2024-06-18T01:46:37.252 INFO:root:teuthology version: 0.0.1.dev325+g8e97141 2024-06-18T01:46:37.252 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-06-17_21:08:03-orch-squid-distro-default-smithi/7760393 --verbose --name teuthology-2024-06-17_21:08:03-orch-squid-distro-default-smithi --description orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/classic} -- /home/teuthworker/archive/teuthology-2024-06-17_21:08:03-orch-squid-distro-default-smithi/7760393/orig.config.yaml 2024-06-18T01:46:37.281 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-06-18T01:46:37.361 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-06-17_21:08:03-orch-squid-distro-default-smithi/7760393 branch: squid description: orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/classic} email: ceph-qa@ceph.com first_in_suite: false job_id: '7760393' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-06-17_21:08:03-orch-squid-distro-default-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: global: mon election default strategy: 1 mgr: debug mgr: 20 debug ms: 1 mgr/cephadm/use_agent: true mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) log-only-match: - CEPHADM_ sha1: 3781e3a592387d16e8020f5db99cdee4198f6d00 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 3781e3a592387d16e8020f5db99cdee4198f6d00 workunit: branch: squid sha1: f18f3f1cbd11e4a41c557e616d172f24deb91473 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - alertmanager.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - grafana.a - node-exporter.b seed: 4712 sha1: 3781e3a592387d16e8020f5db99cdee4198f6d00 sleep_before_teardown: 0 subset: 61/64 suite: orch suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_f18f3f1cbd11e4a41c557e616d172f24deb91473/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: f18f3f1cbd11e4a41c557e616d172f24deb91473 targets: smithi007.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPihHCIAvFlANbmaLG1VJOGlpJ3HlYkdIavDdLtcAKxbZ1RDO+4z0qYf7/Q68bHovfYR9AfVVxmklfwbOmPBSAo= smithi130.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI7T5UryjOx0HWbhCwc3y07voAuOwe1UqVzwT4MTxpNBm8VQxXBjwbLu48w39OThYxUqL+S8mlghCmt1DuHcZdk= tasks: - cephadm: cephadm_branch: v17.2.0 cephadm_git_url: https://github.com/ceph/ceph image: quay.io/ceph/ceph:v17.2.0 - cephadm.shell: mon.a: - ceph config set mgr mgr/cephadm/use_repo_digest false --force - cephadm.shell: env: - sha1 mon.a: - radosgw-admin realm create --rgw-realm=r --default - radosgw-admin zonegroup create --rgw-zonegroup=default --master --default - radosgw-admin zone create --rgw-zonegroup=default --rgw-zone=z --master --default - radosgw-admin period update --rgw-realm=r --commit - ceph orch apply rgw foo --realm r --zone z --placement=2 --port=8000 - ceph orch apply rgw smpl - ceph osd pool create foo - rbd pool init foo - ceph orch apply iscsi foo u p - sleep 120 - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 mon.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph orch upgrade status - ceph health detail - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 - ceph orch ls | grep '^osd ' - cephadm.shell: mon.a: - ceph orch upgrade ls - ceph orch upgrade ls --image quay.io/ceph/ceph --show-all-versions | grep 16.2.0 - ceph orch upgrade ls --image quay.io/ceph/ceph --tags | grep v16.2.2 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 8e9714173de9e92c97e8ef1045d333e96b793454 timestamp: 2024-06-17_21:08:03 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2698841 2024-06-18T01:46:37.362 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_f18f3f1cbd11e4a41c557e616d172f24deb91473/qa; will attempt to use it 2024-06-18T01:46:37.362 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_f18f3f1cbd11e4a41c557e616d172f24deb91473/qa/tasks 2024-06-18T01:46:37.363 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-06-18T01:46:37.364 INFO:teuthology.task.internal:Checking packages... 2024-06-18T01:46:37.385 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '3781e3a592387d16e8020f5db99cdee4198f6d00' 2024-06-18T01:46:37.385 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-06-18T01:46:37.385 INFO:teuthology.packaging:ref: None 2024-06-18T01:46:37.385 INFO:teuthology.packaging:tag: None 2024-06-18T01:46:37.385 INFO:teuthology.packaging:branch: squid 2024-06-18T01:46:37.385 INFO:teuthology.packaging:sha1: 3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T01:46:37.385 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-06-18T01:46:37.692 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3145.gf18f3f1c 2024-06-18T01:46:37.694 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-06-18T01:46:37.702 INFO:teuthology.task.internal:no buildpackages task found 2024-06-18T01:46:37.702 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-06-18T01:46:37.724 INFO:teuthology.task.internal:Saving configuration 2024-06-18T01:46:37.745 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-06-18T01:46:37.755 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-06-18T01:46:37.779 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi007.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-06-17_21:08:03-orch-squid-distro-default-smithi/7760393', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-06-18 01:41:38.721226', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPihHCIAvFlANbmaLG1VJOGlpJ3HlYkdIavDdLtcAKxbZ1RDO+4z0qYf7/Q68bHovfYR9AfVVxmklfwbOmPBSAo='} 2024-06-18T01:46:37.804 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi130.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-06-17_21:08:03-orch-squid-distro-default-smithi/7760393', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-06-18 01:41:38.719357', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI7T5UryjOx0HWbhCwc3y07voAuOwe1UqVzwT4MTxpNBm8VQxXBjwbLu48w39OThYxUqL+S8mlghCmt1DuHcZdk='} 2024-06-18T01:46:37.804 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-06-18T01:46:37.815 INFO:teuthology.task.internal:roles: ubuntu@smithi007.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a'] 2024-06-18T01:46:37.815 INFO:teuthology.task.internal:roles: ubuntu@smithi130.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b'] 2024-06-18T01:46:37.815 INFO:teuthology.run_tasks:Running task console_log... 2024-06-18T01:46:37.951 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd68a747ac0>, signals=[15]) 2024-06-18T01:46:37.951 INFO:teuthology.run_tasks:Running task internal.connect... 2024-06-18T01:46:37.961 INFO:teuthology.task.internal:Opening connections... 2024-06-18T01:46:37.962 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi007.front.sepia.ceph.com 2024-06-18T01:46:37.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-18T01:46:38.050 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi130.front.sepia.ceph.com 2024-06-18T01:46:38.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-18T01:46:38.128 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-06-18T01:46:38.138 DEBUG:teuthology.orchestra.run.smithi007:> uname -m 2024-06-18T01:46:38.156 INFO:teuthology.orchestra.run.smithi007.stdout:x86_64 2024-06-18T01:46:38.156 DEBUG:teuthology.orchestra.run.smithi007:> cat /etc/os-release 2024-06-18T01:46:38.213 INFO:teuthology.orchestra.run.smithi007.stdout:NAME="CentOS Stream" 2024-06-18T01:46:38.213 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION="9" 2024-06-18T01:46:38.213 INFO:teuthology.orchestra.run.smithi007.stdout:ID="centos" 2024-06-18T01:46:38.214 INFO:teuthology.orchestra.run.smithi007.stdout:ID_LIKE="rhel fedora" 2024-06-18T01:46:38.214 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_ID="9" 2024-06-18T01:46:38.214 INFO:teuthology.orchestra.run.smithi007.stdout:PLATFORM_ID="platform:el9" 2024-06-18T01:46:38.214 INFO:teuthology.orchestra.run.smithi007.stdout:PRETTY_NAME="CentOS Stream 9" 2024-06-18T01:46:38.214 INFO:teuthology.orchestra.run.smithi007.stdout:ANSI_COLOR="0;31" 2024-06-18T01:46:38.214 INFO:teuthology.orchestra.run.smithi007.stdout:LOGO="fedora-logo-icon" 2024-06-18T01:46:38.214 INFO:teuthology.orchestra.run.smithi007.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-06-18T01:46:38.214 INFO:teuthology.orchestra.run.smithi007.stdout:HOME_URL="https://centos.org/" 2024-06-18T01:46:38.214 INFO:teuthology.orchestra.run.smithi007.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-06-18T01:46:38.214 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-06-18T01:46:38.214 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-06-18T01:46:38.215 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server 2024-06-18T01:46:38.242 DEBUG:teuthology.orchestra.run.smithi130:> uname -m 2024-06-18T01:46:38.259 INFO:teuthology.orchestra.run.smithi130.stdout:x86_64 2024-06-18T01:46:38.260 DEBUG:teuthology.orchestra.run.smithi130:> cat /etc/os-release 2024-06-18T01:46:38.317 INFO:teuthology.orchestra.run.smithi130.stdout:NAME="CentOS Stream" 2024-06-18T01:46:38.318 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION="9" 2024-06-18T01:46:38.318 INFO:teuthology.orchestra.run.smithi130.stdout:ID="centos" 2024-06-18T01:46:38.318 INFO:teuthology.orchestra.run.smithi130.stdout:ID_LIKE="rhel fedora" 2024-06-18T01:46:38.318 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION_ID="9" 2024-06-18T01:46:38.318 INFO:teuthology.orchestra.run.smithi130.stdout:PLATFORM_ID="platform:el9" 2024-06-18T01:46:38.319 INFO:teuthology.orchestra.run.smithi130.stdout:PRETTY_NAME="CentOS Stream 9" 2024-06-18T01:46:38.319 INFO:teuthology.orchestra.run.smithi130.stdout:ANSI_COLOR="0;31" 2024-06-18T01:46:38.319 INFO:teuthology.orchestra.run.smithi130.stdout:LOGO="fedora-logo-icon" 2024-06-18T01:46:38.319 INFO:teuthology.orchestra.run.smithi130.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-06-18T01:46:38.319 INFO:teuthology.orchestra.run.smithi130.stdout:HOME_URL="https://centos.org/" 2024-06-18T01:46:38.319 INFO:teuthology.orchestra.run.smithi130.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-06-18T01:46:38.320 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-06-18T01:46:38.320 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-06-18T01:46:38.320 INFO:teuthology.lock.ops:Updating smithi130.front.sepia.ceph.com on lock server 2024-06-18T01:46:38.340 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-06-18T01:46:38.350 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-06-18T01:46:38.361 INFO:teuthology.task.internal:Checking for old test directory... 2024-06-18T01:46:38.362 DEBUG:teuthology.orchestra.run.smithi007:> test '!' -e /home/ubuntu/cephtest 2024-06-18T01:46:38.364 DEBUG:teuthology.orchestra.run.smithi130:> test '!' -e /home/ubuntu/cephtest 2024-06-18T01:46:38.380 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-06-18T01:46:38.390 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-06-18T01:46:38.390 DEBUG:teuthology.orchestra.run.smithi007:> test -z $(ls -A /var/lib/ceph) 2024-06-18T01:46:38.421 DEBUG:teuthology.orchestra.run.smithi130:> test -z $(ls -A /var/lib/ceph) 2024-06-18T01:46:38.450 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-06-18T01:46:38.507 INFO:teuthology.run_tasks:Running task kernel... 2024-06-18T01:46:38.524 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-06-18T01:46:38.525 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-06-18T01:46:38.525 DEBUG:teuthology.orchestra.run.smithi007:> test -f /run/.containerenv -o -f /.dockerenv 2024-06-18T01:46:38.525 DEBUG:teuthology.orchestra.run.smithi130:> test -f /run/.containerenv -o -f /.dockerenv 2024-06-18T01:46:38.542 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-18T01:46:38.542 DEBUG:teuthology.orchestra.run.smithi007:> uname -r 2024-06-18T01:46:38.544 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-18T01:46:38.544 DEBUG:teuthology.orchestra.run.smithi130:> uname -r 2024-06-18T01:46:38.600 INFO:teuthology.orchestra.run.smithi007.stdout:5.14.0-437.el9.x86_64 2024-06-18T01:46:38.601 INFO:teuthology.task.kernel:Running kernel on smithi007: 5.14.0-437.el9.x86_64 2024-06-18T01:46:38.601 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum install -y kernel 2024-06-18T01:46:38.602 INFO:teuthology.orchestra.run.smithi130.stdout:5.14.0-437.el9.x86_64 2024-06-18T01:46:38.602 INFO:teuthology.task.kernel:Running kernel on smithi130: 5.14.0-437.el9.x86_64 2024-06-18T01:46:38.603 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum install -y kernel 2024-06-18T01:46:41.798 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - BaseOS 5.0 MB/s | 8.1 MB 00:01 2024-06-18T01:46:41.955 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - BaseOS 4.7 MB/s | 8.1 MB 00:01 2024-06-18T01:46:44.948 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - AppStream 11 MB/s | 20 MB 00:01 2024-06-18T01:46:50.825 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - CRB 3.6 MB/s | 6.3 MB 00:01 2024-06-18T01:46:51.372 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - AppStream 2.3 MB/s | 20 MB 00:08 2024-06-18T01:46:52.396 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - Extras packages 61 kB/s | 17 kB 00:00 2024-06-18T01:46:53.909 INFO:teuthology.orchestra.run.smithi007.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-06-18T01:46:55.615 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.3 MB 00:00 2024-06-18T01:46:57.032 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - Extras packages 80 kB/s | 17 kB 00:00 2024-06-18T01:46:59.349 INFO:teuthology.orchestra.run.smithi007.stdout:lab-extras 22 kB/s | 1.7 kB 00:00 2024-06-18T01:47:01.530 INFO:teuthology.orchestra.run.smithi007.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-06-18T01:47:01.530 INFO:teuthology.orchestra.run.smithi007.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-06-18T01:47:01.623 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2024-06-18T01:47:01.636 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2024-06-18T01:47:01.636 INFO:teuthology.orchestra.run.smithi007.stdout: Package Architecture Version Repository Size 2024-06-18T01:47:01.636 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2024-06-18T01:47:01.636 INFO:teuthology.orchestra.run.smithi007.stdout:Installing: 2024-06-18T01:47:01.636 INFO:teuthology.orchestra.run.smithi007.stdout: kernel x86_64 5.14.0-460.el9 baseos 1.1 M 2024-06-18T01:47:01.636 INFO:teuthology.orchestra.run.smithi007.stdout:Installing dependencies: 2024-06-18T01:47:01.637 INFO:teuthology.orchestra.run.smithi007.stdout: kernel-core x86_64 5.14.0-460.el9 baseos 16 M 2024-06-18T01:47:01.637 INFO:teuthology.orchestra.run.smithi007.stdout: kernel-modules x86_64 5.14.0-460.el9 baseos 35 M 2024-06-18T01:47:01.637 INFO:teuthology.orchestra.run.smithi007.stdout: kernel-modules-core x86_64 5.14.0-460.el9 baseos 29 M 2024-06-18T01:47:01.637 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-06-18T01:47:01.637 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction Summary 2024-06-18T01:47:01.637 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2024-06-18T01:47:01.637 INFO:teuthology.orchestra.run.smithi007.stdout:Install 4 Packages 2024-06-18T01:47:01.637 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-06-18T01:47:01.637 INFO:teuthology.orchestra.run.smithi007.stdout:Total download size: 81 M 2024-06-18T01:47:01.637 INFO:teuthology.orchestra.run.smithi007.stdout:Installed size: 124 M 2024-06-18T01:47:01.637 INFO:teuthology.orchestra.run.smithi007.stdout:Downloading Packages: 2024-06-18T01:47:01.900 INFO:teuthology.orchestra.run.smithi007.stdout:(1/4): kernel-5.14.0-460.el9.x86_64.rpm 4.7 MB/s | 1.1 MB 00:00 2024-06-18T01:47:06.908 INFO:teuthology.orchestra.run.smithi007.stdout:(2/4): kernel-core-5.14.0-460.el9.x86_64.rpm 3.1 MB/s | 16 MB 00:05 2024-06-18T01:47:07.010 INFO:teuthology.orchestra.run.smithi130.stdout:Extra Packages for Enterprise Linux 2.2 MB/s | 21 MB 00:09 2024-06-18T01:47:12.024 INFO:teuthology.orchestra.run.smithi007.stdout:(3/4): kernel-modules-core-5.14.0-460.el9.x86_6 2.9 MB/s | 29 MB 00:10 2024-06-18T01:47:12.308 INFO:teuthology.orchestra.run.smithi130.stdout:lab-extras 15 kB/s | 1.7 kB 00:00 2024-06-18T01:47:13.466 INFO:teuthology.orchestra.run.smithi007.stdout:(4/4): kernel-modules-5.14.0-460.el9.x86_64.rpm 3.0 MB/s | 35 MB 00:11 2024-06-18T01:47:13.466 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2024-06-18T01:47:13.466 INFO:teuthology.orchestra.run.smithi007.stdout:Total 6.9 MB/s | 81 MB 00:11 2024-06-18T01:47:14.206 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction check 2024-06-18T01:47:14.498 INFO:teuthology.orchestra.run.smithi130.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-06-18T01:47:14.498 INFO:teuthology.orchestra.run.smithi130.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-06-18T01:47:14.581 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2024-06-18T01:47:14.593 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2024-06-18T01:47:14.593 INFO:teuthology.orchestra.run.smithi130.stdout: Package Architecture Version Repository Size 2024-06-18T01:47:14.593 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2024-06-18T01:47:14.593 INFO:teuthology.orchestra.run.smithi130.stdout:Installing: 2024-06-18T01:47:14.593 INFO:teuthology.orchestra.run.smithi130.stdout: kernel x86_64 5.14.0-460.el9 baseos 1.1 M 2024-06-18T01:47:14.593 INFO:teuthology.orchestra.run.smithi130.stdout:Installing dependencies: 2024-06-18T01:47:14.593 INFO:teuthology.orchestra.run.smithi130.stdout: kernel-core x86_64 5.14.0-460.el9 baseos 16 M 2024-06-18T01:47:14.593 INFO:teuthology.orchestra.run.smithi130.stdout: kernel-modules x86_64 5.14.0-460.el9 baseos 35 M 2024-06-18T01:47:14.593 INFO:teuthology.orchestra.run.smithi130.stdout: kernel-modules-core x86_64 5.14.0-460.el9 baseos 29 M 2024-06-18T01:47:14.594 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-06-18T01:47:14.594 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2024-06-18T01:47:14.594 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2024-06-18T01:47:14.594 INFO:teuthology.orchestra.run.smithi130.stdout:Install 4 Packages 2024-06-18T01:47:14.594 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-06-18T01:47:14.594 INFO:teuthology.orchestra.run.smithi130.stdout:Total download size: 81 M 2024-06-18T01:47:14.594 INFO:teuthology.orchestra.run.smithi130.stdout:Installed size: 124 M 2024-06-18T01:47:14.594 INFO:teuthology.orchestra.run.smithi130.stdout:Downloading Packages: 2024-06-18T01:47:14.616 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction check succeeded. 2024-06-18T01:47:14.616 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction test 2024-06-18T01:47:15.226 INFO:teuthology.orchestra.run.smithi130.stdout:(1/4): kernel-5.14.0-460.el9.x86_64.rpm 2.9 MB/s | 1.1 MB 00:00 2024-06-18T01:47:15.598 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction test succeeded. 2024-06-18T01:47:15.601 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction 2024-06-18T01:47:18.158 INFO:teuthology.orchestra.run.smithi007.stdout: Preparing : 1/1 2024-06-18T01:47:18.251 INFO:teuthology.orchestra.run.smithi130.stdout:(2/4): kernel-core-5.14.0-460.el9.x86_64.rpm 4.8 MB/s | 16 MB 00:03 2024-06-18T01:47:18.803 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : kernel-modules-core-5.14.0-460.el9.x86_64 1/4 2024-06-18T01:47:18.901 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : kernel-core-5.14.0-460.el9.x86_64 2/4 2024-06-18T01:47:21.426 INFO:teuthology.orchestra.run.smithi130.stdout:(3/4): kernel-modules-5.14.0-460.el9.x86_64.rpm 5.3 MB/s | 35 MB 00:06 2024-06-18T01:47:21.702 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: kernel-core-5.14.0-460.el9.x86_64 2/4 2024-06-18T01:47:21.858 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : kernel-modules-5.14.0-460.el9.x86_64 3/4 2024-06-18T01:47:24.159 INFO:teuthology.orchestra.run.smithi130.stdout:(4/4): kernel-modules-core-5.14.0-460.el9.x86_6 3.3 MB/s | 29 MB 00:08 2024-06-18T01:47:24.159 INFO:teuthology.orchestra.run.smithi130.stdout:-------------------------------------------------------------------------------- 2024-06-18T01:47:24.159 INFO:teuthology.orchestra.run.smithi130.stdout:Total 8.5 MB/s | 81 MB 00:09 2024-06-18T01:47:24.867 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2024-06-18T01:47:25.202 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2024-06-18T01:47:25.203 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2024-06-18T01:47:26.158 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2024-06-18T01:47:26.158 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2024-06-18T01:47:26.965 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: kernel-modules-5.14.0-460.el9.x86_64 3/4 2024-06-18T01:47:27.023 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : kernel-5.14.0-460.el9.x86_64 4/4 2024-06-18T01:47:28.562 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2024-06-18T01:47:29.291 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : kernel-modules-core-5.14.0-460.el9.x86_64 1/4 2024-06-18T01:47:29.385 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : kernel-core-5.14.0-460.el9.x86_64 2/4 2024-06-18T01:47:32.068 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: kernel-core-5.14.0-460.el9.x86_64 2/4 2024-06-18T01:47:32.208 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : kernel-modules-5.14.0-460.el9.x86_64 3/4 2024-06-18T01:47:32.294 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: kernel-modules-core-5.14.0-460.el9.x86_64 4/4 2024-06-18T01:47:36.928 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: kernel-modules-5.14.0-460.el9.x86_64 3/4 2024-06-18T01:47:36.982 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : kernel-5.14.0-460.el9.x86_64 4/4 2024-06-18T01:47:41.726 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: kernel-modules-core-5.14.0-460.el9.x86_64 4/4 2024-06-18T01:48:03.413 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: kernel-core-5.14.0-460.el9.x86_64 4/4 2024-06-18T01:48:03.454 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: kernel-modules-5.14.0-460.el9.x86_64 4/4 2024-06-18T01:48:03.828 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: kernel-5.14.0-460.el9.x86_64 4/4 2024-06-18T01:48:03.828 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : kernel-5.14.0-460.el9.x86_64 1/4 2024-06-18T01:48:03.828 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : kernel-core-5.14.0-460.el9.x86_64 2/4 2024-06-18T01:48:03.828 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : kernel-modules-5.14.0-460.el9.x86_64 3/4 2024-06-18T01:48:04.593 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : kernel-modules-core-5.14.0-460.el9.x86_64 4/4 2024-06-18T01:48:04.593 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-06-18T01:48:04.593 INFO:teuthology.orchestra.run.smithi007.stdout:Installed: 2024-06-18T01:48:04.593 INFO:teuthology.orchestra.run.smithi007.stdout: kernel-5.14.0-460.el9.x86_64 2024-06-18T01:48:04.593 INFO:teuthology.orchestra.run.smithi007.stdout: kernel-core-5.14.0-460.el9.x86_64 2024-06-18T01:48:04.593 INFO:teuthology.orchestra.run.smithi007.stdout: kernel-modules-5.14.0-460.el9.x86_64 2024-06-18T01:48:04.593 INFO:teuthology.orchestra.run.smithi007.stdout: kernel-modules-core-5.14.0-460.el9.x86_64 2024-06-18T01:48:04.593 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-06-18T01:48:04.593 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2024-06-18T01:48:04.969 DEBUG:teuthology.orchestra.run.smithi007:> rpm -q kernel | sort -rV | head -n 1 2024-06-18T01:48:05.048 INFO:teuthology.orchestra.run.smithi007.stdout:kernel-5.14.0-460.el9.x86_64 2024-06-18T01:48:05.048 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-460.el9.x86_64 2024-06-18T01:48:05.048 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-460.el9.x86_64 2024-06-18T01:48:05.048 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-06-18T01:48:05.048 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-06-18T01:48:05.049 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-06-18T01:48:05.049 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi007.front.sepia.ceph.com, path=None, version=distro) 2024-06-18T01:48:05.049 DEBUG:teuthology.orchestra.run.smithi007:> rpm -q kernel | sort -rV | head -n 1 2024-06-18T01:48:05.104 INFO:teuthology.orchestra.run.smithi007.stdout:kernel-5.14.0-460.el9.x86_64 2024-06-18T01:48:05.104 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-460.el9.x86_64 2024-06-18T01:48:05.104 DEBUG:teuthology.orchestra.run.smithi007:> sudo rpm -qi grub2-tools 2024-06-18T01:48:05.135 INFO:teuthology.orchestra.run.smithi007.stdout:Name : grub2-tools 2024-06-18T01:48:05.135 INFO:teuthology.orchestra.run.smithi007.stdout:Epoch : 1 2024-06-18T01:48:05.135 INFO:teuthology.orchestra.run.smithi007.stdout:Version : 2.06 2024-06-18T01:48:05.135 INFO:teuthology.orchestra.run.smithi007.stdout:Release : 68.el9 2024-06-18T01:48:05.136 INFO:teuthology.orchestra.run.smithi007.stdout:Architecture: x86_64 2024-06-18T01:48:05.136 INFO:teuthology.orchestra.run.smithi007.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-06-18T01:48:05.136 INFO:teuthology.orchestra.run.smithi007.stdout:Group : Unspecified 2024-06-18T01:48:05.136 INFO:teuthology.orchestra.run.smithi007.stdout:Size : 8264254 2024-06-18T01:48:05.136 INFO:teuthology.orchestra.run.smithi007.stdout:License : GPLv3+ 2024-06-18T01:48:05.136 INFO:teuthology.orchestra.run.smithi007.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-06-18T01:48:05.136 INFO:teuthology.orchestra.run.smithi007.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-06-18T01:48:05.136 INFO:teuthology.orchestra.run.smithi007.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-06-18T01:48:05.136 INFO:teuthology.orchestra.run.smithi007.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-06-18T01:48:05.136 INFO:teuthology.orchestra.run.smithi007.stdout:Packager : builder@centos.org 2024-06-18T01:48:05.136 INFO:teuthology.orchestra.run.smithi007.stdout:Vendor : CentOS 2024-06-18T01:48:05.136 INFO:teuthology.orchestra.run.smithi007.stdout:URL : http://www.gnu.org/software/grub/ 2024-06-18T01:48:05.136 INFO:teuthology.orchestra.run.smithi007.stdout:Summary : Support tools for GRUB. 2024-06-18T01:48:05.136 INFO:teuthology.orchestra.run.smithi007.stdout:Description : 2024-06-18T01:48:05.137 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-06-18T01:48:05.137 INFO:teuthology.orchestra.run.smithi007.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-06-18T01:48:05.137 INFO:teuthology.orchestra.run.smithi007.stdout:customizable bootloader with modular architecture. It supports a rich 2024-06-18T01:48:05.137 INFO:teuthology.orchestra.run.smithi007.stdout:variety of kernel formats, file systems, computer architectures and 2024-06-18T01:48:05.137 INFO:teuthology.orchestra.run.smithi007.stdout:hardware devices. 2024-06-18T01:48:05.137 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-06-18T01:48:05.137 INFO:teuthology.orchestra.run.smithi007.stdout:This subpackage provides tools for support of all platforms. 2024-06-18T01:48:05.138 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-06-18T01:48:05.138 INFO:teuthology.task.kernel:Updating grub on smithi007 to boot 5.14.0-460.el9.x86_64 2024-06-18T01:48:05.138 DEBUG:teuthology.orchestra.run.smithi007:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-06-18T01:48:05.731 INFO:teuthology.orchestra.run.smithi007.stderr:Generating grub configuration file ... 2024-06-18T01:48:07.192 INFO:teuthology.orchestra.run.smithi007.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-06-18T01:48:07.216 INFO:teuthology.orchestra.run.smithi007.stderr:done 2024-06-18T01:48:07.218 DEBUG:teuthology.orchestra.run.smithi007:> mktemp 2024-06-18T01:48:07.236 INFO:teuthology.orchestra.run.smithi007.stdout:/tmp/tmp.qgKe9V1lsM 2024-06-18T01:48:07.236 DEBUG:teuthology.orchestra.run.smithi007:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.qgKe9V1lsM 2024-06-18T01:48:07.304 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0666 /tmp/tmp.qgKe9V1lsM 2024-06-18T01:48:07.447 DEBUG:teuthology.orchestra.remote:smithi007:/tmp/tmp.qgKe9V1lsM is 6KB 2024-06-18T01:48:07.495 DEBUG:teuthology.orchestra.run.smithi007:> rm -fr /tmp/tmp.qgKe9V1lsM 2024-06-18T01:48:07.510 DEBUG:teuthology.orchestra.run.smithi007:> sudo /bin/ls /boot/loader/entries || true 2024-06-18T01:48:07.580 INFO:teuthology.orchestra.run.smithi007.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-06-18T01:48:07.580 INFO:teuthology.orchestra.run.smithi007.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-06-18T01:48:07.580 INFO:teuthology.orchestra.run.smithi007.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-06-18T01:48:07.581 INFO:teuthology.orchestra.run.smithi007.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-460.el9.x86_64.conf 2024-06-18T01:48:07.582 DEBUG:teuthology.orchestra.run.smithi007:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-460.el9.x86_64 2024-06-18T01:48:07.741 DEBUG:teuthology.orchestra.run.smithi007:> sudo shutdown -r now 2024-06-18T01:48:11.272 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: kernel-core-5.14.0-460.el9.x86_64 4/4 2024-06-18T01:48:11.312 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: kernel-modules-5.14.0-460.el9.x86_64 4/4 2024-06-18T01:48:11.717 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: kernel-5.14.0-460.el9.x86_64 4/4 2024-06-18T01:48:11.717 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : kernel-5.14.0-460.el9.x86_64 1/4 2024-06-18T01:48:11.717 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : kernel-core-5.14.0-460.el9.x86_64 2/4 2024-06-18T01:48:11.717 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : kernel-modules-5.14.0-460.el9.x86_64 3/4 2024-06-18T01:48:12.511 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : kernel-modules-core-5.14.0-460.el9.x86_64 4/4 2024-06-18T01:48:12.511 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-06-18T01:48:12.511 INFO:teuthology.orchestra.run.smithi130.stdout:Installed: 2024-06-18T01:48:12.511 INFO:teuthology.orchestra.run.smithi130.stdout: kernel-5.14.0-460.el9.x86_64 2024-06-18T01:48:12.511 INFO:teuthology.orchestra.run.smithi130.stdout: kernel-core-5.14.0-460.el9.x86_64 2024-06-18T01:48:12.511 INFO:teuthology.orchestra.run.smithi130.stdout: kernel-modules-5.14.0-460.el9.x86_64 2024-06-18T01:48:12.511 INFO:teuthology.orchestra.run.smithi130.stdout: kernel-modules-core-5.14.0-460.el9.x86_64 2024-06-18T01:48:12.511 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-06-18T01:48:12.511 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2024-06-18T01:48:12.902 DEBUG:teuthology.orchestra.run.smithi130:> rpm -q kernel | sort -rV | head -n 1 2024-06-18T01:48:12.979 INFO:teuthology.orchestra.run.smithi130.stdout:kernel-5.14.0-460.el9.x86_64 2024-06-18T01:48:12.980 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-460.el9.x86_64 2024-06-18T01:48:12.980 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-460.el9.x86_64 2024-06-18T01:48:12.980 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-06-18T01:48:12.980 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-06-18T01:48:12.980 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-06-18T01:48:12.981 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi130.front.sepia.ceph.com, path=None, version=distro) 2024-06-18T01:48:12.981 DEBUG:teuthology.orchestra.run.smithi130:> rpm -q kernel | sort -rV | head -n 1 2024-06-18T01:48:13.034 INFO:teuthology.orchestra.run.smithi130.stdout:kernel-5.14.0-460.el9.x86_64 2024-06-18T01:48:13.034 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-460.el9.x86_64 2024-06-18T01:48:13.035 DEBUG:teuthology.orchestra.run.smithi130:> sudo rpm -qi grub2-tools 2024-06-18T01:48:13.071 INFO:teuthology.orchestra.run.smithi130.stdout:Name : grub2-tools 2024-06-18T01:48:13.072 INFO:teuthology.orchestra.run.smithi130.stdout:Epoch : 1 2024-06-18T01:48:13.072 INFO:teuthology.orchestra.run.smithi130.stdout:Version : 2.06 2024-06-18T01:48:13.072 INFO:teuthology.orchestra.run.smithi130.stdout:Release : 68.el9 2024-06-18T01:48:13.072 INFO:teuthology.orchestra.run.smithi130.stdout:Architecture: x86_64 2024-06-18T01:48:13.072 INFO:teuthology.orchestra.run.smithi130.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-06-18T01:48:13.072 INFO:teuthology.orchestra.run.smithi130.stdout:Group : Unspecified 2024-06-18T01:48:13.072 INFO:teuthology.orchestra.run.smithi130.stdout:Size : 8264254 2024-06-18T01:48:13.072 INFO:teuthology.orchestra.run.smithi130.stdout:License : GPLv3+ 2024-06-18T01:48:13.072 INFO:teuthology.orchestra.run.smithi130.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-06-18T01:48:13.072 INFO:teuthology.orchestra.run.smithi130.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-06-18T01:48:13.073 INFO:teuthology.orchestra.run.smithi130.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-06-18T01:48:13.073 INFO:teuthology.orchestra.run.smithi130.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-06-18T01:48:13.073 INFO:teuthology.orchestra.run.smithi130.stdout:Packager : builder@centos.org 2024-06-18T01:48:13.073 INFO:teuthology.orchestra.run.smithi130.stdout:Vendor : CentOS 2024-06-18T01:48:13.073 INFO:teuthology.orchestra.run.smithi130.stdout:URL : http://www.gnu.org/software/grub/ 2024-06-18T01:48:13.073 INFO:teuthology.orchestra.run.smithi130.stdout:Summary : Support tools for GRUB. 2024-06-18T01:48:13.073 INFO:teuthology.orchestra.run.smithi130.stdout:Description : 2024-06-18T01:48:13.073 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-06-18T01:48:13.073 INFO:teuthology.orchestra.run.smithi130.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-06-18T01:48:13.073 INFO:teuthology.orchestra.run.smithi130.stdout:customizable bootloader with modular architecture. It supports a rich 2024-06-18T01:48:13.073 INFO:teuthology.orchestra.run.smithi130.stdout:variety of kernel formats, file systems, computer architectures and 2024-06-18T01:48:13.073 INFO:teuthology.orchestra.run.smithi130.stdout:hardware devices. 2024-06-18T01:48:13.073 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-06-18T01:48:13.074 INFO:teuthology.orchestra.run.smithi130.stdout:This subpackage provides tools for support of all platforms. 2024-06-18T01:48:13.074 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-06-18T01:48:13.075 INFO:teuthology.task.kernel:Updating grub on smithi130 to boot 5.14.0-460.el9.x86_64 2024-06-18T01:48:13.075 DEBUG:teuthology.orchestra.run.smithi130:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-06-18T01:48:13.681 INFO:teuthology.orchestra.run.smithi130.stderr:Generating grub configuration file ... 2024-06-18T01:48:15.053 INFO:teuthology.orchestra.run.smithi130.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-06-18T01:48:15.092 INFO:teuthology.orchestra.run.smithi130.stderr:done 2024-06-18T01:48:15.094 DEBUG:teuthology.orchestra.run.smithi130:> mktemp 2024-06-18T01:48:15.112 INFO:teuthology.orchestra.run.smithi130.stdout:/tmp/tmp.FW2U13dzNV 2024-06-18T01:48:15.113 DEBUG:teuthology.orchestra.run.smithi130:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.FW2U13dzNV 2024-06-18T01:48:15.178 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 0666 /tmp/tmp.FW2U13dzNV 2024-06-18T01:48:15.308 DEBUG:teuthology.orchestra.remote:smithi130:/tmp/tmp.FW2U13dzNV is 6KB 2024-06-18T01:48:15.356 DEBUG:teuthology.orchestra.run.smithi130:> rm -fr /tmp/tmp.FW2U13dzNV 2024-06-18T01:48:15.370 DEBUG:teuthology.orchestra.run.smithi130:> sudo /bin/ls /boot/loader/entries || true 2024-06-18T01:48:15.454 INFO:teuthology.orchestra.run.smithi130.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-06-18T01:48:15.455 INFO:teuthology.orchestra.run.smithi130.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-06-18T01:48:15.455 INFO:teuthology.orchestra.run.smithi130.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-06-18T01:48:15.455 INFO:teuthology.orchestra.run.smithi130.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-460.el9.x86_64.conf 2024-06-18T01:48:15.458 DEBUG:teuthology.orchestra.run.smithi130:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-460.el9.x86_64 2024-06-18T01:48:15.566 DEBUG:teuthology.orchestra.run.smithi130:> sudo shutdown -r now 2024-06-18T01:48:37.766 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-06-18T01:48:37.767 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-06-18T01:48:37.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-18T01:48:45.576 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-06-18T01:48:45.576 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-06-18T01:48:45.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-18T01:48:56.223 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.7 2024-06-18T01:49:03.902 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.130 2024-06-18T01:49:05.225 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-06-18T01:49:05.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-18T01:49:08.286 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.7 2024-06-18T01:49:12.906 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-06-18T01:49:12.907 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-18T01:49:15.966 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.130 2024-06-18T01:49:20.289 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-06-18T01:49:20.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-18T01:49:23.358 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.7 2024-06-18T01:49:27.970 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-06-18T01:49:27.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-18T01:49:38.370 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-06-18T01:49:38.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-18T01:49:41.438 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.7 2024-06-18T01:49:59.454 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-06-18T01:49:59.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-18T01:49:59.806 DEBUG:teuthology.orchestra.run.smithi130:> true 2024-06-18T01:50:00.197 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-06-18T01:50:00.197 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-460.el9.x86_64"... 2024-06-18T01:50:00.197 DEBUG:teuthology.orchestra.run.smithi130:> uname -r 2024-06-18T01:50:00.212 INFO:teuthology.orchestra.run.smithi130.stdout:5.14.0-460.el9.x86_64 2024-06-18T01:50:00.212 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-460.el9.x86_64 vs 5.14.0-460.el9.x86_64 2024-06-18T01:50:00.212 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-06-18T01:50:00.212 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-06-18T01:50:01.212 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-06-18T01:50:01.213 DEBUG:teuthology.orchestra.run.smithi130:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-06-18T01:50:01.303 INFO:teuthology.orchestra.run.smithi130.stdout:ttyS1 2024-06-18T01:50:01.338 DEBUG:teuthology.parallel:result is None 2024-06-18T01:50:02.526 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.7 2024-06-18T01:50:23.527 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-06-18T01:50:23.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-18T01:50:44.979 DEBUG:teuthology.orchestra.run.smithi007:> true 2024-06-18T01:50:45.415 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-06-18T01:50:45.415 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-460.el9.x86_64"... 2024-06-18T01:50:45.415 DEBUG:teuthology.orchestra.run.smithi007:> uname -r 2024-06-18T01:50:45.432 INFO:teuthology.orchestra.run.smithi007.stdout:5.14.0-460.el9.x86_64 2024-06-18T01:50:45.433 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-460.el9.x86_64 vs 5.14.0-460.el9.x86_64 2024-06-18T01:50:45.433 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-06-18T01:50:45.433 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-06-18T01:50:46.434 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-06-18T01:50:46.434 DEBUG:teuthology.orchestra.run.smithi007:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-06-18T01:50:46.508 INFO:teuthology.orchestra.run.smithi007.stdout:ttyS1 2024-06-18T01:50:46.545 DEBUG:teuthology.parallel:result is None 2024-06-18T01:50:46.546 INFO:teuthology.run_tasks:Running task internal.base... 2024-06-18T01:50:46.553 INFO:teuthology.task.internal:Creating test directory... 2024-06-18T01:50:46.553 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-06-18T01:50:46.556 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-06-18T01:50:46.576 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-06-18T01:50:46.582 INFO:teuthology.run_tasks:Running task internal.archive... 2024-06-18T01:50:46.590 INFO:teuthology.task.internal:Creating archive directory... 2024-06-18T01:50:46.590 DEBUG:teuthology.orchestra.run.smithi007:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-06-18T01:50:46.615 DEBUG:teuthology.orchestra.run.smithi130:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-06-18T01:50:46.706 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-06-18T01:50:46.712 INFO:teuthology.task.internal:Enabling coredump saving... 2024-06-18T01:50:46.713 DEBUG:teuthology.orchestra.run.smithi007:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-06-18T01:50:46.715 DEBUG:teuthology.orchestra.run.smithi130:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-06-18T01:50:46.744 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-18T01:50:46.746 INFO:teuthology.orchestra.run.smithi130.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-18T01:50:46.755 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-18T01:50:46.758 INFO:teuthology.orchestra.run.smithi130.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-18T01:50:46.760 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-06-18T01:50:46.766 INFO:teuthology.task.internal:Configuring sudo... 2024-06-18T01:50:46.767 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-06-18T01:50:46.800 DEBUG:teuthology.orchestra.run.smithi130:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-06-18T01:50:46.827 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-06-18T01:50:46.836 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-06-18T01:50:46.836 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-06-18T01:50:46.869 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-06-18T01:50:46.885 DEBUG:teuthology.orchestra.run.smithi007:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-18T01:50:46.969 DEBUG:teuthology.orchestra.run.smithi007:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-18T01:50:47.011 DEBUG:teuthology.orchestra.run.smithi007:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-18T01:50:47.095 DEBUG:teuthology.orchestra.run.smithi007:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-18T01:50:47.135 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-06-18T01:50:47.135 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-06-18T01:50:47.206 DEBUG:teuthology.orchestra.run.smithi130:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-18T01:50:47.252 DEBUG:teuthology.orchestra.run.smithi130:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-18T01:50:47.297 DEBUG:teuthology.orchestra.run.smithi130:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-18T01:50:47.382 DEBUG:teuthology.orchestra.run.smithi130:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-18T01:50:47.423 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-06-18T01:50:47.423 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-06-18T01:50:47.489 DEBUG:teuthology.orchestra.run.smithi007:> sudo service rsyslog restart 2024-06-18T01:50:47.491 DEBUG:teuthology.orchestra.run.smithi130:> sudo service rsyslog restart 2024-06-18T01:50:47.554 INFO:teuthology.orchestra.run.smithi007.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-18T01:50:47.588 INFO:teuthology.orchestra.run.smithi130.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-18T01:50:48.077 INFO:teuthology.run_tasks:Running task internal.timer... 2024-06-18T01:50:48.085 INFO:teuthology.task.internal:Starting timer... 2024-06-18T01:50:48.085 INFO:teuthology.run_tasks:Running task pcp... 2024-06-18T01:50:48.099 INFO:teuthology.run_tasks:Running task selinux... 2024-06-18T01:50:48.107 DEBUG:teuthology.orchestra.run.smithi007:> sudo service auditd rotate 2024-06-18T01:50:48.173 INFO:teuthology.orchestra.run.smithi007.stdout:Rotating logs: 2024-06-18T01:50:48.175 DEBUG:teuthology.orchestra.run.smithi130:> sudo service auditd rotate 2024-06-18T01:50:48.238 INFO:teuthology.orchestra.run.smithi130.stdout:Rotating logs: 2024-06-18T01:50:48.239 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-06-18T01:50:48.240 DEBUG:teuthology.orchestra.run.smithi007:> /usr/sbin/getenforce 2024-06-18T01:50:48.263 INFO:teuthology.orchestra.run.smithi007.stdout:Permissive 2024-06-18T01:50:48.263 DEBUG:teuthology.orchestra.run.smithi130:> /usr/sbin/getenforce 2024-06-18T01:50:48.288 INFO:teuthology.orchestra.run.smithi130.stdout:Permissive 2024-06-18T01:50:48.289 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi007.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi130.front.sepia.ceph.com': 'permissive'} 2024-06-18T01:50:48.289 DEBUG:teuthology.orchestra.run.smithi007:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-06-18T01:50:48.330 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-18T01:50:48.330 DEBUG:teuthology.orchestra.run.smithi130:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-06-18T01:50:48.358 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-18T01:50:48.358 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-06-18T01:50:48.358 DEBUG:teuthology.orchestra.run.smithi007:> sudo /usr/sbin/setenforce permissive 2024-06-18T01:50:48.403 DEBUG:teuthology.orchestra.run.smithi130:> sudo /usr/sbin/setenforce permissive 2024-06-18T01:50:48.430 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-06-18T01:50:48.439 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-06-18T01:50:48.451 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-06-18T01:50:48.451 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi007.front.sepia.ceph.com,smithi130.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-06-18T01:55:13.301 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi007.front.sepia.ceph.com'), Remote(name='ubuntu@smithi130.front.sepia.ceph.com')] 2024-06-18T01:55:13.303 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-06-18T01:55:13.304 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-18T01:55:13.385 DEBUG:teuthology.orchestra.run.smithi007:> true 2024-06-18T01:55:13.420 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-06-18T01:55:13.421 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-06-18T01:55:13.421 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-18T01:55:13.496 DEBUG:teuthology.orchestra.run.smithi130:> true 2024-06-18T01:55:13.574 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-06-18T01:55:13.574 INFO:teuthology.run_tasks:Running task clock... 2024-06-18T01:55:13.587 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-06-18T01:55:13.588 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-06-18T01:55:13.588 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-18T01:55:13.590 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-06-18T01:55:13.590 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-18T01:55:13.620 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-06-18T01:55:13.636 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-06-18T01:55:13.643 INFO:teuthology.orchestra.run.smithi130.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-06-18T01:55:13.658 INFO:teuthology.orchestra.run.smithi130.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-06-18T01:55:13.661 INFO:teuthology.orchestra.run.smithi007.stderr:sudo: ntpd: command not found 2024-06-18T01:55:13.673 INFO:teuthology.orchestra.run.smithi007.stdout:506 Cannot talk to daemon 2024-06-18T01:55:13.682 INFO:teuthology.orchestra.run.smithi130.stderr:sudo: ntpd: command not found 2024-06-18T01:55:13.688 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-06-18T01:55:13.693 INFO:teuthology.orchestra.run.smithi130.stdout:506 Cannot talk to daemon 2024-06-18T01:55:13.702 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-06-18T01:55:13.707 INFO:teuthology.orchestra.run.smithi130.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-06-18T01:55:13.721 INFO:teuthology.orchestra.run.smithi130.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-06-18T01:55:13.757 INFO:teuthology.orchestra.run.smithi007.stderr:bash: line 1: ntpq: command not found 2024-06-18T01:55:13.760 INFO:teuthology.orchestra.run.smithi007.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-18T01:55:13.761 INFO:teuthology.orchestra.run.smithi007.stdout:=============================================================================== 2024-06-18T01:55:13.761 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-18T01:55:13.761 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-18T01:55:13.761 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-18T01:55:13.761 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-18T01:55:13.776 INFO:teuthology.orchestra.run.smithi130.stderr:bash: line 1: ntpq: command not found 2024-06-18T01:55:13.779 INFO:teuthology.orchestra.run.smithi130.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-18T01:55:13.779 INFO:teuthology.orchestra.run.smithi130.stdout:=============================================================================== 2024-06-18T01:55:13.779 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-18T01:55:13.779 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-18T01:55:13.779 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-18T01:55:13.779 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-18T01:55:13.780 INFO:teuthology.run_tasks:Running task cephadm... 2024-06-18T01:55:13.876 INFO:tasks.cephadm:Config: {'cephadm_branch': 'v17.2.0', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'image': 'quay.io/ceph/ceph:v17.2.0', 'conf': {'global': {'mon election default strategy': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr/cephadm/use_agent': True}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'log-only-match': ['CEPHADM_'], 'sha1': '3781e3a592387d16e8020f5db99cdee4198f6d00'} 2024-06-18T01:55:13.876 INFO:tasks.cephadm:Cluster image is quay.io/ceph/ceph:v17.2.0 2024-06-18T01:55:13.877 INFO:tasks.cephadm:Cluster fsid is cd9a3408-2d15-11ef-bc9d-c7b262605968 2024-06-18T01:55:13.877 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-06-18T01:55:13.877 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.7', 'mon.c': '[v2:172.21.15.7:3301,v1:172.21.15.7:6790]', 'mon.b': '172.21.15.130'} 2024-06-18T01:55:13.878 INFO:tasks.cephadm:First mon is mon.a on smithi007 2024-06-18T01:55:13.878 INFO:tasks.cephadm:First mgr is y 2024-06-18T01:55:13.878 INFO:tasks.cephadm:Normalizing hostnames... 2024-06-18T01:55:13.878 DEBUG:teuthology.orchestra.run.smithi007:> sudo hostname $(hostname -s) 2024-06-18T01:55:13.905 DEBUG:teuthology.orchestra.run.smithi130:> sudo hostname $(hostname -s) 2024-06-18T01:55:13.931 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref v17.2.0)... 2024-06-18T01:55:13.931 DEBUG:teuthology.orchestra.run.smithi007:> curl --silent https://raw.githubusercontent.com/ceph/ceph/v17.2.0/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-06-18T01:55:14.252 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r--. 1 ubuntu ubuntu 320521 Jun 18 01:55 /home/ubuntu/cephtest/cephadm 2024-06-18T01:55:14.252 DEBUG:teuthology.orchestra.run.smithi130:> curl --silent https://raw.githubusercontent.com/ceph/ceph/v17.2.0/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-06-18T01:55:14.418 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r--. 1 ubuntu ubuntu 320521 Jun 18 01:55 /home/ubuntu/cephtest/cephadm 2024-06-18T01:55:14.418 DEBUG:teuthology.orchestra.run.smithi007:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-06-18T01:55:14.435 DEBUG:teuthology.orchestra.run.smithi130:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-06-18T01:55:14.461 INFO:tasks.cephadm:Pulling image quay.io/ceph/ceph:v17.2.0 on all hosts... 2024-06-18T01:55:14.461 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 pull 2024-06-18T01:55:14.477 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 pull 2024-06-18T01:55:15.270 INFO:teuthology.orchestra.run.smithi130.stderr:Pulling container image quay.io/ceph/ceph:v17.2.0... 2024-06-18T01:55:15.404 INFO:teuthology.orchestra.run.smithi007.stderr:Pulling container image quay.io/ceph/ceph:v17.2.0... 2024-06-18T01:55:31.491 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T01:55:31.491 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_version": "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)", 2024-06-18T01:55:31.491 INFO:teuthology.orchestra.run.smithi007.stdout: "image_id": "e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9", 2024-06-18T01:55:31.491 INFO:teuthology.orchestra.run.smithi007.stdout: "repo_digests": [ 2024-06-18T01:55:31.491 INFO:teuthology.orchestra.run.smithi007.stdout: "quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a", 2024-06-18T01:55:31.491 INFO:teuthology.orchestra.run.smithi007.stdout: "quay.io/ceph/ceph@sha256:cb4d698cb769b6aba05bf6ef04f41a7fe694160140347576e13bd9348514b667" 2024-06-18T01:55:31.491 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-06-18T01:55:31.491 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T01:55:31.502 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-06-18T01:55:31.502 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_version": "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)", 2024-06-18T01:55:31.502 INFO:teuthology.orchestra.run.smithi130.stdout: "image_id": "e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9", 2024-06-18T01:55:31.502 INFO:teuthology.orchestra.run.smithi130.stdout: "repo_digests": [ 2024-06-18T01:55:31.503 INFO:teuthology.orchestra.run.smithi130.stdout: "quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a", 2024-06-18T01:55:31.503 INFO:teuthology.orchestra.run.smithi130.stdout: "quay.io/ceph/ceph@sha256:cb4d698cb769b6aba05bf6ef04f41a7fe694160140347576e13bd9348514b667" 2024-06-18T01:55:31.503 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-06-18T01:55:31.503 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-06-18T01:55:31.521 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /etc/ceph 2024-06-18T01:55:31.558 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /etc/ceph 2024-06-18T01:55:31.586 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 777 /etc/ceph 2024-06-18T01:55:31.626 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 777 /etc/ceph 2024-06-18T01:55:31.650 INFO:tasks.cephadm:Writing seed config... 2024-06-18T01:55:31.651 INFO:tasks.cephadm: override: [global] mon election default strategy = 1 2024-06-18T01:55:31.652 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-06-18T01:55:31.652 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-06-18T01:55:31.652 INFO:tasks.cephadm: override: [mgr] mgr/cephadm/use_agent = True 2024-06-18T01:55:31.652 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-06-18T01:55:31.652 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-06-18T01:55:31.652 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-06-18T01:55:31.652 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-06-18T01:55:31.652 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-06-18T01:55:31.653 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-06-18T01:55:31.653 DEBUG:teuthology.orchestra.run.smithi007:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-06-18T01:55:31.683 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = cd9a3408-2d15-11ef-bc9d-c7b262605968 mon election default strategy = 1 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 mgr/cephadm/use_agent = True [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-06-18T01:55:31.683 DEBUG:teuthology.orchestra.run.smithi007:mon.a> sudo journalctl -f -n 0 -u ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mon.a.service 2024-06-18T01:55:31.725 DEBUG:teuthology.orchestra.run.smithi007:mgr.y> sudo journalctl -f -n 0 -u ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mgr.y.service 2024-06-18T01:55:31.768 INFO:tasks.cephadm:Bootstrapping... 2024-06-18T01:55:31.768 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 -v bootstrap --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.7 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-06-18T01:55:31.970 INFO:teuthology.orchestra.run.smithi007.stderr:-------------------------------------------------------------------------------- 2024-06-18T01:55:31.970 INFO:teuthology.orchestra.run.smithi007.stderr:cephadm ['--image', 'quay.io/ceph/ceph:v17.2.0', '-v', 'bootstrap', '--fsid', 'cd9a3408-2d15-11ef-bc9d-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'y', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.7', '--skip-admin-label'] 2024-06-18T01:55:31.993 INFO:teuthology.orchestra.run.smithi007.stderr:/bin/podman: 5.1.0 2024-06-18T01:55:31.996 INFO:teuthology.orchestra.run.smithi007.stderr:Verifying podman|docker is present... 2024-06-18T01:55:32.018 INFO:teuthology.orchestra.run.smithi007.stderr:/bin/podman: 5.1.0 2024-06-18T01:55:32.020 INFO:teuthology.orchestra.run.smithi007.stderr:Verifying lvm2 is present... 2024-06-18T01:55:32.020 INFO:teuthology.orchestra.run.smithi007.stderr:Verifying time synchronization is in place... 2024-06-18T01:55:32.027 INFO:teuthology.orchestra.run.smithi007.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2024-06-18T01:55:32.034 INFO:teuthology.orchestra.run.smithi007.stderr:systemctl: inactive 2024-06-18T01:55:32.041 INFO:teuthology.orchestra.run.smithi007.stderr:systemctl: enabled 2024-06-18T01:55:32.048 INFO:teuthology.orchestra.run.smithi007.stderr:systemctl: active 2024-06-18T01:55:32.048 INFO:teuthology.orchestra.run.smithi007.stderr:Unit chronyd.service is enabled and running 2024-06-18T01:55:32.049 INFO:teuthology.orchestra.run.smithi007.stderr:Repeating the final host check... 2024-06-18T01:55:32.070 INFO:teuthology.orchestra.run.smithi007.stderr:/bin/podman: 5.1.0 2024-06-18T01:55:32.073 INFO:teuthology.orchestra.run.smithi007.stderr:podman (/bin/podman) version 5.1.0 is present 2024-06-18T01:55:32.073 INFO:teuthology.orchestra.run.smithi007.stderr:systemctl is present 2024-06-18T01:55:32.073 INFO:teuthology.orchestra.run.smithi007.stderr:lvcreate is present 2024-06-18T01:55:32.079 INFO:teuthology.orchestra.run.smithi007.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2024-06-18T01:55:32.086 INFO:teuthology.orchestra.run.smithi007.stderr:systemctl: inactive 2024-06-18T01:55:32.093 INFO:teuthology.orchestra.run.smithi007.stderr:systemctl: enabled 2024-06-18T01:55:32.099 INFO:teuthology.orchestra.run.smithi007.stderr:systemctl: active 2024-06-18T01:55:32.100 INFO:teuthology.orchestra.run.smithi007.stderr:Unit chronyd.service is enabled and running 2024-06-18T01:55:32.100 INFO:teuthology.orchestra.run.smithi007.stderr:Host looks OK 2024-06-18T01:55:32.100 INFO:teuthology.orchestra.run.smithi007.stderr:Cluster fsid: cd9a3408-2d15-11ef-bc9d-c7b262605968 2024-06-18T01:55:32.100 INFO:teuthology.orchestra.run.smithi007.stderr:Acquiring lock 140137067500544 on /run/cephadm/cd9a3408-2d15-11ef-bc9d-c7b262605968.lock 2024-06-18T01:55:32.100 INFO:teuthology.orchestra.run.smithi007.stderr:Lock 140137067500544 acquired on /run/cephadm/cd9a3408-2d15-11ef-bc9d-c7b262605968.lock 2024-06-18T01:55:32.101 INFO:teuthology.orchestra.run.smithi007.stderr:Verifying IP 172.21.15.7 port 3300 ... 2024-06-18T01:55:32.101 INFO:teuthology.orchestra.run.smithi007.stderr:Verifying IP 172.21.15.7 port 6789 ... 2024-06-18T01:55:32.101 INFO:teuthology.orchestra.run.smithi007.stderr:Base mon IP is 172.21.15.7, final addrv is [v2:172.21.15.7:3300,v1:172.21.15.7:6789] 2024-06-18T01:55:32.103 INFO:teuthology.orchestra.run.smithi007.stderr:/sbin/ip: default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.7 metric 100 2024-06-18T01:55:32.103 INFO:teuthology.orchestra.run.smithi007.stderr:/sbin/ip: 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.7 metric 100 2024-06-18T01:55:32.106 INFO:teuthology.orchestra.run.smithi007.stderr:/sbin/ip: ::1 dev lo proto kernel metric 256 pref medium 2024-06-18T01:55:32.106 INFO:teuthology.orchestra.run.smithi007.stderr:/sbin/ip: fe80::/64 dev ens1f0 proto kernel metric 1024 pref medium 2024-06-18T01:55:32.106 INFO:teuthology.orchestra.run.smithi007.stderr:/sbin/ip: default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 100 pref medium 2024-06-18T01:55:32.109 INFO:teuthology.orchestra.run.smithi007.stderr:/sbin/ip: 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-06-18T01:55:32.109 INFO:teuthology.orchestra.run.smithi007.stderr:/sbin/ip: inet6 ::1/128 scope host 2024-06-18T01:55:32.109 INFO:teuthology.orchestra.run.smithi007.stderr:/sbin/ip: valid_lft forever preferred_lft forever 2024-06-18T01:55:32.109 INFO:teuthology.orchestra.run.smithi007.stderr:/sbin/ip: 4: ens1f0: mtu 1500 state UP qlen 1000 2024-06-18T01:55:32.109 INFO:teuthology.orchestra.run.smithi007.stderr:/sbin/ip: inet6 fe80::ec4:7aff:febd:15ea/64 scope link noprefixroute 2024-06-18T01:55:32.109 INFO:teuthology.orchestra.run.smithi007.stderr:/sbin/ip: valid_lft forever preferred_lft forever 2024-06-18T01:55:32.110 INFO:teuthology.orchestra.run.smithi007.stderr:Mon IP `172.21.15.7` is in CIDR network `172.21.0.0/20` 2024-06-18T01:55:32.110 INFO:teuthology.orchestra.run.smithi007.stderr:- internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-06-18T01:55:32.110 INFO:teuthology.orchestra.run.smithi007.stderr:Pulling container image quay.io/ceph/ceph:v17.2.0... 2024-06-18T01:55:32.215 INFO:teuthology.orchestra.run.smithi007.stderr:/bin/podman: Trying to pull quay.io/ceph/ceph:v17.2.0... 2024-06-18T01:55:32.599 INFO:teuthology.orchestra.run.smithi007.stderr:/bin/podman: Getting image source signatures 2024-06-18T01:55:32.600 INFO:teuthology.orchestra.run.smithi007.stderr:/bin/podman: Copying blob sha256:33ca8fff7868c4dc0c11e09bca97c720eb9cfbab7221216754367dd8de70388a 2024-06-18T01:55:32.600 INFO:teuthology.orchestra.run.smithi007.stderr:/bin/podman: Copying blob sha256:89b4a75bc2d8500f15463747507c9623df43886c134463e7f0527e70900e7a7b 2024-06-18T01:55:32.600 INFO:teuthology.orchestra.run.smithi007.stderr:/bin/podman: Copying blob sha256:a70843738bb77e1ab9c1f85969ebdfa55f178e746be081d1cb4f94011f69eb7c 2024-06-18T01:55:32.600 INFO:teuthology.orchestra.run.smithi007.stderr:/bin/podman: Copying blob sha256:c32ab78b488d0c72f64eded765c0cf6b5bf2c75dab66cb62a9d367fa6ec42513 2024-06-18T01:55:32.600 INFO:teuthology.orchestra.run.smithi007.stderr:/bin/podman: Copying blob sha256:599d07cb321ff0a3c82224e1138fc685793fa69b93ed5780415751a5f7e4b8c2 2024-06-18T01:55:32.600 INFO:teuthology.orchestra.run.smithi007.stderr:/bin/podman: Copying config sha256:e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9 2024-06-18T01:55:32.760 INFO:teuthology.orchestra.run.smithi007.stderr:/bin/podman: Writing manifest to image destination 2024-06-18T01:55:32.904 INFO:teuthology.orchestra.run.smithi007.stderr:/bin/podman: e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9 2024-06-18T01:55:33.349 INFO:teuthology.orchestra.run.smithi007.stderr:ceph: ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable) 2024-06-18T01:55:33.873 INFO:teuthology.orchestra.run.smithi007.stderr:Ceph version: ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable) 2024-06-18T01:55:33.873 INFO:teuthology.orchestra.run.smithi007.stderr:Extracting ceph user uid/gid from container image... 2024-06-18T01:55:34.270 INFO:teuthology.orchestra.run.smithi007.stderr:stat: 167 167 2024-06-18T01:55:34.851 INFO:teuthology.orchestra.run.smithi007.stderr:Creating initial keys... 2024-06-18T01:55:35.217 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph-authtool: AQAX6XBmCJgSChAA3+8eHYFw5/HZTTaPh2DO2A== 2024-06-18T01:55:36.121 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph-authtool: AQAY6XBmDy/rAhAAOf8SZbaQR9cY7YoH/EChSQ== 2024-06-18T01:55:37.094 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph-authtool: AQAZ6XBmGxSmABAA6IYEsmS8hBQgcSRA1P5t9A== 2024-06-18T01:55:37.616 INFO:teuthology.orchestra.run.smithi007.stderr:Creating initial monmap... 2024-06-18T01:55:38.008 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: monmap file /tmp/monmap 2024-06-18T01:55:38.008 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/monmaptool: setting min_mon_release = octopus 2024-06-18T01:55:38.008 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: set fsid to cd9a3408-2d15-11ef-bc9d-c7b262605968 2024-06-18T01:55:38.008 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-06-18T01:55:38.514 INFO:teuthology.orchestra.run.smithi007.stderr:monmaptool for a [v2:172.21.15.7:3300,v1:172.21.15.7:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-06-18T01:55:38.514 INFO:teuthology.orchestra.run.smithi007.stderr:setting min_mon_release = octopus 2024-06-18T01:55:38.514 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/monmaptool: set fsid to cd9a3408-2d15-11ef-bc9d-c7b262605968 2024-06-18T01:55:38.514 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-06-18T01:55:38.514 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-06-18T01:55:38.514 INFO:teuthology.orchestra.run.smithi007.stderr:Creating mon... 2024-06-18T01:55:39.379 INFO:teuthology.orchestra.run.smithi007.stderr:create mon.a on 2024-06-18T01:55:39.589 INFO:teuthology.orchestra.run.smithi007.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-06-18T01:55:39.744 INFO:teuthology.orchestra.run.smithi007.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968.target → /etc/systemd/system/ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968.target. 2024-06-18T01:55:39.745 INFO:teuthology.orchestra.run.smithi007.stderr:systemctl: Created symlink /etc/systemd/system/ceph.target.wants/ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968.target → /etc/systemd/system/ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968.target. 2024-06-18T01:55:40.052 INFO:teuthology.orchestra.run.smithi007.stderr:systemctl: Failed to reset failed state of unit ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mon.a.service: Unit ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mon.a.service not loaded. 2024-06-18T01:55:40.060 INFO:teuthology.orchestra.run.smithi007.stderr:systemctl: Created symlink /etc/systemd/system/ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968.target.wants/ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mon.a.service → /etc/systemd/system/ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@.service. 2024-06-18T01:55:40.750 INFO:teuthology.orchestra.run.smithi007.stderr:systemctl: disabled 2024-06-18T01:55:40.757 INFO:teuthology.orchestra.run.smithi007.stderr:systemctl: inactive 2024-06-18T01:55:40.758 INFO:teuthology.orchestra.run.smithi007.stderr:firewalld.service is not enabled 2024-06-18T01:55:40.758 INFO:teuthology.orchestra.run.smithi007.stderr:Not possible to enable service . firewalld.service is not available 2024-06-18T01:55:40.758 INFO:teuthology.orchestra.run.smithi007.stderr:Waiting for mon to start... 2024-06-18T01:55:40.758 INFO:teuthology.orchestra.run.smithi007.stderr:Waiting for mon... 2024-06-18T01:55:41.238 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: cluster: 2024-06-18T01:55:41.238 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: id: cd9a3408-2d15-11ef-bc9d-c7b262605968 2024-06-18T01:55:41.238 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: health: HEALTH_OK 2024-06-18T01:55:41.238 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: 2024-06-18T01:55:41.238 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: services: 2024-06-18T01:55:41.238 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: mon: 1 daemons, quorum a (age 0.541716s) 2024-06-18T01:55:41.238 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: mgr: no daemons active 2024-06-18T01:55:41.239 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: osd: 0 osds: 0 up, 0 in 2024-06-18T01:55:41.239 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: 2024-06-18T01:55:41.239 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: data: 2024-06-18T01:55:41.239 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: pools: 0 pools, 0 pgs 2024-06-18T01:55:41.239 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: objects: 0 objects, 0 B 2024-06-18T01:55:41.239 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: usage: 0 B used, 0 B / 0 B avail 2024-06-18T01:55:41.239 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: pgs: 2024-06-18T01:55:41.239 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: 2024-06-18T01:55:41.721 INFO:teuthology.orchestra.run.smithi007.stderr:mon is available 2024-06-18T01:55:41.721 INFO:teuthology.orchestra.run.smithi007.stderr:Assimilating anything we can from ceph.conf... 2024-06-18T01:55:42.255 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: 2024-06-18T01:55:42.255 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: [global] 2024-06-18T01:55:42.255 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: fsid = cd9a3408-2d15-11ef-bc9d-c7b262605968 2024-06-18T01:55:42.255 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: mon_host = [v2:172.21.15.7:3300,v1:172.21.15.7:6789] 2024-06-18T01:55:42.255 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: mon_osd_allow_pg_remap = true 2024-06-18T01:55:42.256 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: mon_osd_allow_primary_affinity = true 2024-06-18T01:55:42.256 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: mon_warn_on_no_sortbitwise = false 2024-06-18T01:55:42.256 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: osd_crush_chooseleaf_type = 0 2024-06-18T01:55:42.256 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: 2024-06-18T01:55:42.256 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: [mgr] 2024-06-18T01:55:42.256 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: mgr/cephadm/use_agent = True 2024-06-18T01:55:42.256 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: mgr/telemetry/nag = false 2024-06-18T01:55:42.256 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: 2024-06-18T01:55:42.256 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: [osd] 2024-06-18T01:55:42.256 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: osd_map_max_advance = 10 2024-06-18T01:55:42.256 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: osd_sloppy_crc = true 2024-06-18T01:55:42.837 INFO:teuthology.orchestra.run.smithi007.stderr:Generating new minimal ceph.conf... 2024-06-18T01:55:43.905 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:43 smithi007 ceph-mon[24754]: from='client.? 172.21.15.7:0/1688987180' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:55:43.908 INFO:teuthology.orchestra.run.smithi007.stderr:Restarting the monitor... 2024-06-18T01:55:44.157 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:43 smithi007 systemd[1]: Stopping Ceph mon.a for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T01:55:44.157 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:43 smithi007 bash[24972]: Error: no container with name or ID "ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon.a" found: no such container 2024-06-18T01:55:44.157 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:44 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-a[24750]: 2024-06-18T01:55:44.075+0000 7fcaa20f1700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-06-18T01:55:44.157 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:44 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-a[24750]: 2024-06-18T01:55:44.075+0000 7fcaa20f1700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-06-18T01:55:44.158 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:44 smithi007 podman[24982]: 2024-06-18 01:55:44.158186326 +0000 UTC m=+0.193865333 container died 01a37b96fdfaeb15e0353adb16479484de63997570c11f912b5bd01f5a137b7e (image=quay.io/ceph/ceph:v17.2.0, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-a, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, version=8, io.openshift.tags=base centos centos-stream, maintainer=Guillaume Abrioux , io.k8s.display-name=CentOS Stream 8, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, name=centos-stream, GIT_CLEAN=True, io.openshift.expose-services=, release=754, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.buildah.version=1.19.8, vcs-type=git, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, CEPH_POINT_RELEASE=-17.2.0, distribution-scope=public, GIT_BRANCH=HEAD, vendor=Red Hat, Inc., RELEASE=HEAD, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, architecture=x86_64, ceph=True, build-date=2022-05-03T08:36:31.336870, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_REPO=https://github.com/ceph/ceph-container.git, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, com.redhat.component=centos-stream-container) 2024-06-18T01:55:44.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:44 smithi007 podman[24982]: 2024-06-18 01:55:44.433701878 +0000 UTC m=+0.469380885 container cleanup 01a37b96fdfaeb15e0353adb16479484de63997570c11f912b5bd01f5a137b7e (image=quay.io/ceph/ceph:v17.2.0, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-a, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, GIT_CLEAN=True, version=8, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.openshift.expose-services=, io.buildah.version=1.19.8, maintainer=Guillaume Abrioux , vendor=Red Hat, Inc., build-date=2022-05-03T08:36:31.336870, vcs-type=git, com.redhat.component=centos-stream-container, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, name=centos-stream, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, distribution-scope=public, ceph=True, GIT_BRANCH=HEAD, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, RELEASE=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, io.openshift.tags=base centos centos-stream, CEPH_POINT_RELEASE=-17.2.0, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, architecture=x86_64, io.k8s.display-name=CentOS Stream 8, release=754) 2024-06-18T01:55:44.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:44 smithi007 bash[24982]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-a 2024-06-18T01:55:44.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:44 smithi007 bash[25009]: Error: no container with name or ID "ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon.a" found: no such container 2024-06-18T01:55:44.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:44 smithi007 podman[24995]: 2024-06-18 01:55:44.682914076 +0000 UTC m=+0.522082570 container remove 01a37b96fdfaeb15e0353adb16479484de63997570c11f912b5bd01f5a137b7e (image=quay.io/ceph/ceph:v17.2.0, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-a, build-date=2022-05-03T08:36:31.336870, vendor=Red Hat, Inc., CEPH_POINT_RELEASE=-17.2.0, io.openshift.tags=base centos centos-stream, distribution-scope=public, io.k8s.display-name=CentOS Stream 8, RELEASE=HEAD, release=754, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, architecture=x86_64, io.openshift.expose-services=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , name=centos-stream, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, version=8, io.buildah.version=1.19.8, com.redhat.component=centos-stream-container, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, ceph=True, vcs-type=git, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_CLEAN=True) 2024-06-18T01:55:45.004 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:44 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mon.a.service: Deactivated successfully. 2024-06-18T01:55:45.004 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:44 smithi007 systemd[1]: Stopped Ceph mon.a for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T01:55:45.004 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:44 smithi007 systemd[1]: Starting Ceph mon.a for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T01:55:45.004 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:44 smithi007 podman[25072]: 2024-06-18 01:55:44.92599117 +0000 UTC m=+0.113820716 container create 147f3ea02ae3172f2191bd6e60ec4737befb79c6c82c755bb167ccad2a982a3b (image=quay.io/ceph/ceph:v17.2.0, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-a, build-date=2022-05-03T08:36:31.336870, RELEASE=HEAD, CEPH_POINT_RELEASE=-17.2.0, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.k8s.display-name=CentOS Stream 8, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, distribution-scope=public, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, GIT_CLEAN=True, architecture=x86_64, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, version=8, name=centos-stream, vcs-type=git, maintainer=Guillaume Abrioux , io.openshift.expose-services=, io.buildah.version=1.19.8, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, ceph=True, io.openshift.tags=base centos centos-stream, vendor=Red Hat, Inc., release=754, GIT_BRANCH=HEAD, com.redhat.component=centos-stream-container, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, GIT_REPO=https://github.com/ceph/ceph-container.git) 2024-06-18T01:55:45.004 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:44 smithi007 podman[25072]: 2024-06-18 01:55:44.830717894 +0000 UTC m=+0.018547406 image pull e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9 quay.io/ceph/ceph:v17.2.0 2024-06-18T01:55:45.176 INFO:teuthology.orchestra.run.smithi007.stderr:Setting mon public_network to 172.21.0.0/20 2024-06-18T01:55:45.301 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 podman[25072]: 2024-06-18 01:55:45.099061711 +0000 UTC m=+0.286891227 container init 147f3ea02ae3172f2191bd6e60ec4737befb79c6c82c755bb167ccad2a982a3b (image=quay.io/ceph/ceph:v17.2.0, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-a, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.buildah.version=1.19.8, GIT_BRANCH=HEAD, io.openshift.tags=base centos centos-stream, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, com.redhat.component=centos-stream-container, name=centos-stream, RELEASE=HEAD, vendor=Red Hat, Inc., GIT_CLEAN=True, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, release=754, build-date=2022-05-03T08:36:31.336870, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, version=8, io.openshift.expose-services=, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.k8s.display-name=CentOS Stream 8, architecture=x86_64, vcs-type=git, CEPH_POINT_RELEASE=-17.2.0, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, distribution-scope=public, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=https://github.com/ceph/ceph-container.git) 2024-06-18T01:55:45.301 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 podman[25072]: 2024-06-18 01:55:45.102270011 +0000 UTC m=+0.290099514 container start 147f3ea02ae3172f2191bd6e60ec4737befb79c6c82c755bb167ccad2a982a3b (image=quay.io/ceph/ceph:v17.2.0, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-a, name=centos-stream, io.buildah.version=1.19.8, release=754, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, distribution-scope=public, architecture=x86_64, maintainer=Guillaume Abrioux , GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, com.redhat.component=centos-stream-container, io.openshift.expose-services=, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, version=8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, CEPH_POINT_RELEASE=-17.2.0, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., ceph=True, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_REPO=https://github.com/ceph/ceph-container.git, vendor=Red Hat, Inc., build-date=2022-05-03T08:36:31.336870, io.openshift.tags=base centos centos-stream, GIT_CLEAN=True, vcs-type=git, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, RELEASE=HEAD, GIT_BRANCH=HEAD, io.k8s.display-name=CentOS Stream 8) 2024-06-18T01:55:45.301 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: set uid:gid to 167:167 (ceph:ceph) 2024-06-18T01:55:45.301 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable), process ceph-mon, pid 2 2024-06-18T01:55:45.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: pidfile_write: ignore empty --pid-file 2024-06-18T01:55:45.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: load: jerasure load: lrc 2024-06-18T01:55:45.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: RocksDB version: 6.15.5 2024-06-18T01:55:45.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-06-18T01:55:45.303 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Compile date Apr 18 2022 2024-06-18T01:55:45.303 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: DB SUMMARY 2024-06-18T01:55:45.303 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: DB Session ID: LNANUT3XI2EII89U8EG6 2024-06-18T01:55:45.303 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: CURRENT file: CURRENT 2024-06-18T01:55:45.303 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: IDENTITY file: IDENTITY 2024-06-18T01:55:45.303 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2024-06-18T01:55:45.303 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-06-18T01:55:45.303 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000010.log size: 82603 ; 2024-06-18T01:55:45.303 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.error_if_exists: 0 2024-06-18T01:55:45.303 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.create_if_missing: 0 2024-06-18T01:55:45.303 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.paranoid_checks: 1 2024-06-18T01:55:45.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-06-18T01:55:45.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.env: 0x564b770c6860 2024-06-18T01:55:45.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.fs: Posix File System 2024-06-18T01:55:45.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.info_log: 0x564b781cfdc0 2024-06-18T01:55:45.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.max_file_opening_threads: 16 2024-06-18T01:55:45.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.statistics: (nil) 2024-06-18T01:55:45.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.use_fsync: 0 2024-06-18T01:55:45.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.max_log_file_size: 0 2024-06-18T01:55:45.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-06-18T01:55:45.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.log_file_time_to_roll: 0 2024-06-18T01:55:45.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.keep_log_file_num: 1000 2024-06-18T01:55:45.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.recycle_log_file_num: 0 2024-06-18T01:55:45.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.allow_fallocate: 1 2024-06-18T01:55:45.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.allow_mmap_reads: 0 2024-06-18T01:55:45.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.allow_mmap_writes: 0 2024-06-18T01:55:45.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.use_direct_reads: 0 2024-06-18T01:55:45.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-06-18T01:55:45.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.create_missing_column_families: 0 2024-06-18T01:55:45.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.db_log_dir: 2024-06-18T01:55:45.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2024-06-18T01:55:45.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.table_cache_numshardbits: 6 2024-06-18T01:55:45.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.WAL_ttl_seconds: 0 2024-06-18T01:55:45.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.WAL_size_limit_MB: 0 2024-06-18T01:55:45.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-06-18T01:55:45.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-06-18T01:55:45.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.is_fd_close_on_exec: 1 2024-06-18T01:55:45.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.advise_random_on_open: 1 2024-06-18T01:55:45.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.db_write_buffer_size: 0 2024-06-18T01:55:45.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.write_buffer_manager: 0x564b782c02a0 2024-06-18T01:55:45.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-06-18T01:55:45.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-06-18T01:55:45.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-06-18T01:55:45.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.use_adaptive_mutex: 0 2024-06-18T01:55:45.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.rate_limiter: (nil) 2024-06-18T01:55:45.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-06-18T01:55:45.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.wal_recovery_mode: 2 2024-06-18T01:55:45.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.enable_thread_tracking: 0 2024-06-18T01:55:45.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.enable_pipelined_write: 0 2024-06-18T01:55:45.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.unordered_write: 0 2024-06-18T01:55:45.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-06-18T01:55:45.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-06-18T01:55:45.307 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-06-18T01:55:45.307 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-06-18T01:55:45.307 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.row_cache: None 2024-06-18T01:55:45.307 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.wal_filter: None 2024-06-18T01:55:45.307 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-06-18T01:55:45.307 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.allow_ingest_behind: 0 2024-06-18T01:55:45.307 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.preserve_deletes: 0 2024-06-18T01:55:45.307 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.two_write_queues: 0 2024-06-18T01:55:45.307 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.manual_wal_flush: 0 2024-06-18T01:55:45.307 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.atomic_flush: 0 2024-06-18T01:55:45.307 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-06-18T01:55:45.307 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.persist_stats_to_disk: 0 2024-06-18T01:55:45.308 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.write_dbid_to_manifest: 0 2024-06-18T01:55:45.308 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.log_readahead_size: 0 2024-06-18T01:55:45.308 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-06-18T01:55:45.308 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.best_efforts_recovery: 0 2024-06-18T01:55:45.308 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-06-18T01:55:45.308 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-06-18T01:55:45.308 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.allow_data_in_errors: 0 2024-06-18T01:55:45.308 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.db_host_id: __hostname__ 2024-06-18T01:55:45.308 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.max_background_jobs: 2 2024-06-18T01:55:45.308 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.max_background_compactions: -1 2024-06-18T01:55:45.308 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.max_subcompactions: 1 2024-06-18T01:55:45.308 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-06-18T01:55:45.308 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-06-18T01:55:45.308 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.delayed_write_rate : 16777216 2024-06-18T01:55:45.308 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.max_total_wal_size: 0 2024-06-18T01:55:45.309 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-06-18T01:55:45.309 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.stats_dump_period_sec: 600 2024-06-18T01:55:45.309 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.stats_persist_period_sec: 600 2024-06-18T01:55:45.309 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-06-18T01:55:45.309 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.max_open_files: -1 2024-06-18T01:55:45.309 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.bytes_per_sync: 0 2024-06-18T01:55:45.309 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.wal_bytes_per_sync: 0 2024-06-18T01:55:45.309 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.strict_bytes_per_sync: 0 2024-06-18T01:55:45.309 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.compaction_readahead_size: 0 2024-06-18T01:55:45.309 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.max_background_flushes: -1 2024-06-18T01:55:45.309 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Compression algorithms supported: 2024-06-18T01:55:45.309 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-06-18T01:55:45.309 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: kZSTD supported: 0 2024-06-18T01:55:45.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: kXpressCompression supported: 0 2024-06-18T01:55:45.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: kLZ4HCCompression supported: 1 2024-06-18T01:55:45.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: kLZ4Compression supported: 1 2024-06-18T01:55:45.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: kBZip2Compression supported: 0 2024-06-18T01:55:45.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: kZlibCompression supported: 1 2024-06-18T01:55:45.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: kSnappyCompression supported: 1 2024-06-18T01:55:45.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Fast CRC32 supported: Supported on x86 2024-06-18T01:55:45.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: [db/version_set.cc:4725] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000009 2024-06-18T01:55:45.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: [db/column_family.cc:597] --------------- Options for column family [default]: 2024-06-18T01:55:45.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-06-18T01:55:45.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.merge_operator: 2024-06-18T01:55:45.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.compaction_filter: None 2024-06-18T01:55:45.311 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.compaction_filter_factory: None 2024-06-18T01:55:45.311 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.sst_partitioner_factory: None 2024-06-18T01:55:45.311 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.memtable_factory: SkipListFactory 2024-06-18T01:55:45.311 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.table_factory: BlockBasedTable 2024-06-18T01:55:45.311 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x564b7819bd00) 2024-06-18T01:55:45.311 INFO:journalctl@ceph.mon.a.smithi007.stdout: cache_index_and_filter_blocks: 1 2024-06-18T01:55:45.311 INFO:journalctl@ceph.mon.a.smithi007.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-06-18T01:55:45.311 INFO:journalctl@ceph.mon.a.smithi007.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-06-18T01:55:45.311 INFO:journalctl@ceph.mon.a.smithi007.stdout: pin_top_level_index_and_filter: 1 2024-06-18T01:55:45.311 INFO:journalctl@ceph.mon.a.smithi007.stdout: index_type: 0 2024-06-18T01:55:45.311 INFO:journalctl@ceph.mon.a.smithi007.stdout: data_block_index_type: 0 2024-06-18T01:55:45.311 INFO:journalctl@ceph.mon.a.smithi007.stdout: index_shortening: 1 2024-06-18T01:55:45.311 INFO:journalctl@ceph.mon.a.smithi007.stdout: data_block_hash_table_util_ratio: 0.750000 2024-06-18T01:55:45.312 INFO:journalctl@ceph.mon.a.smithi007.stdout: hash_index_allow_collision: 1 2024-06-18T01:55:45.312 INFO:journalctl@ceph.mon.a.smithi007.stdout: checksum: 1 2024-06-18T01:55:45.312 INFO:journalctl@ceph.mon.a.smithi007.stdout: no_block_cache: 0 2024-06-18T01:55:45.312 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_cache: 0x564b78206170 2024-06-18T01:55:45.312 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_cache_name: BinnedLRUCache 2024-06-18T01:55:45.312 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_cache_options: 2024-06-18T01:55:45.312 INFO:journalctl@ceph.mon.a.smithi007.stdout: capacity : 536870912 2024-06-18T01:55:45.312 INFO:journalctl@ceph.mon.a.smithi007.stdout: num_shard_bits : 4 2024-06-18T01:55:45.312 INFO:journalctl@ceph.mon.a.smithi007.stdout: strict_capacity_limit : 0 2024-06-18T01:55:45.312 INFO:journalctl@ceph.mon.a.smithi007.stdout: high_pri_pool_ratio: 0.000 2024-06-18T01:55:45.312 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_cache_compressed: (nil) 2024-06-18T01:55:45.312 INFO:journalctl@ceph.mon.a.smithi007.stdout: persistent_cache: (nil) 2024-06-18T01:55:45.312 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_size: 4096 2024-06-18T01:55:45.312 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_size_deviation: 10 2024-06-18T01:55:45.312 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_restart_interval: 16 2024-06-18T01:55:45.313 INFO:journalctl@ceph.mon.a.smithi007.stdout: index_block_restart_interval: 1 2024-06-18T01:55:45.313 INFO:journalctl@ceph.mon.a.smithi007.stdout: metadata_block_size: 4096 2024-06-18T01:55:45.313 INFO:journalctl@ceph.mon.a.smithi007.stdout: partition_filters: 0 2024-06-18T01:55:45.313 INFO:journalctl@ceph.mon.a.smithi007.stdout: use_delta_encoding: 1 2024-06-18T01:55:45.313 INFO:journalctl@ceph.mon.a.smithi007.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-06-18T01:55:45.313 INFO:journalctl@ceph.mon.a.smithi007.stdout: whole_key_filtering: 1 2024-06-18T01:55:45.313 INFO:journalctl@ceph.mon.a.smithi007.stdout: verify_compression: 0 2024-06-18T01:55:45.313 INFO:journalctl@ceph.mon.a.smithi007.stdout: read_amp_bytes_per_bit: 0 2024-06-18T01:55:45.313 INFO:journalctl@ceph.mon.a.smithi007.stdout: format_version: 4 2024-06-18T01:55:45.313 INFO:journalctl@ceph.mon.a.smithi007.stdout: enable_index_compression: 1 2024-06-18T01:55:45.313 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_align: 0 2024-06-18T01:55:45.313 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.write_buffer_size: 33554432 2024-06-18T01:55:45.313 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.max_write_buffer_number: 2 2024-06-18T01:55:45.313 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.compression: NoCompression 2024-06-18T01:55:45.314 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.bottommost_compression: Disabled 2024-06-18T01:55:45.314 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.prefix_extractor: nullptr 2024-06-18T01:55:45.314 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-06-18T01:55:45.314 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.num_levels: 7 2024-06-18T01:55:45.314 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-06-18T01:55:45.314 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-06-18T01:55:45.314 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-06-18T01:55:45.314 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-06-18T01:55:45.314 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-06-18T01:55:45.314 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-06-18T01:55:45.314 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-06-18T01:55:45.315 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-06-18T01:55:45.315 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-06-18T01:55:45.315 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-06-18T01:55:45.317 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.compression_opts.window_bits: -14 2024-06-18T01:55:45.317 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.compression_opts.level: 32767 2024-06-18T01:55:45.317 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.compression_opts.strategy: 0 2024-06-18T01:55:45.317 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-06-18T01:55:45.317 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-06-18T01:55:45.317 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-06-18T01:55:45.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.compression_opts.enabled: false 2024-06-18T01:55:45.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-06-18T01:55:45.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-06-18T01:55:45.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-06-18T01:55:45.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.target_file_size_base: 67108864 2024-06-18T01:55:45.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.target_file_size_multiplier: 1 2024-06-18T01:55:45.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-06-18T01:55:45.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-06-18T01:55:45.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-06-18T01:55:45.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-06-18T01:55:45.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-06-18T01:55:45.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-06-18T01:55:45.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-06-18T01:55:45.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-06-18T01:55:45.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-06-18T01:55:45.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-06-18T01:55:45.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-06-18T01:55:45.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-06-18T01:55:45.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.arena_block_size: 4194304 2024-06-18T01:55:45.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-06-18T01:55:45.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-06-18T01:55:45.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-06-18T01:55:45.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.disable_auto_compactions: 0 2024-06-18T01:55:45.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-06-18T01:55:45.322 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-06-18T01:55:45.322 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-06-18T01:55:45.322 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-06-18T01:55:45.322 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-06-18T01:55:45.322 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-06-18T01:55:45.322 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-06-18T01:55:45.322 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-06-18T01:55:45.322 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-06-18T01:55:45.322 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-06-18T01:55:45.322 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.table_properties_collectors: 2024-06-18T01:55:45.322 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.inplace_update_support: 0 2024-06-18T01:55:45.322 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.inplace_update_num_locks: 10000 2024-06-18T01:55:45.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-06-18T01:55:45.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-06-18T01:55:45.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.memtable_huge_page_size: 0 2024-06-18T01:55:45.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.bloom_locality: 0 2024-06-18T01:55:45.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.max_successive_merges: 0 2024-06-18T01:55:45.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.optimize_filters_for_hits: 0 2024-06-18T01:55:45.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.paranoid_file_checks: 0 2024-06-18T01:55:45.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.force_consistency_checks: 1 2024-06-18T01:55:45.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.report_bg_io_stats: 0 2024-06-18T01:55:45.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.ttl: 2592000 2024-06-18T01:55:45.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.periodic_compaction_seconds: 0 2024-06-18T01:55:45.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.enable_blob_files: false 2024-06-18T01:55:45.324 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.min_blob_size: 0 2024-06-18T01:55:45.324 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.blob_file_size: 268435456 2024-06-18T01:55:45.324 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.blob_compression_type: NoCompression 2024-06-18T01:55:45.324 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.enable_blob_garbage_collection: false 2024-06-18T01:55:45.324 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-06-18T01:55:45.324 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: [db/version_set.cc:4773] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-06-18T01:55:45.324 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: [db/version_set.cc:4782] Column family [default] (ID 0), log number is 5 2024-06-18T01:55:45.324 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: [db/version_set.cc:4083] Creating manifest 13 2024-06-18T01:55:45.324 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: EVENT_LOG_v1 {"time_micros": 1718675745128408, "job": 1, "event": "recovery_started", "wal_files": [10]} 2024-06-18T01:55:45.324 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: [db/db_impl/db_impl_open.cc:847] Recovering log #10 mode 2 2024-06-18T01:55:45.324 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: [table/block_based/filter_policy.cc:996] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-06-18T01:55:45.324 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: EVENT_LOG_v1 {"time_micros": 1718675745129178, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 79153, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 77416, "index_size": 225, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 10027, "raw_average_key_size": 47, "raw_value_size": 71725, "raw_average_value_size": 339, "num_data_blocks": 10, "num_entries": 211, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1718675745, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "e87bb5f4-533e-44e3-a05d-92dfdc098920", "db_session_id": "LNANUT3XI2EII89U8EG6"}} 2024-06-18T01:55:45.325 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: [db/version_set.cc:4083] Creating manifest 15 2024-06-18T01:55:45.325 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: EVENT_LOG_v1 {"time_micros": 1718675745129504, "job": 1, "event": "recovery_finished"} 2024-06-18T01:55:45.325 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: [file/delete_scheduler.cc:73] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-06-18T01:55:45.325 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: [db/db_impl/db_impl_open.cc:1701] SstFileManager instance 0x564b781eca80 2024-06-18T01:55:45.325 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: DB pointer 0x564b781fc000 2024-06-18T01:55:45.325 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: [db/db_impl/db_impl.cc:902] ------- DUMPING STATS ------- 2024-06-18T01:55:45.325 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-06-18T01:55:45.325 INFO:journalctl@ceph.mon.a.smithi007.stdout: ** DB Stats ** 2024-06-18T01:55:45.325 INFO:journalctl@ceph.mon.a.smithi007.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-18T01:55:45.325 INFO:journalctl@ceph.mon.a.smithi007.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-06-18T01:55:45.325 INFO:journalctl@ceph.mon.a.smithi007.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-18T01:55:45.325 INFO:journalctl@ceph.mon.a.smithi007.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-18T01:55:45.325 INFO:journalctl@ceph.mon.a.smithi007.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-06-18T01:55:45.326 INFO:journalctl@ceph.mon.a.smithi007.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-06-18T01:55:45.326 INFO:journalctl@ceph.mon.a.smithi007.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-18T01:55:45.326 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-06-18T01:55:45.326 INFO:journalctl@ceph.mon.a.smithi007.stdout: ** Compaction Stats [default] ** 2024-06-18T01:55:45.326 INFO:journalctl@ceph.mon.a.smithi007.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-06-18T01:55:45.326 INFO:journalctl@ceph.mon.a.smithi007.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-06-18T01:55:45.326 INFO:journalctl@ceph.mon.a.smithi007.stdout: L0 2/0 79.06 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 148.9 0.00 0.00 1 0.001 0 0 2024-06-18T01:55:45.326 INFO:journalctl@ceph.mon.a.smithi007.stdout: Sum 2/0 79.06 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 148.9 0.00 0.00 1 0.001 0 0 2024-06-18T01:55:45.326 INFO:journalctl@ceph.mon.a.smithi007.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 148.9 0.00 0.00 1 0.001 0 0 2024-06-18T01:55:45.326 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-06-18T01:55:45.326 INFO:journalctl@ceph.mon.a.smithi007.stdout: ** Compaction Stats [default] ** 2024-06-18T01:55:45.327 INFO:journalctl@ceph.mon.a.smithi007.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-06-18T01:55:45.327 INFO:journalctl@ceph.mon.a.smithi007.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-06-18T01:55:45.327 INFO:journalctl@ceph.mon.a.smithi007.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 148.9 0.00 0.00 1 0.001 0 0 2024-06-18T01:55:45.327 INFO:journalctl@ceph.mon.a.smithi007.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-18T01:55:45.327 INFO:journalctl@ceph.mon.a.smithi007.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-06-18T01:55:45.327 INFO:journalctl@ceph.mon.a.smithi007.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-06-18T01:55:45.327 INFO:journalctl@ceph.mon.a.smithi007.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-06-18T01:55:45.327 INFO:journalctl@ceph.mon.a.smithi007.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-06-18T01:55:45.327 INFO:journalctl@ceph.mon.a.smithi007.stdout: AddFile(Keys): cumulative 0, interval 0 2024-06-18T01:55:45.327 INFO:journalctl@ceph.mon.a.smithi007.stdout: Cumulative compaction: 0.00 GB write, 24.27 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-18T01:55:45.327 INFO:journalctl@ceph.mon.a.smithi007.stdout: Interval compaction: 0.00 GB write, 24.27 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-18T01:55:45.327 INFO:journalctl@ceph.mon.a.smithi007.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-06-18T01:55:45.327 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-06-18T01:55:45.327 INFO:journalctl@ceph.mon.a.smithi007.stdout: ** File Read Latency Histogram By Level [default] ** 2024-06-18T01:55:45.328 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-06-18T01:55:45.328 INFO:journalctl@ceph.mon.a.smithi007.stdout: ** Compaction Stats [default] ** 2024-06-18T01:55:45.328 INFO:journalctl@ceph.mon.a.smithi007.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-06-18T01:55:45.328 INFO:journalctl@ceph.mon.a.smithi007.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-06-18T01:55:45.328 INFO:journalctl@ceph.mon.a.smithi007.stdout: L0 2/0 79.06 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 148.9 0.00 0.00 1 0.001 0 0 2024-06-18T01:55:45.328 INFO:journalctl@ceph.mon.a.smithi007.stdout: Sum 2/0 79.06 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 148.9 0.00 0.00 1 0.001 0 0 2024-06-18T01:55:45.328 INFO:journalctl@ceph.mon.a.smithi007.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-06-18T01:55:45.329 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-06-18T01:55:45.329 INFO:journalctl@ceph.mon.a.smithi007.stdout: ** Compaction Stats [default] ** 2024-06-18T01:55:45.329 INFO:journalctl@ceph.mon.a.smithi007.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-06-18T01:55:45.329 INFO:journalctl@ceph.mon.a.smithi007.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-06-18T01:55:45.329 INFO:journalctl@ceph.mon.a.smithi007.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 148.9 0.00 0.00 1 0.001 0 0 2024-06-18T01:55:45.329 INFO:journalctl@ceph.mon.a.smithi007.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-18T01:55:45.330 INFO:journalctl@ceph.mon.a.smithi007.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-06-18T01:55:45.330 INFO:journalctl@ceph.mon.a.smithi007.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-06-18T01:55:45.330 INFO:journalctl@ceph.mon.a.smithi007.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-06-18T01:55:45.330 INFO:journalctl@ceph.mon.a.smithi007.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-06-18T01:55:45.330 INFO:journalctl@ceph.mon.a.smithi007.stdout: AddFile(Keys): cumulative 0, interval 0 2024-06-18T01:55:45.330 INFO:journalctl@ceph.mon.a.smithi007.stdout: Cumulative compaction: 0.00 GB write, 24.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-18T01:55:45.330 INFO:journalctl@ceph.mon.a.smithi007.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-18T01:55:45.330 INFO:journalctl@ceph.mon.a.smithi007.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-06-18T01:55:45.331 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-06-18T01:55:45.331 INFO:journalctl@ceph.mon.a.smithi007.stdout: ** File Read Latency Histogram By Level [default] ** 2024-06-18T01:55:45.331 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: starting mon.a rank 0 at public addrs [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] at bind addrs [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 2024-06-18T01:55:45.331 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: mon.a@-1(???) e1 preinit fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 2024-06-18T01:55:45.331 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: mon.a@-1(???).mds e1 new map 2024-06-18T01:55:45.331 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: mon.a@-1(???).mds e1 print_map 2024-06-18T01:55:45.331 INFO:journalctl@ceph.mon.a.smithi007.stdout: e1 2024-06-18T01:55:45.331 INFO:journalctl@ceph.mon.a.smithi007.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-06-18T01:55:45.331 INFO:journalctl@ceph.mon.a.smithi007.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-18T01:55:45.331 INFO:journalctl@ceph.mon.a.smithi007.stdout: legacy client fscid: -1 2024-06-18T01:55:45.331 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-06-18T01:55:45.331 INFO:journalctl@ceph.mon.a.smithi007.stdout: No filesystems configured 2024-06-18T01:55:45.331 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-06-18T01:55:45.331 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-06-18T01:55:45.332 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-06-18T01:55:45.332 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-06-18T01:55:45.332 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-06-18T01:55:45.332 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: expand_channel_meta expand map: {default=false} 2024-06-18T01:55:45.332 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: expand_channel_meta from 'false' to 'false' 2024-06-18T01:55:45.332 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: expand_channel_meta expanded map: {default=false} 2024-06-18T01:55:45.332 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: expand_channel_meta expand map: {default=info} 2024-06-18T01:55:45.332 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: expand_channel_meta from 'info' to 'info' 2024-06-18T01:55:45.332 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: expand_channel_meta expanded map: {default=info} 2024-06-18T01:55:45.332 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: expand_channel_meta expand map: {default=daemon} 2024-06-18T01:55:45.332 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: expand_channel_meta from 'daemon' to 'daemon' 2024-06-18T01:55:45.332 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: expand_channel_meta expanded map: {default=daemon} 2024-06-18T01:55:45.332 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: expand_channel_meta expand map: {default=debug} 2024-06-18T01:55:45.332 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: expand_channel_meta from 'debug' to 'debug' 2024-06-18T01:55:45.332 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: expand_channel_meta expanded map: {default=debug} 2024-06-18T01:55:45.333 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 bash[25072]: 147f3ea02ae3172f2191bd6e60ec4737befb79c6c82c755bb167ccad2a982a3b 2024-06-18T01:55:45.333 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 systemd[1]: Started Ceph mon.a for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T01:55:45.333 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: mon.a is new leader, mons a in quorum (ranks 0) 2024-06-18T01:55:45.333 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: monmap e1: 1 mons at {a=[v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0]} 2024-06-18T01:55:45.333 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: fsmap 2024-06-18T01:55:45.333 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: osdmap e1: 0 total, 0 up, 0 in 2024-06-18T01:55:45.333 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:45 smithi007 ceph-mon[25091]: mgrmap e1: no daemons active 2024-06-18T01:55:46.241 INFO:teuthology.orchestra.run.smithi007.stderr:Wrote config to /etc/ceph/ceph.conf 2024-06-18T01:55:46.241 INFO:teuthology.orchestra.run.smithi007.stderr:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-06-18T01:55:46.241 INFO:teuthology.orchestra.run.smithi007.stderr:Creating mgr... 2024-06-18T01:55:46.242 INFO:teuthology.orchestra.run.smithi007.stderr:Verifying port 9283 ... 2024-06-18T01:55:46.426 INFO:teuthology.orchestra.run.smithi007.stderr:systemctl: Failed to reset failed state of unit ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mgr.y.service: Unit ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mgr.y.service not loaded. 2024-06-18T01:55:46.434 INFO:teuthology.orchestra.run.smithi007.stderr:systemctl: Created symlink /etc/systemd/system/ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968.target.wants/ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mgr.y.service → /etc/systemd/system/ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@.service. 2024-06-18T01:55:46.691 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:55:46 smithi007 systemd[1]: Starting Ceph mgr.y for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T01:55:46.948 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:46 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/3702484983' entity='client.admin' 2024-06-18T01:55:46.948 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:55:46 smithi007 podman[25308]: 2024-06-18 01:55:46.735751681 +0000 UTC m=+0.021768197 image pull e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9 quay.io/ceph/ceph:v17.2.0 2024-06-18T01:55:46.948 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:55:46 smithi007 podman[25308]: 2024-06-18 01:55:46.840849959 +0000 UTC m=+0.126866516 container create 78a1afd0bdddabfc4ec47e114b59291b01d01d7e1f7993a7bc296c29c00ced51 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y, version=8, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, vcs-type=git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=-17.2.0, io.k8s.display-name=CentOS Stream 8, distribution-scope=public, GIT_CLEAN=True, RELEASE=HEAD, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, GIT_REPO=https://github.com/ceph/ceph-container.git, build-date=2022-05-03T08:36:31.336870, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, name=centos-stream, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.buildah.version=1.19.8, release=754, io.openshift.expose-services=, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, com.redhat.component=centos-stream-container, io.openshift.tags=base centos centos-stream, ceph=True, maintainer=Guillaume Abrioux , architecture=x86_64, vendor=Red Hat, Inc.) 2024-06-18T01:55:47.148 INFO:teuthology.orchestra.run.smithi007.stderr:systemctl: disabled 2024-06-18T01:55:47.156 INFO:teuthology.orchestra.run.smithi007.stderr:systemctl: inactive 2024-06-18T01:55:47.157 INFO:teuthology.orchestra.run.smithi007.stderr:firewalld.service is not enabled 2024-06-18T01:55:47.157 INFO:teuthology.orchestra.run.smithi007.stderr:Not possible to enable service . firewalld.service is not available 2024-06-18T01:55:47.165 INFO:teuthology.orchestra.run.smithi007.stderr:systemctl: disabled 2024-06-18T01:55:47.172 INFO:teuthology.orchestra.run.smithi007.stderr:systemctl: inactive 2024-06-18T01:55:47.173 INFO:teuthology.orchestra.run.smithi007.stderr:firewalld.service is not enabled 2024-06-18T01:55:47.174 INFO:teuthology.orchestra.run.smithi007.stderr:Not possible to open ports <[9283]>. firewalld.service is not available 2024-06-18T01:55:47.174 INFO:teuthology.orchestra.run.smithi007.stderr:Waiting for mgr to start... 2024-06-18T01:55:47.174 INFO:teuthology.orchestra.run.smithi007.stderr:Waiting for mgr... 2024-06-18T01:55:47.304 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:55:47 smithi007 podman[25308]: 2024-06-18 01:55:47.034799178 +0000 UTC m=+0.320815692 container init 78a1afd0bdddabfc4ec47e114b59291b01d01d7e1f7993a7bc296c29c00ced51 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y, ceph=True, version=8, io.openshift.tags=base centos centos-stream, vendor=Red Hat, Inc., GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, build-date=2022-05-03T08:36:31.336870, architecture=x86_64, CEPH_POINT_RELEASE=-17.2.0, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, GIT_CLEAN=True, release=754, distribution-scope=public, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.openshift.expose-services=, GIT_REPO=https://github.com/ceph/ceph-container.git, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, RELEASE=HEAD, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_BRANCH=HEAD, io.k8s.display-name=CentOS Stream 8, name=centos-stream, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, vcs-type=git, maintainer=Guillaume Abrioux , io.buildah.version=1.19.8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, com.redhat.component=centos-stream-container) 2024-06-18T01:55:47.306 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:55:47 smithi007 podman[25308]: 2024-06-18 01:55:47.037585193 +0000 UTC m=+0.323601687 container start 78a1afd0bdddabfc4ec47e114b59291b01d01d7e1f7993a7bc296c29c00ced51 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y, vcs-type=git, GIT_CLEAN=True, GIT_BRANCH=HEAD, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, release=754, io.k8s.display-name=CentOS Stream 8, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., build-date=2022-05-03T08:36:31.336870, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, version=8, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.19.8, io.openshift.expose-services=, RELEASE=HEAD, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.openshift.tags=base centos centos-stream, vendor=Red Hat, Inc., com.redhat.component=centos-stream-container, ceph=True, CEPH_POINT_RELEASE=-17.2.0, distribution-scope=public, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, maintainer=Guillaume Abrioux , architecture=x86_64, name=centos-stream) 2024-06-18T01:55:47.306 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:55:47 smithi007 bash[25308]: 78a1afd0bdddabfc4ec47e114b59291b01d01d7e1f7993a7bc296c29c00ced51 2024-06-18T01:55:47.306 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:55:47 smithi007 systemd[1]: Started Ceph mgr.y for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T01:55:47.306 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:55:47 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:55:47.189+0000 7f020a7e4000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-18T01:55:47.587 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:55:47 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:55:47.333+0000 7f020a7e4000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-18T01:55:47.587 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:55:47 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:55:47.439+0000 7f020a7e4000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-18T01:55:47.704 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: 2024-06-18T01:55:47.705 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: { 2024-06-18T01:55:47.705 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "fsid": "cd9a3408-2d15-11ef-bc9d-c7b262605968", 2024-06-18T01:55:47.705 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "health": { 2024-06-18T01:55:47.705 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2024-06-18T01:55:47.705 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "checks": {}, 2024-06-18T01:55:47.705 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "mutes": [] 2024-06-18T01:55:47.705 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: }, 2024-06-18T01:55:47.705 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "election_epoch": 5, 2024-06-18T01:55:47.705 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "quorum": [ 2024-06-18T01:55:47.705 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: 0 2024-06-18T01:55:47.705 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: ], 2024-06-18T01:55:47.706 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "quorum_names": [ 2024-06-18T01:55:47.706 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "a" 2024-06-18T01:55:47.706 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: ], 2024-06-18T01:55:47.706 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "quorum_age": 2, 2024-06-18T01:55:47.706 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "monmap": { 2024-06-18T01:55:47.706 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "epoch": 1, 2024-06-18T01:55:47.706 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "min_mon_release_name": "quincy", 2024-06-18T01:55:47.706 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "num_mons": 1 2024-06-18T01:55:47.706 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: }, 2024-06-18T01:55:47.706 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "osdmap": { 2024-06-18T01:55:47.706 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "epoch": 1, 2024-06-18T01:55:47.707 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "num_osds": 0, 2024-06-18T01:55:47.707 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "num_up_osds": 0, 2024-06-18T01:55:47.707 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "osd_up_since": 0, 2024-06-18T01:55:47.707 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "num_in_osds": 0, 2024-06-18T01:55:47.711 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "osd_in_since": 0, 2024-06-18T01:55:47.711 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2024-06-18T01:55:47.711 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: }, 2024-06-18T01:55:47.711 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "pgmap": { 2024-06-18T01:55:47.711 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "pgs_by_state": [], 2024-06-18T01:55:47.711 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "num_pgs": 0, 2024-06-18T01:55:47.711 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "num_pools": 0, 2024-06-18T01:55:47.711 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "num_objects": 0, 2024-06-18T01:55:47.711 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "data_bytes": 0, 2024-06-18T01:55:47.712 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "bytes_used": 0, 2024-06-18T01:55:47.712 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "bytes_avail": 0, 2024-06-18T01:55:47.712 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "bytes_total": 0 2024-06-18T01:55:47.712 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: }, 2024-06-18T01:55:47.712 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "fsmap": { 2024-06-18T01:55:47.712 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "epoch": 1, 2024-06-18T01:55:47.712 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "by_rank": [], 2024-06-18T01:55:47.712 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "up:standby": 0 2024-06-18T01:55:47.712 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: }, 2024-06-18T01:55:47.712 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "mgrmap": { 2024-06-18T01:55:47.713 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "available": false, 2024-06-18T01:55:47.713 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "num_standbys": 0, 2024-06-18T01:55:47.713 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "modules": [ 2024-06-18T01:55:47.713 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "iostat", 2024-06-18T01:55:47.713 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "nfs", 2024-06-18T01:55:47.713 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "restful" 2024-06-18T01:55:47.713 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: ], 2024-06-18T01:55:47.713 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "services": {} 2024-06-18T01:55:47.713 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: }, 2024-06-18T01:55:47.713 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "servicemap": { 2024-06-18T01:55:47.713 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "epoch": 1, 2024-06-18T01:55:47.713 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "modified": "2024-06-18T01:55:40.695890+0000", 2024-06-18T01:55:47.714 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "services": {} 2024-06-18T01:55:47.714 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: }, 2024-06-18T01:55:47.714 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "progress_events": {} 2024-06-18T01:55:47.714 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: } 2024-06-18T01:55:47.861 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:47 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/1477386003' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-06-18T01:55:47.861 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:55:47 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:55:47.775+0000 7f020a7e4000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-18T01:55:48.181 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:55:47 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:55:47.861+0000 7f020a7e4000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-18T01:55:48.251 INFO:teuthology.orchestra.run.smithi007.stderr:mgr not available, waiting (1/15)... 2024-06-18T01:55:49.319 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:55:49 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:55:49.064+0000 7f020a7e4000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-18T01:55:49.319 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:55:49 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:55:49.234+0000 7f020a7e4000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-18T01:55:49.319 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:55:49 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:55:49.319+0000 7f020a7e4000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-18T01:55:49.931 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:55:49 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:55:49.643+0000 7f020a7e4000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-18T01:55:49.932 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:55:49 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:55:49.737+0000 7f020a7e4000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-18T01:55:49.932 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:55:49 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:55:49.835+0000 7f020a7e4000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-18T01:55:50.366 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:55:50 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:55:50.097+0000 7f020a7e4000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-18T01:55:50.681 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:55:50 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:55:50.573+0000 7f020a7e4000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-18T01:55:50.704 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: 2024-06-18T01:55:50.704 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: { 2024-06-18T01:55:50.704 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "fsid": "cd9a3408-2d15-11ef-bc9d-c7b262605968", 2024-06-18T01:55:50.704 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "health": { 2024-06-18T01:55:50.704 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2024-06-18T01:55:50.704 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "checks": {}, 2024-06-18T01:55:50.704 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "mutes": [] 2024-06-18T01:55:50.704 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: }, 2024-06-18T01:55:50.704 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "election_epoch": 5, 2024-06-18T01:55:50.704 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "quorum": [ 2024-06-18T01:55:50.705 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: 0 2024-06-18T01:55:50.705 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: ], 2024-06-18T01:55:50.705 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "quorum_names": [ 2024-06-18T01:55:50.705 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "a" 2024-06-18T01:55:50.705 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: ], 2024-06-18T01:55:50.705 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "quorum_age": 5, 2024-06-18T01:55:50.705 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "monmap": { 2024-06-18T01:55:50.705 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "epoch": 1, 2024-06-18T01:55:50.705 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "min_mon_release_name": "quincy", 2024-06-18T01:55:50.705 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "num_mons": 1 2024-06-18T01:55:50.705 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: }, 2024-06-18T01:55:50.705 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "osdmap": { 2024-06-18T01:55:50.705 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "epoch": 1, 2024-06-18T01:55:50.705 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "num_osds": 0, 2024-06-18T01:55:50.706 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "num_up_osds": 0, 2024-06-18T01:55:50.706 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "osd_up_since": 0, 2024-06-18T01:55:50.706 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "num_in_osds": 0, 2024-06-18T01:55:50.706 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "osd_in_since": 0, 2024-06-18T01:55:50.706 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2024-06-18T01:55:50.706 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: }, 2024-06-18T01:55:50.706 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "pgmap": { 2024-06-18T01:55:50.706 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "pgs_by_state": [], 2024-06-18T01:55:50.706 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "num_pgs": 0, 2024-06-18T01:55:50.706 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "num_pools": 0, 2024-06-18T01:55:50.706 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "num_objects": 0, 2024-06-18T01:55:50.706 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "data_bytes": 0, 2024-06-18T01:55:50.706 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "bytes_used": 0, 2024-06-18T01:55:50.707 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "bytes_avail": 0, 2024-06-18T01:55:50.707 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "bytes_total": 0 2024-06-18T01:55:50.707 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: }, 2024-06-18T01:55:50.707 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "fsmap": { 2024-06-18T01:55:50.707 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "epoch": 1, 2024-06-18T01:55:50.707 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "by_rank": [], 2024-06-18T01:55:50.707 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "up:standby": 0 2024-06-18T01:55:50.707 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: }, 2024-06-18T01:55:50.707 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "mgrmap": { 2024-06-18T01:55:50.707 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "available": false, 2024-06-18T01:55:50.707 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "num_standbys": 0, 2024-06-18T01:55:50.707 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "modules": [ 2024-06-18T01:55:50.707 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "iostat", 2024-06-18T01:55:50.707 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "nfs", 2024-06-18T01:55:50.707 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "restful" 2024-06-18T01:55:50.708 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: ], 2024-06-18T01:55:50.708 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "services": {} 2024-06-18T01:55:50.708 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: }, 2024-06-18T01:55:50.708 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "servicemap": { 2024-06-18T01:55:50.708 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "epoch": 1, 2024-06-18T01:55:50.708 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "modified": "2024-06-18T01:55:40.695890+0000", 2024-06-18T01:55:50.708 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "services": {} 2024-06-18T01:55:50.708 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: }, 2024-06-18T01:55:50.708 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "progress_events": {} 2024-06-18T01:55:50.708 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: } 2024-06-18T01:55:51.299 INFO:teuthology.orchestra.run.smithi007.stderr:mgr not available, waiting (2/15)... 2024-06-18T01:55:51.369 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:51 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/3666565698' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-06-18T01:55:51.369 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:55:51 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:55:51.085+0000 7f020a7e4000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-18T01:55:51.369 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:55:51 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:55:51.182+0000 7f020a7e4000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-18T01:55:51.681 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:55:51 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:55:51.490+0000 7f020a7e4000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-18T01:55:51.681 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:55:51 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:55:51.582+0000 7f020a7e4000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-18T01:55:52.355 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:55:52 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:55:52.006+0000 7f020a7e4000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-18T01:55:52.356 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:55:52 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:55:52.142+0000 7f020a7e4000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-18T01:55:52.356 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:55:52 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:55:52.237+0000 7f020a7e4000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-18T01:55:52.356 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:55:52 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:55:52.355+0000 7f020a7e4000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-18T01:55:52.681 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:55:52 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:55:52.447+0000 7f020a7e4000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-18T01:55:53.392 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:55:53 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:55:53.017+0000 7f020a7e4000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-18T01:55:53.681 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:55:53 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:55:53.392+0000 7f020a7e4000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-18T01:55:53.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:53 smithi007 ceph-mon[25091]: Activating manager daemon y 2024-06-18T01:55:53.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:53 smithi007 ceph-mon[25091]: mgrmap e2: y(active, starting, since 0.00275039s) 2024-06-18T01:55:53.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:53 smithi007 ceph-mon[25091]: from='mgr.14100 172.21.15.7:0/1092681782' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-18T01:55:53.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:53 smithi007 ceph-mon[25091]: from='mgr.14100 172.21.15.7:0/1092681782' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-18T01:55:53.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:53 smithi007 ceph-mon[25091]: from='mgr.14100 172.21.15.7:0/1092681782' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-18T01:55:53.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:53 smithi007 ceph-mon[25091]: from='mgr.14100 172.21.15.7:0/1092681782' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-18T01:55:53.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:53 smithi007 ceph-mon[25091]: from='mgr.14100 172.21.15.7:0/1092681782' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-06-18T01:55:53.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:53 smithi007 ceph-mon[25091]: Manager daemon y is now available 2024-06-18T01:55:53.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:53 smithi007 ceph-mon[25091]: from='mgr.14100 172.21.15.7:0/1092681782' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-06-18T01:55:53.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:53 smithi007 ceph-mon[25091]: from='mgr.14100 172.21.15.7:0/1092681782' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-06-18T01:55:53.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:53 smithi007 ceph-mon[25091]: from='mgr.14100 172.21.15.7:0/1092681782' entity='mgr.y' 2024-06-18T01:55:53.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:53 smithi007 ceph-mon[25091]: from='mgr.14100 172.21.15.7:0/1092681782' entity='mgr.y' 2024-06-18T01:55:53.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:53 smithi007 ceph-mon[25091]: from='mgr.14100 172.21.15.7:0/1092681782' entity='mgr.y' 2024-06-18T01:55:53.814 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: 2024-06-18T01:55:53.814 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: { 2024-06-18T01:55:53.814 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "fsid": "cd9a3408-2d15-11ef-bc9d-c7b262605968", 2024-06-18T01:55:53.814 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "health": { 2024-06-18T01:55:53.814 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2024-06-18T01:55:53.814 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "checks": {}, 2024-06-18T01:55:53.814 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "mutes": [] 2024-06-18T01:55:53.814 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: }, 2024-06-18T01:55:53.814 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "election_epoch": 5, 2024-06-18T01:55:53.814 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "quorum": [ 2024-06-18T01:55:53.815 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: 0 2024-06-18T01:55:53.815 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: ], 2024-06-18T01:55:53.815 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "quorum_names": [ 2024-06-18T01:55:53.815 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "a" 2024-06-18T01:55:53.815 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: ], 2024-06-18T01:55:53.815 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "quorum_age": 8, 2024-06-18T01:55:53.815 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "monmap": { 2024-06-18T01:55:53.815 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "epoch": 1, 2024-06-18T01:55:53.815 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "min_mon_release_name": "quincy", 2024-06-18T01:55:53.815 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "num_mons": 1 2024-06-18T01:55:53.815 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: }, 2024-06-18T01:55:53.815 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "osdmap": { 2024-06-18T01:55:53.815 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "epoch": 1, 2024-06-18T01:55:53.815 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "num_osds": 0, 2024-06-18T01:55:53.816 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "num_up_osds": 0, 2024-06-18T01:55:53.816 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "osd_up_since": 0, 2024-06-18T01:55:53.816 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "num_in_osds": 0, 2024-06-18T01:55:53.819 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "osd_in_since": 0, 2024-06-18T01:55:53.819 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2024-06-18T01:55:53.819 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: }, 2024-06-18T01:55:53.819 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "pgmap": { 2024-06-18T01:55:53.819 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "pgs_by_state": [], 2024-06-18T01:55:53.819 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "num_pgs": 0, 2024-06-18T01:55:53.819 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "num_pools": 0, 2024-06-18T01:55:53.819 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "num_objects": 0, 2024-06-18T01:55:53.819 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "data_bytes": 0, 2024-06-18T01:55:53.820 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "bytes_used": 0, 2024-06-18T01:55:53.820 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "bytes_avail": 0, 2024-06-18T01:55:53.820 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "bytes_total": 0 2024-06-18T01:55:53.820 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: }, 2024-06-18T01:55:53.820 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "fsmap": { 2024-06-18T01:55:53.820 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "epoch": 1, 2024-06-18T01:55:53.820 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "by_rank": [], 2024-06-18T01:55:53.820 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "up:standby": 0 2024-06-18T01:55:53.820 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: }, 2024-06-18T01:55:53.820 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "mgrmap": { 2024-06-18T01:55:53.820 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "available": false, 2024-06-18T01:55:53.820 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "num_standbys": 0, 2024-06-18T01:55:53.820 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "modules": [ 2024-06-18T01:55:53.820 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "iostat", 2024-06-18T01:55:53.820 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "nfs", 2024-06-18T01:55:53.821 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "restful" 2024-06-18T01:55:53.821 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: ], 2024-06-18T01:55:53.821 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "services": {} 2024-06-18T01:55:53.821 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: }, 2024-06-18T01:55:53.821 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "servicemap": { 2024-06-18T01:55:53.821 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "epoch": 1, 2024-06-18T01:55:53.821 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "modified": "2024-06-18T01:55:40.695890+0000", 2024-06-18T01:55:53.821 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "services": {} 2024-06-18T01:55:53.821 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: }, 2024-06-18T01:55:53.821 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "progress_events": {} 2024-06-18T01:55:53.821 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: } 2024-06-18T01:55:54.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:54 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/2227761055' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-06-18T01:55:54.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:54 smithi007 ceph-mon[25091]: mgrmap e3: y(active, since 1.00618s) 2024-06-18T01:55:56.367 INFO:teuthology.orchestra.run.smithi007.stderr:mgr not available, waiting (3/15)... 2024-06-18T01:55:57.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:55:57 smithi007 ceph-mon[25091]: mgrmap e4: y(active, since 2s) 2024-06-18T01:56:02.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:02 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/2472598832' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-06-18T01:56:02.668 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: 2024-06-18T01:56:02.668 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: { 2024-06-18T01:56:02.668 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "fsid": "cd9a3408-2d15-11ef-bc9d-c7b262605968", 2024-06-18T01:56:02.668 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "health": { 2024-06-18T01:56:02.668 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2024-06-18T01:56:02.668 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "checks": {}, 2024-06-18T01:56:02.669 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "mutes": [] 2024-06-18T01:56:02.669 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: }, 2024-06-18T01:56:02.669 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "election_epoch": 5, 2024-06-18T01:56:02.669 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "quorum": [ 2024-06-18T01:56:02.669 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: 0 2024-06-18T01:56:02.669 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: ], 2024-06-18T01:56:02.669 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "quorum_names": [ 2024-06-18T01:56:02.670 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "a" 2024-06-18T01:56:02.670 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: ], 2024-06-18T01:56:02.670 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "quorum_age": 16, 2024-06-18T01:56:02.670 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "monmap": { 2024-06-18T01:56:02.670 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "epoch": 1, 2024-06-18T01:56:02.670 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "min_mon_release_name": "quincy", 2024-06-18T01:56:02.670 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "num_mons": 1 2024-06-18T01:56:02.670 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: }, 2024-06-18T01:56:02.670 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "osdmap": { 2024-06-18T01:56:02.670 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "epoch": 1, 2024-06-18T01:56:02.670 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "num_osds": 0, 2024-06-18T01:56:02.670 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "num_up_osds": 0, 2024-06-18T01:56:02.670 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "osd_up_since": 0, 2024-06-18T01:56:02.671 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "num_in_osds": 0, 2024-06-18T01:56:02.671 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "osd_in_since": 0, 2024-06-18T01:56:02.671 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2024-06-18T01:56:02.671 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: }, 2024-06-18T01:56:02.671 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "pgmap": { 2024-06-18T01:56:02.671 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "pgs_by_state": [], 2024-06-18T01:56:02.671 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "num_pgs": 0, 2024-06-18T01:56:02.671 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "num_pools": 0, 2024-06-18T01:56:02.671 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "num_objects": 0, 2024-06-18T01:56:02.671 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "data_bytes": 0, 2024-06-18T01:56:02.672 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "bytes_used": 0, 2024-06-18T01:56:02.672 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "bytes_avail": 0, 2024-06-18T01:56:02.672 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "bytes_total": 0 2024-06-18T01:56:02.672 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: }, 2024-06-18T01:56:02.672 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "fsmap": { 2024-06-18T01:56:02.672 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "epoch": 1, 2024-06-18T01:56:02.672 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "by_rank": [], 2024-06-18T01:56:02.672 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "up:standby": 0 2024-06-18T01:56:02.672 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: }, 2024-06-18T01:56:02.673 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "mgrmap": { 2024-06-18T01:56:02.673 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "available": true, 2024-06-18T01:56:02.673 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "num_standbys": 0, 2024-06-18T01:56:02.673 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "modules": [ 2024-06-18T01:56:02.673 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "iostat", 2024-06-18T01:56:02.673 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "nfs", 2024-06-18T01:56:02.674 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "restful" 2024-06-18T01:56:02.674 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: ], 2024-06-18T01:56:02.674 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "services": {} 2024-06-18T01:56:02.674 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: }, 2024-06-18T01:56:02.674 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "servicemap": { 2024-06-18T01:56:02.674 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "epoch": 1, 2024-06-18T01:56:02.674 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "modified": "2024-06-18T01:55:40.695890+0000", 2024-06-18T01:56:02.674 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "services": {} 2024-06-18T01:56:02.674 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: }, 2024-06-18T01:56:02.674 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "progress_events": {} 2024-06-18T01:56:02.674 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: } 2024-06-18T01:56:07.248 INFO:teuthology.orchestra.run.smithi007.stderr:mgr is available 2024-06-18T01:56:07.916 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: 2024-06-18T01:56:07.916 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: [global] 2024-06-18T01:56:07.916 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: fsid = cd9a3408-2d15-11ef-bc9d-c7b262605968 2024-06-18T01:56:07.916 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: mon_osd_allow_pg_remap = true 2024-06-18T01:56:07.916 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: mon_osd_allow_primary_affinity = true 2024-06-18T01:56:07.916 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: mon_warn_on_no_sortbitwise = false 2024-06-18T01:56:07.916 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: osd_crush_chooseleaf_type = 0 2024-06-18T01:56:07.916 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: 2024-06-18T01:56:07.916 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: [mgr] 2024-06-18T01:56:07.916 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: mgr/telemetry/nag = false 2024-06-18T01:56:07.917 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: 2024-06-18T01:56:07.917 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: [osd] 2024-06-18T01:56:07.917 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: osd_map_max_advance = 10 2024-06-18T01:56:07.917 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: osd_sloppy_crc = true 2024-06-18T01:56:08.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:07 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/675706235' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-06-18T01:56:08.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:07 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/675706235' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-06-18T01:56:08.443 INFO:teuthology.orchestra.run.smithi007.stderr:Enabling cephadm module... 2024-06-18T01:56:09.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:09 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/2675053678' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-06-18T01:56:09.432 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:09 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: ignoring --setuser ceph since I am not root 2024-06-18T01:56:09.432 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:09 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: ignoring --setgroup ceph since I am not root 2024-06-18T01:56:09.432 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:09 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:56:09.312+0000 7fad8d907000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-18T01:56:09.724 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:09 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:56:09.446+0000 7fad8d907000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-18T01:56:09.724 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:09 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:56:09.549+0000 7fad8d907000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-18T01:56:09.982 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:09 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:56:09.872+0000 7fad8d907000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-18T01:56:09.983 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:09 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:56:09.958+0000 7fad8d907000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-18T01:56:10.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:10 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/2675053678' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-06-18T01:56:10.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:10 smithi007 ceph-mon[25091]: mgrmap e5: y(active, since 15s) 2024-06-18T01:56:10.453 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: { 2024-06-18T01:56:10.453 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "epoch": 5, 2024-06-18T01:56:10.453 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "available": true, 2024-06-18T01:56:10.453 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "active_name": "y", 2024-06-18T01:56:10.453 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "num_standby": 0 2024-06-18T01:56:10.453 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: } 2024-06-18T01:56:10.999 INFO:teuthology.orchestra.run.smithi007.stderr:Waiting for the mgr to restart... 2024-06-18T01:56:10.999 INFO:teuthology.orchestra.run.smithi007.stderr:Waiting for mgr epoch 5... 2024-06-18T01:56:11.282 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:11 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/58605669' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-06-18T01:56:11.282 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:11 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:56:11.151+0000 7fad8d907000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-18T01:56:11.681 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:11 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:56:11.326+0000 7fad8d907000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-18T01:56:11.682 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:11 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:56:11.413+0000 7fad8d907000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-18T01:56:12.175 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:11 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:56:11.738+0000 7fad8d907000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-18T01:56:12.175 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:11 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:56:11.831+0000 7fad8d907000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-18T01:56:12.175 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:11 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:56:11.927+0000 7fad8d907000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-18T01:56:12.431 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:12 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:56:12.175+0000 7fad8d907000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-18T01:56:12.929 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:12 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:56:12.635+0000 7fad8d907000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-18T01:56:13.181 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:13 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:56:13.137+0000 7fad8d907000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-18T01:56:13.539 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:13 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:56:13.234+0000 7fad8d907000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-18T01:56:13.539 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:13 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:56:13.539+0000 7fad8d907000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-18T01:56:13.931 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:13 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:56:13.631+0000 7fad8d907000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-18T01:56:14.396 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:14 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:56:14.049+0000 7fad8d907000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-18T01:56:14.397 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:14 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:56:14.185+0000 7fad8d907000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-18T01:56:14.397 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:14 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:56:14.280+0000 7fad8d907000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-18T01:56:14.397 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:14 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:56:14.397+0000 7fad8d907000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-18T01:56:14.681 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:14 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:56:14.488+0000 7fad8d907000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-18T01:56:15.427 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:15 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:56:15.055+0000 7fad8d907000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-18T01:56:15.681 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:15 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:56:15.426+0000 7fad8d907000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-18T01:56:16.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:16 smithi007 ceph-mon[25091]: Active manager daemon y restarted 2024-06-18T01:56:16.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:16 smithi007 ceph-mon[25091]: Activating manager daemon y 2024-06-18T01:56:16.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:16 smithi007 ceph-mon[25091]: osdmap e2: 0 total, 0 up, 0 in 2024-06-18T01:56:16.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:16 smithi007 ceph-mon[25091]: mgrmap e6: y(active, starting, since 0.712441s) 2024-06-18T01:56:16.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:16 smithi007 ceph-mon[25091]: from='mgr.14120 172.21.15.7:0/2999002923' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-18T01:56:16.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:16 smithi007 ceph-mon[25091]: from='mgr.14120 172.21.15.7:0/2999002923' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-06-18T01:56:16.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:16 smithi007 ceph-mon[25091]: from='mgr.14120 172.21.15.7:0/2999002923' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-18T01:56:16.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:16 smithi007 ceph-mon[25091]: from='mgr.14120 172.21.15.7:0/2999002923' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-18T01:56:16.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:16 smithi007 ceph-mon[25091]: from='mgr.14120 172.21.15.7:0/2999002923' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-18T01:56:16.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:16 smithi007 ceph-mon[25091]: Manager daemon y is now available 2024-06-18T01:56:16.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:16 smithi007 ceph-mon[25091]: from='mgr.14120 172.21.15.7:0/2999002923' entity='mgr.y' 2024-06-18T01:56:16.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:16 smithi007 ceph-mon[25091]: from='mgr.14120 172.21.15.7:0/2999002923' entity='mgr.y' 2024-06-18T01:56:16.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:16 smithi007 ceph-mon[25091]: from='mgr.14120 172.21.15.7:0/2999002923' entity='mgr.y' 2024-06-18T01:56:16.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:16 smithi007 ceph-mon[25091]: from='mgr.14120 172.21.15.7:0/2999002923' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:56:16.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:16 smithi007 ceph-mon[25091]: from='mgr.14120 172.21.15.7:0/2999002923' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:56:16.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:16 smithi007 ceph-mon[25091]: from='mgr.14120 172.21.15.7:0/2999002923' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:56:16.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:16 smithi007 ceph-mon[25091]: from='mgr.14120 172.21.15.7:0/2999002923' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-06-18T01:56:16.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:16 smithi007 ceph-mon[25091]: from='mgr.14120 172.21.15.7:0/2999002923' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-06-18T01:56:17.153 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: { 2024-06-18T01:56:17.153 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "mgrmap_epoch": 7, 2024-06-18T01:56:17.153 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "initialized": true 2024-06-18T01:56:17.153 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: } 2024-06-18T01:56:17.404 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:17 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: [18/Jun/2024:01:56:17] ENGINE Bus STARTING 2024-06-18T01:56:17.404 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:17 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: [18/Jun/2024:01:56:17] ENGINE Serving on https://172.21.15.7:7150 2024-06-18T01:56:17.661 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:17 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: [18/Jun/2024:01:56:17] ENGINE Bus STARTED 2024-06-18T01:56:17.664 INFO:teuthology.orchestra.run.smithi007.stderr:mgr epoch 5 is available 2024-06-18T01:56:17.664 INFO:teuthology.orchestra.run.smithi007.stderr:Setting orchestrator backend to cephadm... 2024-06-18T01:56:18.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:18 smithi007 ceph-mon[25091]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-06-18T01:56:18.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:18 smithi007 ceph-mon[25091]: mgrmap e7: y(active, since 1.71389s) 2024-06-18T01:56:18.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:18 smithi007 ceph-mon[25091]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-06-18T01:56:18.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:18 smithi007 ceph-mon[25091]: from='mgr.14120 172.21.15.7:0/2999002923' entity='mgr.y' 2024-06-18T01:56:18.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:18 smithi007 ceph-mon[25091]: from='mgr.14120 172.21.15.7:0/2999002923' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:56:19.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:19 smithi007 ceph-mon[25091]: [18/Jun/2024:01:56:17] ENGINE Bus STARTING 2024-06-18T01:56:19.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:19 smithi007 ceph-mon[25091]: [18/Jun/2024:01:56:17] ENGINE Serving on https://172.21.15.7:7150 2024-06-18T01:56:19.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:19 smithi007 ceph-mon[25091]: [18/Jun/2024:01:56:17] ENGINE Bus STARTED 2024-06-18T01:56:19.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:19 smithi007 ceph-mon[25091]: from='mgr.14120 172.21.15.7:0/2999002923' entity='mgr.y' 2024-06-18T01:56:19.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:19 smithi007 ceph-mon[25091]: from='mgr.14120 172.21.15.7:0/2999002923' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:56:19.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:19 smithi007 ceph-mon[25091]: mgrmap e8: y(active, since 2s) 2024-06-18T01:56:19.456 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: value unchanged 2024-06-18T01:56:20.022 INFO:teuthology.orchestra.run.smithi007.stderr:Generating ssh key... 2024-06-18T01:56:20.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:20 smithi007 ceph-mon[25091]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T01:56:21.286 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:21 smithi007 ceph-mon[25091]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T01:56:21.286 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:21 smithi007 ceph-mon[25091]: from='mgr.14120 172.21.15.7:0/2999002923' entity='mgr.y' 2024-06-18T01:56:21.286 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:21 smithi007 ceph-mon[25091]: from='mgr.14120 172.21.15.7:0/2999002923' entity='mgr.y' 2024-06-18T01:56:21.286 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:20 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: Generating public/private rsa key pair. 2024-06-18T01:56:21.287 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:20 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: Your identification has been saved in /tmp/tmpo_hk9m39/key. 2024-06-18T01:56:21.287 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:20 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: Your public key has been saved in /tmp/tmpo_hk9m39/key.pub. 2024-06-18T01:56:21.287 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:20 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: The key fingerprint is: 2024-06-18T01:56:21.287 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:20 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: SHA256:/vkPkc4372LYR7G6zukZRa4LF8YFQUuMELVrrSBSzdg ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968 2024-06-18T01:56:21.287 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:20 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: The key's randomart image is: 2024-06-18T01:56:21.287 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:20 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: +---[RSA 3072]----+ 2024-06-18T01:56:21.287 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:20 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: | o+.+=. | 2024-06-18T01:56:21.287 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:20 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: | = .o.o | 2024-06-18T01:56:21.287 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:20 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: | o E . . o | 2024-06-18T01:56:21.287 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:20 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: | . +.+. | 2024-06-18T01:56:21.287 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:20 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: | . .S. oo= oo| 2024-06-18T01:56:21.287 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:20 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: | ... ooo.+..| 2024-06-18T01:56:21.287 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:20 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: | . o+*+. | 2024-06-18T01:56:21.287 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:20 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: | . .=+Oo.| 2024-06-18T01:56:21.288 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:20 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: | o.+@o+o| 2024-06-18T01:56:21.288 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:20 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: +----[SHA256]-----+ 2024-06-18T01:56:22.156 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDV1UuQjQZQyZvNFPwCx2llmapktPl20+ANXpQLHKXXrmuPQrNO3FpcIZaP3FAQsXdgs2aRw3eU/8JAQIk6nBoboVkRMtXUB+SVCr/6DZQA5N30I02VYKuVBCYmYLMaRl4JXKea6N+VutUWJrzc9w6wklXh37LHcExLWsrN1JzR8rUW9BFrkJ9ynsw1ykcwB9y/PxRN91r4uiuQEyC0H+dVu6LrQPCDuMnU5KvnnaoFtIHmqzZnR66la78Ps36wI0NyBHkBxbCOaJXX6UztlNt2jVOFtIYIkHw6M6k5ynTJv74q2Z+vmp3onJ3FHEs/bbN7MGD5rvQiPKIldW0ASzzbPIMJOYY6kfSimXlohr6erNNd/a/XBxdSnjAfbSJJg5tbH18NU3rEDihlDxl6Zdi57RboKQvg8u/otug43Zl1yAn64f2bXAVqFTQFzOSZXq8GYsWlQkGmaUh41FoloSV/n3Y9+2+7CCjj/hanLIw1UYXhwCAjmFQNDwLK5bfAwSs= ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968 2024-06-18T01:56:22.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:22 smithi007 ceph-mon[25091]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T01:56:22.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:22 smithi007 ceph-mon[25091]: Generating ssh key... 2024-06-18T01:56:22.658 INFO:teuthology.orchestra.run.smithi007.stderr:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-06-18T01:56:22.658 INFO:teuthology.orchestra.run.smithi007.stderr:Adding key to root@localhost authorized_keys... 2024-06-18T01:56:22.658 INFO:teuthology.orchestra.run.smithi007.stderr:Adding host smithi007... 2024-06-18T01:56:23.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:23 smithi007 ceph-mon[25091]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T01:56:24.179 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: Added host 'smithi007' with addr '172.21.15.7' 2024-06-18T01:56:24.758 INFO:teuthology.orchestra.run.smithi007.stderr:Deploying unmanaged mon service... 2024-06-18T01:56:25.389 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: Scheduled mon update... 2024-06-18T01:56:25.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:25 smithi007 ceph-mon[25091]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi007", "addr": "172.21.15.7", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T01:56:25.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:25 smithi007 ceph-mon[25091]: Deploying cephadm binary to smithi007 2024-06-18T01:56:25.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:25 smithi007 ceph-mon[25091]: from='mgr.14120 172.21.15.7:0/2999002923' entity='mgr.y' 2024-06-18T01:56:25.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:25 smithi007 ceph-mon[25091]: Added host smithi007 2024-06-18T01:56:25.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:25 smithi007 ceph-mon[25091]: from='mgr.14120 172.21.15.7:0/2999002923' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:56:26.019 INFO:teuthology.orchestra.run.smithi007.stderr:Deploying unmanaged mgr service... 2024-06-18T01:56:26.629 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:26 smithi007 ceph-mon[25091]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T01:56:26.629 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:26 smithi007 ceph-mon[25091]: Saving service mon spec with placement count:5 2024-06-18T01:56:26.629 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:26 smithi007 ceph-mon[25091]: from='mgr.14120 172.21.15.7:0/2999002923' entity='mgr.y' 2024-06-18T01:56:26.641 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: Scheduled mgr update... 2024-06-18T01:56:27.764 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:27 smithi007 ceph-mon[25091]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T01:56:27.764 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:27 smithi007 ceph-mon[25091]: Saving service mgr spec with placement count:2 2024-06-18T01:56:27.764 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:27 smithi007 ceph-mon[25091]: from='mgr.14120 172.21.15.7:0/2999002923' entity='mgr.y' 2024-06-18T01:56:29.154 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:29 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/4187719213' entity='client.admin' 2024-06-18T01:56:29.155 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:29 smithi007 ceph-mon[25091]: from='mgr.14120 172.21.15.7:0/2999002923' entity='mgr.y' 2024-06-18T01:56:29.155 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:29 smithi007 ceph-mon[25091]: from='mgr.14120 172.21.15.7:0/2999002923' entity='mgr.y' 2024-06-18T01:56:30.369 INFO:teuthology.orchestra.run.smithi007.stderr:Enabling the dashboard module... 2024-06-18T01:56:30.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:30 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/2003154006' entity='client.admin' 2024-06-18T01:56:30.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:30 smithi007 ceph-mon[25091]: from='mgr.14120 172.21.15.7:0/2999002923' entity='mgr.y' 2024-06-18T01:56:30.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:30 smithi007 ceph-mon[25091]: from='mgr.14120 172.21.15.7:0/2999002923' entity='mgr.y' 2024-06-18T01:56:30.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:30 smithi007 ceph-mon[25091]: from='mgr.14120 172.21.15.7:0/2999002923' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi007", "name": "osd_memory_target"}]: dispatch 2024-06-18T01:56:30.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:30 smithi007 ceph-mon[25091]: from='mgr.14120 172.21.15.7:0/2999002923' entity='mgr.y' 2024-06-18T01:56:30.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:30 smithi007 ceph-mon[25091]: from='mgr.14120 172.21.15.7:0/2999002923' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi007", "caps": []}]: dispatch 2024-06-18T01:56:30.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:30 smithi007 ceph-mon[25091]: from='mgr.14120 172.21.15.7:0/2999002923' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.agent.smithi007", "caps": []}]': finished 2024-06-18T01:56:31.816 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:31 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/3244611261' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-06-18T01:56:31.816 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:31 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: ignoring --setuser ceph since I am not root 2024-06-18T01:56:31.816 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:31 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: ignoring --setgroup ceph since I am not root 2024-06-18T01:56:31.816 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:31 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:56:31.720+0000 7f8ad0f3c000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-18T01:56:32.074 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:31 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:56:31.856+0000 7f8ad0f3c000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-18T01:56:32.075 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:31 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:56:31.957+0000 7f8ad0f3c000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-18T01:56:32.370 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:32 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:56:32.281+0000 7f8ad0f3c000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-18T01:56:32.370 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:32 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:56:32.369+0000 7f8ad0f3c000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-18T01:56:32.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:32 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/3244611261' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-06-18T01:56:32.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:32 smithi007 ceph-mon[25091]: mgrmap e9: y(active, since 16s) 2024-06-18T01:56:32.761 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: { 2024-06-18T01:56:32.761 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "epoch": 9, 2024-06-18T01:56:32.761 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "available": true, 2024-06-18T01:56:32.761 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "active_name": "y", 2024-06-18T01:56:32.761 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "num_standby": 0 2024-06-18T01:56:32.761 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: } 2024-06-18T01:56:33.567 INFO:teuthology.orchestra.run.smithi007.stderr:Waiting for the mgr to restart... 2024-06-18T01:56:33.567 INFO:teuthology.orchestra.run.smithi007.stderr:Waiting for mgr epoch 9... 2024-06-18T01:56:33.826 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:33 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/3193832855' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-06-18T01:56:33.827 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:33 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:56:33.558+0000 7f8ad0f3c000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-18T01:56:33.827 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:33 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:56:33.739+0000 7f8ad0f3c000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-18T01:56:33.827 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:33 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:56:33.826+0000 7f8ad0f3c000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-18T01:56:34.431 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:34 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:56:34.154+0000 7f8ad0f3c000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-18T01:56:34.431 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:34 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:56:34.248+0000 7f8ad0f3c000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-18T01:56:34.432 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:34 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:56:34.344+0000 7f8ad0f3c000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-18T01:56:34.931 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:34 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:56:34.594+0000 7f8ad0f3c000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-18T01:56:35.431 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:56:35.053+0000 7f8ad0f3c000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-18T01:56:35.858 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:56:35.560+0000 7f8ad0f3c000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-18T01:56:35.859 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:56:35.659+0000 7f8ad0f3c000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-18T01:56:36.182 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:56:35.975+0000 7f8ad0f3c000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-18T01:56:36.182 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:36 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:56:36.069+0000 7f8ad0f3c000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-18T01:56:36.843 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:36 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:56:36.490+0000 7f8ad0f3c000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-18T01:56:36.843 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:36 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:56:36.629+0000 7f8ad0f3c000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-18T01:56:36.843 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:36 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:56:36.725+0000 7f8ad0f3c000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-18T01:56:36.843 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:36 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:56:36.843+0000 7f8ad0f3c000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-18T01:56:37.181 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:36 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:56:36.935+0000 7f8ad0f3c000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-18T01:56:37.878 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:37 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:56:37.505+0000 7f8ad0f3c000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-18T01:56:38.141 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:37 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T01:56:37.878+0000 7f8ad0f3c000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-18T01:56:38.431 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:38 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: [18/Jun/2024:01:56:38] ENGINE Bus STARTING 2024-06-18T01:56:38.432 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:38 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: [18/Jun/2024:01:56:38] ENGINE Serving on https://172.21.15.7:7150 2024-06-18T01:56:38.432 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:38 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: [18/Jun/2024:01:56:38] ENGINE Bus STARTED 2024-06-18T01:56:38.944 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: { 2024-06-18T01:56:38.944 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "mgrmap_epoch": 11, 2024-06-18T01:56:38.944 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: "initialized": true 2024-06-18T01:56:38.944 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: } 2024-06-18T01:56:39.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:38 smithi007 ceph-mon[25091]: Active manager daemon y restarted 2024-06-18T01:56:39.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:38 smithi007 ceph-mon[25091]: Activating manager daemon y 2024-06-18T01:56:39.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:38 smithi007 ceph-mon[25091]: osdmap e3: 0 total, 0 up, 0 in 2024-06-18T01:56:39.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:38 smithi007 ceph-mon[25091]: mgrmap e10: y(active, starting, since 0.0525369s) 2024-06-18T01:56:39.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:38 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-18T01:56:39.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:38 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-06-18T01:56:39.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:38 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-18T01:56:39.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:38 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-18T01:56:39.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:38 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-18T01:56:39.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:38 smithi007 ceph-mon[25091]: Manager daemon y is now available 2024-06-18T01:56:39.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:38 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:56:39.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:38 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:56:39.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:38 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:56:39.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:38 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-06-18T01:56:39.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:38 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-06-18T01:56:39.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:38 smithi007 ceph-mon[25091]: [18/Jun/2024:01:56:38] ENGINE Bus STARTING 2024-06-18T01:56:39.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:38 smithi007 ceph-mon[25091]: [18/Jun/2024:01:56:38] ENGINE Serving on https://172.21.15.7:7150 2024-06-18T01:56:39.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:38 smithi007 ceph-mon[25091]: [18/Jun/2024:01:56:38] ENGINE Bus STARTED 2024-06-18T01:56:39.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:38 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:56:39.501 INFO:teuthology.orchestra.run.smithi007.stderr:mgr epoch 9 is available 2024-06-18T01:56:39.501 INFO:teuthology.orchestra.run.smithi007.stderr:Generating a dashboard self-signed certificate... 2024-06-18T01:56:40.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:39 smithi007 ceph-mon[25091]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-06-18T01:56:40.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:39 smithi007 ceph-mon[25091]: mgrmap e11: y(active, since 1.05634s) 2024-06-18T01:56:40.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:39 smithi007 ceph-mon[25091]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-06-18T01:56:40.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:39 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:56:40.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:39 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi007", "name": "osd_memory_target"}]: dispatch 2024-06-18T01:56:40.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:39 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:56:40.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:39 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi007", "caps": []}]: dispatch 2024-06-18T01:56:40.261 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: Self-signed certificate created 2024-06-18T01:56:40.799 INFO:teuthology.orchestra.run.smithi007.stderr:Creating initial admin user... 2024-06-18T01:56:41.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:40 smithi007 ceph-mon[25091]: mgrmap e12: y(active, since 2s) 2024-06-18T01:56:41.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:40 smithi007 ceph-mon[25091]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T01:56:41.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:40 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:56:41.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:40 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:56:41.659 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: {"username": "admin", "password": "$2b$12$RqyyMxf/IXTDaPEbc2VLjesjDYIDrlWdw2YKXZRgVenOOAU/ADpzy", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1718675801, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-06-18T01:56:42.181 INFO:teuthology.orchestra.run.smithi007.stderr:Fetching dashboard port number... 2024-06-18T01:56:42.288 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:41 smithi007 ceph-mon[25091]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T01:56:42.288 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:41 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:56:42.802 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: 8443 2024-06-18T01:56:43.428 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:42 smithi007 ceph-mon[25091]: Deploying daemon agent.smithi007 on smithi007 2024-06-18T01:56:43.428 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:42 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/2971021594' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-06-18T01:56:43.441 INFO:teuthology.orchestra.run.smithi007.stderr:systemctl: disabled 2024-06-18T01:56:43.448 INFO:teuthology.orchestra.run.smithi007.stderr:systemctl: inactive 2024-06-18T01:56:43.449 INFO:teuthology.orchestra.run.smithi007.stderr:firewalld.service is not enabled 2024-06-18T01:56:43.449 INFO:teuthology.orchestra.run.smithi007.stderr:Not possible to open ports <[8443]>. firewalld.service is not available 2024-06-18T01:56:43.451 INFO:teuthology.orchestra.run.smithi007.stderr:Ceph Dashboard is now available at: 2024-06-18T01:56:43.451 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-06-18T01:56:43.451 INFO:teuthology.orchestra.run.smithi007.stderr: URL: https://smithi007.front.sepia.ceph.com:8443/ 2024-06-18T01:56:43.451 INFO:teuthology.orchestra.run.smithi007.stderr: User: admin 2024-06-18T01:56:43.451 INFO:teuthology.orchestra.run.smithi007.stderr: Password: cy3h51735h 2024-06-18T01:56:43.451 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-06-18T01:56:43.452 INFO:teuthology.orchestra.run.smithi007.stderr:Enabling autotune for osd_memory_target 2024-06-18T01:56:45.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:44 smithi007 ceph-mon[25091]: mgrmap e13: y(active, since 6s) 2024-06-18T01:56:45.447 INFO:teuthology.orchestra.run.smithi007.stderr:/usr/bin/ceph: set mgr/dashboard/cluster/status 2024-06-18T01:56:45.987 INFO:teuthology.orchestra.run.smithi007.stderr:You can access the Ceph CLI with: 2024-06-18T01:56:45.987 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-06-18T01:56:45.987 INFO:teuthology.orchestra.run.smithi007.stderr: sudo /home/ubuntu/cephtest/cephadm shell --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-06-18T01:56:45.987 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-06-18T01:56:45.987 INFO:teuthology.orchestra.run.smithi007.stderr:Please consider enabling telemetry to help improve Ceph: 2024-06-18T01:56:45.987 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-06-18T01:56:45.987 INFO:teuthology.orchestra.run.smithi007.stderr: ceph telemetry on 2024-06-18T01:56:45.987 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-06-18T01:56:45.987 INFO:teuthology.orchestra.run.smithi007.stderr:For more information see: 2024-06-18T01:56:45.988 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-06-18T01:56:45.988 INFO:teuthology.orchestra.run.smithi007.stderr: https://docs.ceph.com/docs/master/mgr/telemetry/ 2024-06-18T01:56:45.988 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-06-18T01:56:45.988 INFO:teuthology.orchestra.run.smithi007.stderr:Bootstrap complete. 2024-06-18T01:56:46.193 INFO:tasks.cephadm:Fetching config... 2024-06-18T01:56:46.193 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-06-18T01:56:46.193 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-06-18T01:56:46.210 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-06-18T01:56:46.210 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-06-18T01:56:46.210 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-06-18T01:56:46.268 INFO:tasks.cephadm:Fetching mon keyring... 2024-06-18T01:56:46.268 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-06-18T01:56:46.268 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/mon.a/keyring of=/dev/stdout 2024-06-18T01:56:46.375 INFO:tasks.cephadm:Fetching pub ssh key... 2024-06-18T01:56:46.375 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-06-18T01:56:46.375 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-06-18T01:56:46.433 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-06-18T01:56:46.433 DEBUG:teuthology.orchestra.run.smithi007:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDV1UuQjQZQyZvNFPwCx2llmapktPl20+ANXpQLHKXXrmuPQrNO3FpcIZaP3FAQsXdgs2aRw3eU/8JAQIk6nBoboVkRMtXUB+SVCr/6DZQA5N30I02VYKuVBCYmYLMaRl4JXKea6N+VutUWJrzc9w6wklXh37LHcExLWsrN1JzR8rUW9BFrkJ9ynsw1ykcwB9y/PxRN91r4uiuQEyC0H+dVu6LrQPCDuMnU5KvnnaoFtIHmqzZnR66la78Ps36wI0NyBHkBxbCOaJXX6UztlNt2jVOFtIYIkHw6M6k5ynTJv74q2Z+vmp3onJ3FHEs/bbN7MGD5rvQiPKIldW0ASzzbPIMJOYY6kfSimXlohr6erNNd/a/XBxdSnjAfbSJJg5tbH18NU3rEDihlDxl6Zdi57RboKQvg8u/otug43Zl1yAn64f2bXAVqFTQFzOSZXq8GYsWlQkGmaUh41FoloSV/n3Y9+2+7CCjj/hanLIw1UYXhwCAjmFQNDwLK5bfAwSs= ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-06-18T01:56:46.509 INFO:teuthology.orchestra.run.smithi007.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDV1UuQjQZQyZvNFPwCx2llmapktPl20+ANXpQLHKXXrmuPQrNO3FpcIZaP3FAQsXdgs2aRw3eU/8JAQIk6nBoboVkRMtXUB+SVCr/6DZQA5N30I02VYKuVBCYmYLMaRl4JXKea6N+VutUWJrzc9w6wklXh37LHcExLWsrN1JzR8rUW9BFrkJ9ynsw1ykcwB9y/PxRN91r4uiuQEyC0H+dVu6LrQPCDuMnU5KvnnaoFtIHmqzZnR66la78Ps36wI0NyBHkBxbCOaJXX6UztlNt2jVOFtIYIkHw6M6k5ynTJv74q2Z+vmp3onJ3FHEs/bbN7MGD5rvQiPKIldW0ASzzbPIMJOYY6kfSimXlohr6erNNd/a/XBxdSnjAfbSJJg5tbH18NU3rEDihlDxl6Zdi57RboKQvg8u/otug43Zl1yAn64f2bXAVqFTQFzOSZXq8GYsWlQkGmaUh41FoloSV/n3Y9+2+7CCjj/hanLIw1UYXhwCAjmFQNDwLK5bfAwSs= ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968 2024-06-18T01:56:46.521 DEBUG:teuthology.orchestra.run.smithi130:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDV1UuQjQZQyZvNFPwCx2llmapktPl20+ANXpQLHKXXrmuPQrNO3FpcIZaP3FAQsXdgs2aRw3eU/8JAQIk6nBoboVkRMtXUB+SVCr/6DZQA5N30I02VYKuVBCYmYLMaRl4JXKea6N+VutUWJrzc9w6wklXh37LHcExLWsrN1JzR8rUW9BFrkJ9ynsw1ykcwB9y/PxRN91r4uiuQEyC0H+dVu6LrQPCDuMnU5KvnnaoFtIHmqzZnR66la78Ps36wI0NyBHkBxbCOaJXX6UztlNt2jVOFtIYIkHw6M6k5ynTJv74q2Z+vmp3onJ3FHEs/bbN7MGD5rvQiPKIldW0ASzzbPIMJOYY6kfSimXlohr6erNNd/a/XBxdSnjAfbSJJg5tbH18NU3rEDihlDxl6Zdi57RboKQvg8u/otug43Zl1yAn64f2bXAVqFTQFzOSZXq8GYsWlQkGmaUh41FoloSV/n3Y9+2+7CCjj/hanLIw1UYXhwCAjmFQNDwLK5bfAwSs= ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-06-18T01:56:46.564 INFO:teuthology.orchestra.run.smithi130.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDV1UuQjQZQyZvNFPwCx2llmapktPl20+ANXpQLHKXXrmuPQrNO3FpcIZaP3FAQsXdgs2aRw3eU/8JAQIk6nBoboVkRMtXUB+SVCr/6DZQA5N30I02VYKuVBCYmYLMaRl4JXKea6N+VutUWJrzc9w6wklXh37LHcExLWsrN1JzR8rUW9BFrkJ9ynsw1ykcwB9y/PxRN91r4uiuQEyC0H+dVu6LrQPCDuMnU5KvnnaoFtIHmqzZnR66la78Ps36wI0NyBHkBxbCOaJXX6UztlNt2jVOFtIYIkHw6M6k5ynTJv74q2Z+vmp3onJ3FHEs/bbN7MGD5rvQiPKIldW0ASzzbPIMJOYY6kfSimXlohr6erNNd/a/XBxdSnjAfbSJJg5tbH18NU3rEDihlDxl6Zdi57RboKQvg8u/otug43Zl1yAn64f2bXAVqFTQFzOSZXq8GYsWlQkGmaUh41FoloSV/n3Y9+2+7CCjj/hanLIw1UYXhwCAjmFQNDwLK5bfAwSs= ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968 2024-06-18T01:56:46.575 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:46 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/1704269250' entity='client.admin' 2024-06-18T01:56:46.576 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-06-18T01:56:46.836 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:46 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.7 - - [18/Jun/2024:01:56:46] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T01:56:47.867 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:47 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:56:47.867 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:47 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:56:47.867 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:47 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:56:47.868 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:47 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:56:47.868 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:47 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:56:47.868 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:47 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:56:49.276 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:48 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:56:50.432 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:50 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.7 - - [18/Jun/2024:01:56:50] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T01:56:50.828 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-06-18T01:56:50.828 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-06-18T01:56:51.156 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:51 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/603624804' entity='client.admin' 2024-06-18T01:56:51.156 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:51 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:56:51.156 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:51 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:56:51.156 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:51 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:56:51.156 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:51 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:56:51.932 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:51 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.7 - - [18/Jun/2024:01:56:51] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T01:56:52.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:52 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:56:52.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:52 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:56:53.597 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi130 2024-06-18T01:56:53.597 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-06-18T01:56:53.597 DEBUG:teuthology.orchestra.run.smithi130:> dd of=/etc/ceph/ceph.conf 2024-06-18T01:56:53.616 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-06-18T01:56:53.616 DEBUG:teuthology.orchestra.run.smithi130:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-06-18T01:56:53.674 INFO:tasks.cephadm:Adding host smithi130 to orchestrator... 2024-06-18T01:56:53.675 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph orch host add smithi130 2024-06-18T01:56:54.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:53 smithi007 ceph-mon[25091]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T01:56:54.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:53 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:56:54.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:53 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:56:54.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:53 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:56:54.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:53 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:56:54.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:53 smithi007 ceph-mon[25091]: Updating smithi007:/etc/ceph/ceph.conf 2024-06-18T01:56:54.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:53 smithi007 ceph-mon[25091]: Updating smithi007:/etc/ceph/ceph.client.admin.keyring 2024-06-18T01:56:54.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:53 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:56:54.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:53 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:56:56.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:56 smithi007 ceph-mon[25091]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi130", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T01:56:56.511 INFO:teuthology.orchestra.run.smithi007.stdout:Added host 'smithi130' with addr '172.21.15.130' 2024-06-18T01:56:57.118 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph orch host ls --format=json 2024-06-18T01:56:57.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:57 smithi007 ceph-mon[25091]: Deploying cephadm binary to smithi130 2024-06-18T01:56:57.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:57 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:56:57.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:57 smithi007 ceph-mon[25091]: Added host smithi130 2024-06-18T01:56:57.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:57 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:56:57.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:57 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:56:57.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:57 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:56:57.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:57 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:56:57.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:57 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:56:57.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:57 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:56:57.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:57 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi130", "name": "osd_memory_target"}]: dispatch 2024-06-18T01:56:57.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:57 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:56:57.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:57 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi130", "caps": []}]: dispatch 2024-06-18T01:56:57.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:57 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.agent.smithi130", "caps": []}]': finished 2024-06-18T01:56:59.093 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-06-18T01:56:59.093 INFO:teuthology.orchestra.run.smithi007.stdout:[{"addr": "172.21.15.7", "hostname": "smithi007", "labels": [], "status": ""}, {"addr": "172.21.15.130", "hostname": "smithi130", "labels": [], "status": ""}] 2024-06-18T01:56:59.093 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:58 smithi007 ceph-mon[25091]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:56:59.093 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:58 smithi007 ceph-mon[25091]: Deploying daemon agent.smithi130 on smithi130 2024-06-18T01:56:59.093 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:58 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:56:59.093 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:58 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:56:59.094 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:58 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:56:59.094 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:58 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:56:59.673 INFO:tasks.cephadm:Setting crush tunables to default 2024-06-18T01:56:59.674 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph osd crush tunables default 2024-06-18T01:56:59.931 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:56:59 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.130 - - [18/Jun/2024:01:56:59] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T01:57:00.260 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:57:00 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.130 - - [18/Jun/2024:01:57:00] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T01:57:00.261 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:59 smithi007 ceph-mon[25091]: Updating smithi130:/etc/ceph/ceph.conf 2024-06-18T01:57:00.261 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:59 smithi007 ceph-mon[25091]: Updating smithi130:/etc/ceph/ceph.client.admin.keyring 2024-06-18T01:57:00.261 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:59 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:00.261 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:59 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:00.261 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:59 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:57:00.261 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:59 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:57:00.261 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:59 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:57:00.261 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:59 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:00.261 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:59 smithi007 ceph-mon[25091]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-18T01:57:00.261 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:56:59 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:01.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:01 smithi007 ceph-mon[25091]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:01.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:01 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:01.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:01 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:01.932 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:57:01 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.130 - - [18/Jun/2024:01:57:01] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T01:57:02.023 INFO:teuthology.orchestra.run.smithi007.stderr:adjusted tunables profile to default 2024-06-18T01:57:02.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:02 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/2545108397' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-06-18T01:57:02.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:02 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:02.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:02 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:02.709 INFO:tasks.cephadm:Adding mon.a on smithi007 2024-06-18T01:57:02.710 INFO:tasks.cephadm:Adding mon.c on smithi007 2024-06-18T01:57:02.710 INFO:tasks.cephadm:Adding mon.b on smithi130 2024-06-18T01:57:02.710 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph orch apply mon '3;smithi007:172.21.15.7=a;smithi007:[v2:172.21.15.7:3301,v1:172.21.15.7:6790]=c;smithi130:172.21.15.130=b' 2024-06-18T01:57:03.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:03 smithi007 ceph-mon[25091]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:03.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:03 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/2545108397' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-06-18T01:57:03.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:03 smithi007 ceph-mon[25091]: osdmap e4: 0 total, 0 up, 0 in 2024-06-18T01:57:03.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:03 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:04.510 INFO:teuthology.orchestra.run.smithi130.stdout:Scheduled mon update... 2024-06-18T01:57:05.070 DEBUG:teuthology.orchestra.run.smithi007:mon.c> sudo journalctl -f -n 0 -u ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mon.c.service 2024-06-18T01:57:05.072 DEBUG:teuthology.orchestra.run.smithi130:mon.b> sudo journalctl -f -n 0 -u ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mon.b.service 2024-06-18T01:57:05.075 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-06-18T01:57:05.075 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph mon dump -f json 2024-06-18T01:57:05.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:05 smithi007 ceph-mon[25091]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:05.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:05 smithi007 ceph-mon[25091]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi007:172.21.15.7=a;smithi007:[v2:172.21.15.7:3301,v1:172.21.15.7:6790]=c;smithi130:172.21.15.130=b", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T01:57:05.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:05 smithi007 ceph-mon[25091]: Saving service mon spec with placement smithi007:172.21.15.7=a;smithi007:[v2:172.21.15.7:3301,v1:172.21.15.7:6790]=c;smithi130:172.21.15.130=b;count:3 2024-06-18T01:57:05.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:05 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:05.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:05 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:57:05.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:05 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:57:05.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:05 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:57:05.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:05 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:05.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:05 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-18T01:57:05.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:05 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:57:05.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:05 smithi007 ceph-mon[25091]: Deploying daemon mon.c on smithi007 2024-06-18T01:57:07.001 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-06-18T01:57:07.002 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":1,"fsid":"cd9a3408-2d15-11ef-bc9d-c7b262605968","modified":"2024-06-18T01:55:37.939231Z","created":"2024-06-18T01:55:37.939231Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:3300","nonce":0},{"type":"v1","addr":"172.21.15.7:6789","nonce":0}]},"addr":"172.21.15.7:6789/0","public_addr":"172.21.15.7:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-06-18T01:57:07.002 INFO:teuthology.orchestra.run.smithi130.stderr:dumped monmap epoch 1 2024-06-18T01:57:07.538 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:07 smithi007 ceph-mon[25091]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:07.538 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:07 smithi007 ceph-mon[25091]: from='client.? 172.21.15.130:0/3874579445' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-18T01:57:08.580 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-06-18T01:57:08.581 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph mon dump -f json 2024-06-18T01:57:08.969 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:08 smithi007 ceph-mon[29879]: mon.c@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete,mon_cluster_log_to_file 2024-06-18T01:57:09.354 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:09 smithi007 bash[29788]: 1d1e2628656b1787737107fc80d20f513a8bebe984e2b9f8c498eb5dbc63e30b 2024-06-18T01:57:09.355 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:09 smithi007 systemd[1]: Started Ceph mon.c for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T01:57:14.432 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:57:13 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.7 - - [18/Jun/2024:01:57:13] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T01:57:14.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:14 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-18T01:57:14.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:14 smithi007 ceph-mon[25091]: mon.a calling monitor election 2024-06-18T01:57:14.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:14 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-18T01:57:14.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:14 smithi007 ceph-mon[25091]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:14.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:14 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-18T01:57:14.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:14 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-18T01:57:14.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:14 smithi007 ceph-mon[25091]: mon.c calling monitor election 2024-06-18T01:57:14.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:14 smithi007 ceph-mon[25091]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:14.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:14 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-18T01:57:14.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:14 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-18T01:57:14.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:14 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-18T01:57:14.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:14 smithi007 ceph-mon[25091]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-06-18T01:57:14.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:14 smithi007 ceph-mon[25091]: monmap e2: 2 mons at {a=[v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0],c=[v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0]} 2024-06-18T01:57:14.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:14 smithi007 ceph-mon[25091]: fsmap 2024-06-18T01:57:14.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:14 smithi007 ceph-mon[25091]: osdmap e4: 0 total, 0 up, 0 in 2024-06-18T01:57:14.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:14 smithi007 ceph-mon[25091]: mgrmap e13: y(active, since 36s) 2024-06-18T01:57:14.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:14 smithi007 ceph-mon[25091]: overall HEALTH_OK 2024-06-18T01:57:14.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:14 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:14.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:14 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:14.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:14 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-18T01:57:14.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:14 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:57:14.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:14 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:14.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:14 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-18T01:57:14.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:14 smithi007 ceph-mon[29879]: mon.a calling monitor election 2024-06-18T01:57:14.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:14 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-18T01:57:14.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:14 smithi007 ceph-mon[29879]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:14.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:14 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-18T01:57:14.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:14 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-18T01:57:14.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:14 smithi007 ceph-mon[29879]: mon.c calling monitor election 2024-06-18T01:57:14.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:14 smithi007 ceph-mon[29879]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:14.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:14 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-18T01:57:14.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:14 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-18T01:57:14.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:14 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-18T01:57:14.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:14 smithi007 ceph-mon[29879]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-06-18T01:57:14.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:14 smithi007 ceph-mon[29879]: monmap e2: 2 mons at {a=[v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0],c=[v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0]} 2024-06-18T01:57:14.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:14 smithi007 ceph-mon[29879]: fsmap 2024-06-18T01:57:14.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:14 smithi007 ceph-mon[29879]: osdmap e4: 0 total, 0 up, 0 in 2024-06-18T01:57:14.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:14 smithi007 ceph-mon[29879]: mgrmap e13: y(active, since 36s) 2024-06-18T01:57:14.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:14 smithi007 ceph-mon[29879]: overall HEALTH_OK 2024-06-18T01:57:14.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:14 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:14.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:14 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:14.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:14 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-18T01:57:14.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:14 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:57:14.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:14 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:14.874 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-06-18T01:57:14.875 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":2,"fsid":"cd9a3408-2d15-11ef-bc9d-c7b262605968","modified":"2024-06-18T01:57:08.972211Z","created":"2024-06-18T01:55:37.939231Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:3300","nonce":0},{"type":"v1","addr":"172.21.15.7:6789","nonce":0}]},"addr":"172.21.15.7:6789/0","public_addr":"172.21.15.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:3301","nonce":0},{"type":"v1","addr":"172.21.15.7:6790","nonce":0}]},"addr":"172.21.15.7:6790/0","public_addr":"172.21.15.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-06-18T01:57:14.877 INFO:teuthology.orchestra.run.smithi130.stderr:dumped monmap epoch 2 2024-06-18T01:57:15.431 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:15 smithi007 ceph-mon[29879]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:15.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:15 smithi007 ceph-mon[29879]: Deploying daemon mon.b on smithi130 2024-06-18T01:57:15.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:15 smithi007 ceph-mon[29879]: from='client.? 172.21.15.130:0/1388917089' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-18T01:57:15.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:15 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-18T01:57:15.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:15 smithi007 ceph-mon[25091]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:15.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:15 smithi007 ceph-mon[25091]: Deploying daemon mon.b on smithi130 2024-06-18T01:57:15.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:15 smithi007 ceph-mon[25091]: from='client.? 172.21.15.130:0/1388917089' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-18T01:57:15.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:15 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-18T01:57:16.395 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-06-18T01:57:16.395 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph mon dump -f json 2024-06-18T01:57:17.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:17 smithi007 ceph-mon[25091]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:17.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:17 smithi007 ceph-mon[29879]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:18.706 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-06-18T01:57:18.808 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":2,"fsid":"cd9a3408-2d15-11ef-bc9d-c7b262605968","modified":"2024-06-18T01:57:08.972211Z","created":"2024-06-18T01:55:37.939231Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:3300","nonce":0},{"type":"v1","addr":"172.21.15.7:6789","nonce":0}]},"addr":"172.21.15.7:6789/0","public_addr":"172.21.15.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:3301","nonce":0},{"type":"v1","addr":"172.21.15.7:6790","nonce":0}]},"addr":"172.21.15.7:6790/0","public_addr":"172.21.15.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-06-18T01:57:18.809 INFO:teuthology.orchestra.run.smithi130.stderr:dumped monmap epoch 2 2024-06-18T01:57:20.568 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-06-18T01:57:20.568 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph mon dump -f json 2024-06-18T01:57:24.174 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:57:23 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.130 - - [18/Jun/2024:01:57:23] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T01:57:24.175 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:57:24 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.130 - - [18/Jun/2024:01:57:24] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T01:57:24.175 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:23 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-18T01:57:24.175 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:23 smithi007 ceph-mon[25091]: mon.c calling monitor election 2024-06-18T01:57:24.175 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:23 smithi007 ceph-mon[25091]: mon.a calling monitor election 2024-06-18T01:57:24.175 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:23 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-18T01:57:24.175 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:23 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-18T01:57:24.175 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:23 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-18T01:57:24.175 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:23 smithi007 ceph-mon[25091]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:24.176 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:23 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-18T01:57:24.176 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:23 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-18T01:57:24.176 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:23 smithi007 ceph-mon[25091]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:24.176 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:23 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-18T01:57:24.176 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:23 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-18T01:57:24.176 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:23 smithi007 ceph-mon[25091]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-06-18T01:57:24.176 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:23 smithi007 ceph-mon[25091]: monmap e3: 3 mons at {a=[v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0],b=[v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0],c=[v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0]} 2024-06-18T01:57:24.176 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:23 smithi007 ceph-mon[25091]: fsmap 2024-06-18T01:57:24.176 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:23 smithi007 ceph-mon[25091]: osdmap e4: 0 total, 0 up, 0 in 2024-06-18T01:57:24.176 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:23 smithi007 ceph-mon[25091]: mgrmap e13: y(active, since 46s) 2024-06-18T01:57:24.176 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:23 smithi007 ceph-mon[25091]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-06-18T01:57:24.176 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:23 smithi007 ceph-mon[25091]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-06-18T01:57:24.176 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:23 smithi007 ceph-mon[25091]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-06-18T01:57:24.176 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:23 smithi007 ceph-mon[25091]: mon.b (rank 2) addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] is down (out of quorum) 2024-06-18T01:57:24.176 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:23 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:24.177 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:23 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:24.177 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:23 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:57:24.177 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:23 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:57:24.177 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:23 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:24.177 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:23 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:57:24.177 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:23 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-18T01:57:24.177 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:23 smithi007 ceph-mon[29879]: mon.c calling monitor election 2024-06-18T01:57:24.177 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:23 smithi007 ceph-mon[29879]: mon.a calling monitor election 2024-06-18T01:57:24.177 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:23 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-18T01:57:24.177 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:23 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-18T01:57:24.177 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:23 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-18T01:57:24.177 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:23 smithi007 ceph-mon[29879]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:24.178 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:23 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-18T01:57:24.178 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:23 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-18T01:57:24.178 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:23 smithi007 ceph-mon[29879]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:24.178 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:23 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-18T01:57:24.178 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:23 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-18T01:57:24.178 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:23 smithi007 ceph-mon[29879]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-06-18T01:57:24.178 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:23 smithi007 ceph-mon[29879]: monmap e3: 3 mons at {a=[v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0],b=[v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0],c=[v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0]} 2024-06-18T01:57:24.178 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:23 smithi007 ceph-mon[29879]: fsmap 2024-06-18T01:57:24.178 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:23 smithi007 ceph-mon[29879]: osdmap e4: 0 total, 0 up, 0 in 2024-06-18T01:57:24.178 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:23 smithi007 ceph-mon[29879]: mgrmap e13: y(active, since 46s) 2024-06-18T01:57:24.178 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:23 smithi007 ceph-mon[29879]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-06-18T01:57:24.178 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:23 smithi007 ceph-mon[29879]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-06-18T01:57:24.178 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:23 smithi007 ceph-mon[29879]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-06-18T01:57:24.178 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:23 smithi007 ceph-mon[29879]: mon.b (rank 2) addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] is down (out of quorum) 2024-06-18T01:57:24.179 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:23 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:24.179 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:23 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:24.179 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:23 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:57:24.179 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:23 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:57:24.179 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:23 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:24.179 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:23 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:57:24.683 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-06-18T01:57:24.683 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":3,"fsid":"cd9a3408-2d15-11ef-bc9d-c7b262605968","modified":"2024-06-18T01:57:18.881740Z","created":"2024-06-18T01:55:37.939231Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:3300","nonce":0},{"type":"v1","addr":"172.21.15.7:6789","nonce":0}]},"addr":"172.21.15.7:6789/0","public_addr":"172.21.15.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:3301","nonce":0},{"type":"v1","addr":"172.21.15.7:6790","nonce":0}]},"addr":"172.21.15.7:6790/0","public_addr":"172.21.15.7:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:3300","nonce":0},{"type":"v1","addr":"172.21.15.130:6789","nonce":0}]},"addr":"172.21.15.130:6789/0","public_addr":"172.21.15.130:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-06-18T01:57:24.684 INFO:teuthology.orchestra.run.smithi130.stderr:dumped monmap epoch 3 2024-06-18T01:57:25.083 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:25 smithi007 ceph-mon[25091]: Updating smithi007:/etc/ceph/ceph.conf 2024-06-18T01:57:25.083 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:25 smithi007 ceph-mon[25091]: Updating smithi130:/etc/ceph/ceph.conf 2024-06-18T01:57:25.083 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:25 smithi007 ceph-mon[25091]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:25.083 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:25 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:25.083 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:25 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:25.083 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:25 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:25.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:25 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:25.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:25 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:25.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:25 smithi007 ceph-mon[25091]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T01:57:25.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:25 smithi007 ceph-mon[25091]: Reconfiguring mon.a (unknown last config time)... 2024-06-18T01:57:25.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:25 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-18T01:57:25.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:25 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-18T01:57:25.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:25 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:57:25.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:25 smithi007 ceph-mon[25091]: Reconfiguring daemon mon.a on smithi007 2024-06-18T01:57:25.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:25 smithi007 ceph-mon[25091]: from='client.? 172.21.15.130:0/3206017419' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-18T01:57:25.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:25 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-18T01:57:25.084 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:25 smithi007 ceph-mon[29879]: Updating smithi007:/etc/ceph/ceph.conf 2024-06-18T01:57:25.084 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:25 smithi007 ceph-mon[29879]: Updating smithi130:/etc/ceph/ceph.conf 2024-06-18T01:57:25.084 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:25 smithi007 ceph-mon[29879]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:25.085 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:25 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:25.085 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:25 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:25.085 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:25 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:25.085 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:25 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:25.085 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:25 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:25.085 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:25 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T01:57:25.085 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:25 smithi007 ceph-mon[29879]: Reconfiguring mon.a (unknown last config time)... 2024-06-18T01:57:25.085 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:25 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-18T01:57:25.085 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:25 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-18T01:57:25.085 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:25 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:57:25.085 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:25 smithi007 ceph-mon[29879]: Reconfiguring daemon mon.a on smithi007 2024-06-18T01:57:25.085 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:25 smithi007 ceph-mon[29879]: from='client.? 172.21.15.130:0/3206017419' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-18T01:57:25.085 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:25 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-18T01:57:25.244 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-06-18T01:57:25.245 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph config generate-minimal-conf 2024-06-18T01:57:26.149 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:26 smithi130 ceph-mon[26123]: mon.b calling monitor election 2024-06-18T01:57:26.149 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:26 smithi130 ceph-mon[26123]: mon.c calling monitor election 2024-06-18T01:57:26.149 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:26 smithi130 ceph-mon[26123]: mon.a calling monitor election 2024-06-18T01:57:26.150 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:26 smithi130 ceph-mon[26123]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-06-18T01:57:26.150 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:26 smithi130 ceph-mon[26123]: monmap e3: 3 mons at {a=[v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0],b=[v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0],c=[v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0]} 2024-06-18T01:57:26.150 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:26 smithi130 ceph-mon[26123]: fsmap 2024-06-18T01:57:26.150 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:26 smithi130 ceph-mon[26123]: osdmap e4: 0 total, 0 up, 0 in 2024-06-18T01:57:26.150 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:26 smithi130 ceph-mon[26123]: mgrmap e13: y(active, since 48s) 2024-06-18T01:57:26.150 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:26 smithi130 ceph-mon[26123]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-06-18T01:57:26.150 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:26 smithi130 ceph-mon[26123]: Cluster is now healthy 2024-06-18T01:57:26.150 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:26 smithi130 ceph-mon[26123]: overall HEALTH_OK 2024-06-18T01:57:26.257 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:26 smithi007 ceph-mon[25091]: mon.b calling monitor election 2024-06-18T01:57:26.258 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:26 smithi007 ceph-mon[25091]: mon.b calling monitor election 2024-06-18T01:57:26.258 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:26 smithi007 ceph-mon[25091]: mon.c calling monitor election 2024-06-18T01:57:26.258 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:26 smithi007 ceph-mon[25091]: mon.a calling monitor election 2024-06-18T01:57:26.258 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:26 smithi007 ceph-mon[25091]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-06-18T01:57:26.258 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:26 smithi007 ceph-mon[25091]: monmap e3: 3 mons at {a=[v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0],b=[v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0],c=[v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0]} 2024-06-18T01:57:26.258 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:26 smithi007 ceph-mon[25091]: fsmap 2024-06-18T01:57:26.258 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:26 smithi007 ceph-mon[25091]: osdmap e4: 0 total, 0 up, 0 in 2024-06-18T01:57:26.258 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:26 smithi007 ceph-mon[25091]: mgrmap e13: y(active, since 48s) 2024-06-18T01:57:26.258 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:26 smithi007 ceph-mon[25091]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-06-18T01:57:26.258 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:26 smithi007 ceph-mon[25091]: Cluster is now healthy 2024-06-18T01:57:26.259 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:26 smithi007 ceph-mon[25091]: overall HEALTH_OK 2024-06-18T01:57:26.259 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:26 smithi007 ceph-mon[29879]: mon.b calling monitor election 2024-06-18T01:57:26.259 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:26 smithi007 ceph-mon[29879]: mon.b calling monitor election 2024-06-18T01:57:26.259 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:26 smithi007 ceph-mon[29879]: mon.c calling monitor election 2024-06-18T01:57:26.259 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:26 smithi007 ceph-mon[29879]: mon.a calling monitor election 2024-06-18T01:57:26.259 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:26 smithi007 ceph-mon[29879]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-06-18T01:57:26.259 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:26 smithi007 ceph-mon[29879]: monmap e3: 3 mons at {a=[v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0],b=[v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0],c=[v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0]} 2024-06-18T01:57:26.259 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:26 smithi007 ceph-mon[29879]: fsmap 2024-06-18T01:57:26.259 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:26 smithi007 ceph-mon[29879]: osdmap e4: 0 total, 0 up, 0 in 2024-06-18T01:57:26.259 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:26 smithi007 ceph-mon[29879]: mgrmap e13: y(active, since 48s) 2024-06-18T01:57:26.259 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:26 smithi007 ceph-mon[29879]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-06-18T01:57:26.260 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:26 smithi007 ceph-mon[29879]: Cluster is now healthy 2024-06-18T01:57:26.260 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:26 smithi007 ceph-mon[29879]: overall HEALTH_OK 2024-06-18T01:57:26.557 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:57:26 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.130 - - [18/Jun/2024:01:57:26] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T01:57:26.557 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:57:26 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.7 - - [18/Jun/2024:01:57:26] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T01:57:27.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:27 smithi007 ceph-mon[25091]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:27.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:27 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:27.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:27 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:27.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:27 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:27.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:27 smithi007 ceph-mon[25091]: Reconfiguring mon.c (monmap changed)... 2024-06-18T01:57:27.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:27 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-18T01:57:27.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:27 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-18T01:57:27.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:27 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:57:27.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:27 smithi007 ceph-mon[25091]: Reconfiguring daemon mon.c on smithi007 2024-06-18T01:57:27.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:27 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:27.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:27 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:27.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:27 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-18T01:57:27.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:27 smithi007 ceph-mon[29879]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:27.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:27 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:27.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:27 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:27.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:27 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:27.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:27 smithi007 ceph-mon[29879]: Reconfiguring mon.c (monmap changed)... 2024-06-18T01:57:27.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:27 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-18T01:57:27.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:27 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-18T01:57:27.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:27 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:57:27.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:27 smithi007 ceph-mon[29879]: Reconfiguring daemon mon.c on smithi007 2024-06-18T01:57:27.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:27 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:27.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:27 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:27.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:27 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-18T01:57:27.478 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:27 smithi130 ceph-mon[26123]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:27.478 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:27 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:27.478 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:27 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:27.478 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:27 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:27.478 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:27 smithi130 ceph-mon[26123]: Reconfiguring mon.c (monmap changed)... 2024-06-18T01:57:27.479 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:27 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-18T01:57:27.479 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:27 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-18T01:57:27.479 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:27 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:57:27.479 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:27 smithi130 ceph-mon[26123]: Reconfiguring daemon mon.c on smithi007 2024-06-18T01:57:27.479 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:27 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:27.479 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:27 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:27.479 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:27 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-18T01:57:28.140 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:57:27 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.130 - - [18/Jun/2024:01:57:27] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T01:57:28.681 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:57:28 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.7 - - [18/Jun/2024:01:57:28] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T01:57:29.013 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:28 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:29.013 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:28 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:29.013 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:28 smithi007 ceph-mon[29879]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:29.013 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:28 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:29.013 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:28 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:29.014 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:28 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:29.014 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:28 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:29.014 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:28 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:29.014 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:28 smithi007 ceph-mon[25091]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:29.014 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:28 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:29.014 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:28 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:29.014 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:28 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:29.212 INFO:teuthology.orchestra.run.smithi007.stdout:# minimal ceph.conf for cd9a3408-2d15-11ef-bc9d-c7b262605968 2024-06-18T01:57:29.212 INFO:teuthology.orchestra.run.smithi007.stdout:[global] 2024-06-18T01:57:29.212 INFO:teuthology.orchestra.run.smithi007.stdout: fsid = cd9a3408-2d15-11ef-bc9d-c7b262605968 2024-06-18T01:57:29.212 INFO:teuthology.orchestra.run.smithi007.stdout: mon_host = [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] 2024-06-18T01:57:29.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:28 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:29.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:28 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:29.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:28 smithi130 ceph-mon[26123]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:29.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:28 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:29.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:28 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:29.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:28 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:30.000 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-06-18T01:57:30.001 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-06-18T01:57:30.001 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/ceph/ceph.conf 2024-06-18T01:57:30.033 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-06-18T01:57:30.033 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-06-18T01:57:30.097 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:29 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/1279702197' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:57:30.098 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:29 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/1279702197' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:57:30.101 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-06-18T01:57:30.102 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/ceph/ceph.conf 2024-06-18T01:57:30.131 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:29 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/1279702197' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:57:30.136 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-06-18T01:57:30.136 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-06-18T01:57:30.205 INFO:tasks.cephadm:Adding mgr.y on smithi007 2024-06-18T01:57:30.205 INFO:tasks.cephadm:Adding mgr.x on smithi130 2024-06-18T01:57:30.205 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph orch apply mgr '2;smithi007=y;smithi130=x' 2024-06-18T01:57:31.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:31 smithi007 ceph-mon[25091]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:31.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:31 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:31.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:31 smithi007 ceph-mon[25091]: Reconfiguring mon.b (monmap changed)... 2024-06-18T01:57:31.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:31 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-18T01:57:31.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:31 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-18T01:57:31.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:31 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:57:31.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:31 smithi007 ceph-mon[25091]: Reconfiguring daemon mon.b on smithi130 2024-06-18T01:57:31.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:31 smithi007 ceph-mon[29879]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:31.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:31 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:31.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:31 smithi007 ceph-mon[29879]: Reconfiguring mon.b (monmap changed)... 2024-06-18T01:57:31.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:31 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-18T01:57:31.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:31 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-18T01:57:31.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:31 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:57:31.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:31 smithi007 ceph-mon[29879]: Reconfiguring daemon mon.b on smithi130 2024-06-18T01:57:31.683 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:31 smithi130 ceph-mon[26123]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:31.683 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:31 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:31.683 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:31 smithi130 ceph-mon[26123]: Reconfiguring mon.b (monmap changed)... 2024-06-18T01:57:31.683 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:31 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-18T01:57:31.684 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:31 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-18T01:57:31.684 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:31 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:57:31.684 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:31 smithi130 ceph-mon[26123]: Reconfiguring daemon mon.b on smithi130 2024-06-18T01:57:32.047 INFO:teuthology.orchestra.run.smithi130.stdout:Scheduled mgr update... 2024-06-18T01:57:32.775 DEBUG:teuthology.orchestra.run.smithi130:mgr.x> sudo journalctl -f -n 0 -u ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mgr.x.service 2024-06-18T01:57:32.777 INFO:tasks.cephadm:Deploying OSDs... 2024-06-18T01:57:32.778 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-06-18T01:57:32.778 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/scratch_devs of=/dev/stdout 2024-06-18T01:57:32.798 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-06-18T01:57:32.798 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_1 2024-06-18T01:57:32.857 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-06-18T01:57:32.857 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-18T01:57:32.858 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 5h/5d Inode: 672 Links: 1 2024-06-18T01:57:32.858 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-18T01:57:32.858 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2024-06-18T01:57:32.858 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-06-18 01:57:27.637463797 +0000 2024-06-18T01:57:32.858 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-06-18 01:54:32.272000838 +0000 2024-06-18T01:57:32.858 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-06-18 01:54:32.272000838 +0000 2024-06-18T01:57:32.858 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: 2024-06-18 01:54:32.272000838 +0000 2024-06-18T01:57:32.858 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-06-18T01:57:32.927 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2024-06-18T01:57:32.927 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2024-06-18T01:57:32.927 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.000128666 s, 4.0 MB/s 2024-06-18T01:57:32.928 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-06-18T01:57:32.988 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_2 2024-06-18T01:57:33.046 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-06-18T01:57:33.047 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-18T01:57:33.047 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 5h/5d Inode: 693 Links: 1 2024-06-18T01:57:33.047 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-18T01:57:33.047 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2024-06-18T01:57:33.047 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-06-18 01:57:27.637463797 +0000 2024-06-18T01:57:33.047 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-06-18 01:54:32.596995889 +0000 2024-06-18T01:57:33.047 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-06-18 01:54:32.596995889 +0000 2024-06-18T01:57:33.047 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: 2024-06-18 01:54:32.596995889 +0000 2024-06-18T01:57:33.047 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-06-18T01:57:33.113 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2024-06-18T01:57:33.113 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2024-06-18T01:57:33.114 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.0001168 s, 4.4 MB/s 2024-06-18T01:57:33.115 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-06-18T01:57:33.174 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_3 2024-06-18T01:57:33.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:33 smithi007 ceph-mon[25091]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:33.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:33 smithi007 ceph-mon[25091]: from='client.24110 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi007=y;smithi130=x", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T01:57:33.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:33 smithi007 ceph-mon[25091]: Saving service mgr spec with placement smithi007=y;smithi130=x;count:2 2024-06-18T01:57:33.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:33 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:33.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:33 smithi007 ceph-mon[29879]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:33.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:33 smithi007 ceph-mon[29879]: from='client.24110 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi007=y;smithi130=x", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T01:57:33.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:33 smithi007 ceph-mon[29879]: Saving service mgr spec with placement smithi007=y;smithi130=x;count:2 2024-06-18T01:57:33.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:33 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:33.199 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-06-18T01:57:33.199 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-18T01:57:33.199 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 5h/5d Inode: 711 Links: 1 2024-06-18T01:57:33.199 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-18T01:57:33.199 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2024-06-18T01:57:33.199 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-06-18 01:57:27.637463797 +0000 2024-06-18T01:57:33.199 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-06-18 01:54:32.926990864 +0000 2024-06-18T01:57:33.200 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-06-18 01:54:32.926990864 +0000 2024-06-18T01:57:33.200 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: 2024-06-18 01:54:32.926990864 +0000 2024-06-18T01:57:33.200 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-06-18T01:57:33.221 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:33 smithi130 ceph-mon[26123]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:33.221 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:33 smithi130 ceph-mon[26123]: from='client.24110 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi007=y;smithi130=x", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T01:57:33.221 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:33 smithi130 ceph-mon[26123]: Saving service mgr spec with placement smithi007=y;smithi130=x;count:2 2024-06-18T01:57:33.221 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:33 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:33.265 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2024-06-18T01:57:33.265 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2024-06-18T01:57:33.266 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.000119552 s, 4.3 MB/s 2024-06-18T01:57:33.267 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-06-18T01:57:33.325 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_4 2024-06-18T01:57:33.382 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-06-18T01:57:33.382 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-18T01:57:33.382 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 5h/5d Inode: 728 Links: 1 2024-06-18T01:57:33.382 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-18T01:57:33.383 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2024-06-18T01:57:33.383 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-06-18 01:57:27.637463797 +0000 2024-06-18T01:57:33.383 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-06-18 01:54:33.259985793 +0000 2024-06-18T01:57:33.383 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-06-18 01:54:33.259985793 +0000 2024-06-18T01:57:33.383 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: 2024-06-18 01:54:33.259985793 +0000 2024-06-18T01:57:33.383 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-06-18T01:57:33.448 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2024-06-18T01:57:33.448 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2024-06-18T01:57:33.448 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.000111159 s, 4.6 MB/s 2024-06-18T01:57:33.449 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-06-18T01:57:33.507 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-06-18T01:57:33.507 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/scratch_devs of=/dev/stdout 2024-06-18T01:57:33.523 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-06-18T01:57:33.524 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_1 2024-06-18T01:57:33.580 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-06-18T01:57:33.581 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-18T01:57:33.581 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-06-18T01:57:33.581 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-18T01:57:33.581 INFO:teuthology.orchestra.run.smithi130.stdout:Context: system_u:object_r:device_t:s0 2024-06-18T01:57:33.581 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2024-06-18 01:57:27.141906602 +0000 2024-06-18T01:57:33.581 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2024-06-18 01:54:28.365055361 +0000 2024-06-18T01:57:33.581 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2024-06-18 01:54:28.365055361 +0000 2024-06-18T01:57:33.581 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: 2024-06-18 01:54:28.365055361 +0000 2024-06-18T01:57:33.582 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-06-18T01:57:33.645 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2024-06-18T01:57:33.645 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2024-06-18T01:57:33.645 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000212143 s, 2.4 MB/s 2024-06-18T01:57:33.647 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-06-18T01:57:33.704 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_2 2024-06-18T01:57:33.759 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-06-18T01:57:33.759 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-18T01:57:33.760 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-06-18T01:57:33.760 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-18T01:57:33.760 INFO:teuthology.orchestra.run.smithi130.stdout:Context: system_u:object_r:device_t:s0 2024-06-18T01:57:33.760 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2024-06-18 01:57:27.141906602 +0000 2024-06-18T01:57:33.760 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2024-06-18 01:54:28.705049654 +0000 2024-06-18T01:57:33.760 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2024-06-18 01:54:28.705049654 +0000 2024-06-18T01:57:33.760 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: 2024-06-18 01:54:28.705049654 +0000 2024-06-18T01:57:33.760 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-06-18T01:57:33.823 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2024-06-18T01:57:33.824 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2024-06-18T01:57:33.824 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000204927 s, 2.5 MB/s 2024-06-18T01:57:33.825 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-06-18T01:57:33.881 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_3 2024-06-18T01:57:33.937 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-06-18T01:57:33.937 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-18T01:57:33.937 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-06-18T01:57:33.938 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-18T01:57:33.938 INFO:teuthology.orchestra.run.smithi130.stdout:Context: system_u:object_r:device_t:s0 2024-06-18T01:57:33.938 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2024-06-18 01:57:27.141906602 +0000 2024-06-18T01:57:33.938 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2024-06-18 01:54:29.041044014 +0000 2024-06-18T01:57:33.938 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2024-06-18 01:54:29.041044014 +0000 2024-06-18T01:57:33.938 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: 2024-06-18 01:54:29.041044014 +0000 2024-06-18T01:57:33.938 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-06-18T01:57:34.001 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2024-06-18T01:57:34.002 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2024-06-18T01:57:34.002 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000172606 s, 3.0 MB/s 2024-06-18T01:57:34.003 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-06-18T01:57:34.059 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_4 2024-06-18T01:57:34.115 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-06-18T01:57:34.115 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-18T01:57:34.115 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-06-18T01:57:34.115 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-18T01:57:34.115 INFO:teuthology.orchestra.run.smithi130.stdout:Context: system_u:object_r:device_t:s0 2024-06-18T01:57:34.115 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2024-06-18 01:57:27.141906602 +0000 2024-06-18T01:57:34.115 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2024-06-18 01:54:29.375038409 +0000 2024-06-18T01:57:34.115 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2024-06-18 01:54:29.375038409 +0000 2024-06-18T01:57:34.115 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: 2024-06-18 01:54:29.375038409 +0000 2024-06-18T01:57:34.116 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-06-18T01:57:34.178 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2024-06-18T01:57:34.178 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2024-06-18T01:57:34.178 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000186751 s, 2.7 MB/s 2024-06-18T01:57:34.179 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-06-18T01:57:34.235 INFO:tasks.cephadm:Deploying osd.0 on smithi007 with /dev/vg_nvme/lv_4... 2024-06-18T01:57:34.235 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-06-18T01:57:34.857 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:34 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:34.858 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:34 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:57:34.858 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:34 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:57:34.858 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:34 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:57:34.858 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:34 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:34.858 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:34 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-18T01:57:34.858 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:34 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-18T01:57:34.858 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:34 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-18T01:57:34.858 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:34 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:57:34.858 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:34 smithi007 ceph-mon[29879]: Deploying daemon mgr.x on smithi130 2024-06-18T01:57:34.858 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:34 smithi007 ceph-mon[29879]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:34.859 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:34 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:34.859 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:34 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:57:34.859 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:34 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:57:34.859 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:34 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:57:34.859 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:34 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:34.859 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:34 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-18T01:57:34.859 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:34 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-18T01:57:34.859 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:34 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-18T01:57:34.859 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:34 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:57:34.859 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:34 smithi007 ceph-mon[25091]: Deploying daemon mgr.x on smithi130 2024-06-18T01:57:34.859 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:34 smithi007 ceph-mon[25091]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:34.972 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:34 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:34.972 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:34 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:57:34.972 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:34 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:57:34.972 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:34 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:57:34.972 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:34 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:34.972 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:34 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-18T01:57:34.972 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:34 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-18T01:57:34.972 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:34 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-18T01:57:34.972 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:34 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:57:34.972 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:34 smithi130 ceph-mon[26123]: Deploying daemon mgr.x on smithi130 2024-06-18T01:57:34.973 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:34 smithi130 ceph-mon[26123]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:35.544 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 01:57:35 smithi130 podman[27649]: 2024-06-18 01:57:35.472776304 +0000 UTC m=+0.130003532 container create 02d55b2b38c8863174cdafffac90f3d4cc878e54a950a52f63c36629c195b031 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x, maintainer=Guillaume Abrioux , release=754, com.redhat.component=centos-stream-container, CEPH_POINT_RELEASE=-17.2.0, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, distribution-scope=public, io.buildah.version=1.19.8, version=8, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, vcs-type=git, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.openshift.tags=base centos centos-stream, io.k8s.display-name=CentOS Stream 8, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, ceph=True, build-date=2022-05-03T08:36:31.336870, GIT_BRANCH=HEAD, architecture=x86_64, io.openshift.expose-services=, GIT_REPO=https://github.com/ceph/ceph-container.git, vendor=Red Hat, Inc., name=centos-stream, RELEASE=HEAD, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., GIT_CLEAN=True) 2024-06-18T01:57:35.846 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 01:57:35 smithi130 podman[27649]: 2024-06-18 01:57:35.701664361 +0000 UTC m=+0.358891595 container init 02d55b2b38c8863174cdafffac90f3d4cc878e54a950a52f63c36629c195b031 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x, distribution-scope=public, name=centos-stream, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.openshift.tags=base centos centos-stream, ceph=True, release=754, com.redhat.component=centos-stream-container, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.openshift.expose-services=, io.k8s.display-name=CentOS Stream 8, RELEASE=HEAD, GIT_BRANCH=HEAD, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, vendor=Red Hat, Inc., GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, vcs-type=git, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, architecture=x86_64, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, CEPH_POINT_RELEASE=-17.2.0, build-date=2022-05-03T08:36:31.336870, io.buildah.version=1.19.8, version=8, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream) 2024-06-18T01:57:35.847 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 01:57:35 smithi130 podman[27649]: 2024-06-18 01:57:35.7044499 +0000 UTC m=+0.361677133 container start 02d55b2b38c8863174cdafffac90f3d4cc878e54a950a52f63c36629c195b031 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x, io.openshift.tags=base centos centos-stream, distribution-scope=public, vcs-type=git, GIT_BRANCH=HEAD, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, architecture=x86_64, RELEASE=HEAD, io.openshift.expose-services=, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.k8s.display-name=CentOS Stream 8, name=centos-stream, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.buildah.version=1.19.8, CEPH_POINT_RELEASE=-17.2.0, vendor=Red Hat, Inc., ceph=True, version=8, GIT_CLEAN=True, build-date=2022-05-03T08:36:31.336870, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, com.redhat.component=centos-stream-container, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., release=754, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image) 2024-06-18T01:57:35.847 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 01:57:35 smithi130 ceph-mgr[27668]: -- 172.21.15.130:0/2936923954 <== mon.2 v2:172.21.15.130:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c2da982340 con 0x55c2da95b000 2024-06-18T01:57:35.847 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 01:57:35 smithi130 bash[27649]: 02d55b2b38c8863174cdafffac90f3d4cc878e54a950a52f63c36629c195b031 2024-06-18T01:57:35.847 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 01:57:35 smithi130 systemd[1]: Started Ceph mgr.x for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T01:57:36.285 INFO:teuthology.orchestra.run.smithi007.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-06-18T01:57:36.285 INFO:teuthology.orchestra.run.smithi007.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-06-18T01:57:36.285 INFO:teuthology.orchestra.run.smithi007.stderr: stderr: 10+0 records in 2024-06-18T01:57:36.285 INFO:teuthology.orchestra.run.smithi007.stderr:10+0 records out 2024-06-18T01:57:36.285 INFO:teuthology.orchestra.run.smithi007.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00891404 s, 1.2 GB/s 2024-06-18T01:57:36.286 INFO:teuthology.orchestra.run.smithi007.stderr:--> Zapping successful for: 2024-06-18T01:57:36.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 01:57:35 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: 2024-06-18T01:57:35.846+0000 7feba5351000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-18T01:57:36.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 01:57:35 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: 2024-06-18T01:57:35.977+0000 7feba5351000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-18T01:57:36.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 01:57:36 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: 2024-06-18T01:57:36.075+0000 7feba5351000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-18T01:57:36.644 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 01:57:36 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: 2024-06-18T01:57:36.393+0000 7feba5351000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-18T01:57:36.645 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 01:57:36 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: 2024-06-18T01:57:36.477+0000 7feba5351000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-18T01:57:36.898 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:36 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:36.898 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:36 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:57:36.898 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:36 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:57:36.898 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:36 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:57:36.898 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:36 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:36.899 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:36 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T01:57:36.899 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:36 smithi130 ceph-mon[26123]: Reconfiguring mgr.y (unknown last config time)... 2024-06-18T01:57:36.899 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:36 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-18T01:57:36.899 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:36 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-18T01:57:36.899 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:36 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:57:36.899 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:36 smithi130 ceph-mon[26123]: Reconfiguring daemon mgr.y on smithi007 2024-06-18T01:57:36.899 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:36 smithi130 ceph-mon[26123]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:37.039 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:36 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:37.039 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:36 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:57:37.039 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:36 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:57:37.039 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:36 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:57:37.039 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:36 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:37.039 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:36 smithi007 ceph-mon[25091]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T01:57:37.039 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:36 smithi007 ceph-mon[25091]: Reconfiguring mgr.y (unknown last config time)... 2024-06-18T01:57:37.039 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:36 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-18T01:57:37.039 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:36 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-18T01:57:37.039 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:36 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:57:37.039 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:36 smithi007 ceph-mon[25091]: Reconfiguring daemon mgr.y on smithi007 2024-06-18T01:57:37.039 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:36 smithi007 ceph-mon[25091]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:37.040 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:36 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:37.040 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:36 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:57:37.040 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:36 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:57:37.040 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:36 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:57:37.040 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:36 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:37.040 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:36 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T01:57:37.040 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:36 smithi007 ceph-mon[29879]: Reconfiguring mgr.y (unknown last config time)... 2024-06-18T01:57:37.040 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:36 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-18T01:57:37.040 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:36 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-18T01:57:37.040 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:36 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:57:37.040 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:36 smithi007 ceph-mon[29879]: Reconfiguring daemon mgr.y on smithi007 2024-06-18T01:57:37.041 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:36 smithi007 ceph-mon[29879]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:37.685 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph orch daemon add osd smithi007:vg_nvme/lv_4 2024-06-18T01:57:37.793 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 01:57:37 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: 2024-06-18T01:57:37.649+0000 7feba5351000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-18T01:57:38.258 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 01:57:37 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: 2024-06-18T01:57:37.823+0000 7feba5351000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-18T01:57:38.258 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 01:57:37 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: 2024-06-18T01:57:37.940+0000 7feba5351000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-18T01:57:38.544 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 01:57:38 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: 2024-06-18T01:57:38.277+0000 7feba5351000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-18T01:57:38.544 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 01:57:38 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: 2024-06-18T01:57:38.374+0000 7feba5351000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-18T01:57:38.544 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 01:57:38 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: 2024-06-18T01:57:38.471+0000 7feba5351000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-18T01:57:38.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:38 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:38.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:38 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:57:38.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:38 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:57:38.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:38 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:57:38.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:38 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:38.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:38 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T01:57:38.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:38 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-06-18T01:57:38.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:38 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-06-18T01:57:38.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:38 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:38.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:38 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:38.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:38 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:57:38.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:38 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:57:38.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:38 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:57:38.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:38 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:38.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:38 smithi007 ceph-mon[25091]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T01:57:38.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:38 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-06-18T01:57:38.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:38 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-06-18T01:57:38.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:38 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:38.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:38 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:38.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:38 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:57:38.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:38 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:57:38.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:38 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:57:38.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:38 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:38.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:38 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T01:57:38.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:38 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-06-18T01:57:38.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:38 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-06-18T01:57:38.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:38 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:39.033 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 01:57:38 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: 2024-06-18T01:57:38.715+0000 7feba5351000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-18T01:57:39.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 01:57:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: 2024-06-18T01:57:39.164+0000 7feba5351000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-18T01:57:39.324 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:57:39 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.130 - - [18/Jun/2024:01:57:39] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T01:57:39.582 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:57:39 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.130 - - [18/Jun/2024:01:57:39] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T01:57:39.582 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:39 smithi007 ceph-mon[25091]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:39.583 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:39 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:39.583 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:39 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:39.583 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:39 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:57:39.583 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:39 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:57:39.583 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:39 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:57:39.583 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:39 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:39.583 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:39 smithi007 ceph-mon[29879]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:39.583 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:39 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:39.583 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:39 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:39.583 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:39 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:57:39.583 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:39 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:57:39.584 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:39 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:57:39.584 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:39 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:39.650 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:39 smithi130 ceph-mon[26123]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:39.650 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:39 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:39.650 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:39 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:39.650 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:39 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:57:39.650 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:39 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:57:39.650 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:39 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:57:39.651 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:39 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:40.024 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 01:57:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: 2024-06-18T01:57:39.650+0000 7feba5351000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-18T01:57:40.024 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 01:57:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: 2024-06-18T01:57:39.741+0000 7feba5351000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-18T01:57:40.025 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 01:57:40 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: 2024-06-18T01:57:40.024+0000 7feba5351000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-18T01:57:40.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 01:57:40 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: 2024-06-18T01:57:40.111+0000 7feba5351000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-18T01:57:40.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:40 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:40.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:40 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:40.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:40 smithi007 ceph-mon[25091]: from='client.24118 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T01:57:40.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:40 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-18T01:57:40.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:40 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-18T01:57:40.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:40 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:57:40.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:40 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:40.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:40 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:40.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:40 smithi007 ceph-mon[29879]: from='client.24118 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T01:57:40.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:40 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-18T01:57:40.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:40 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-18T01:57:40.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:40 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:57:40.728 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 01:57:40 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: 2024-06-18T01:57:40.512+0000 7feba5351000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-18T01:57:40.728 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 01:57:40 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: 2024-06-18T01:57:40.640+0000 7feba5351000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-18T01:57:40.728 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 01:57:40 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: 2024-06-18T01:57:40.728+0000 7feba5351000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-18T01:57:40.729 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:40 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:40.729 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:40 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:40.729 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:40 smithi130 ceph-mon[26123]: from='client.24118 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T01:57:40.729 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:40 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-18T01:57:40.729 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:40 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-18T01:57:40.729 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:40 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:57:41.043 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 01:57:40 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: 2024-06-18T01:57:40.838+0000 7feba5351000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-18T01:57:41.043 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 01:57:40 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: 2024-06-18T01:57:40.923+0000 7feba5351000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-18T01:57:41.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:41 smithi130 ceph-mon[26123]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:41.793 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 01:57:41 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: 2024-06-18T01:57:41.454+0000 7feba5351000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-18T01:57:41.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:41 smithi007 ceph-mon[25091]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:41.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:41 smithi007 ceph-mon[29879]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:42.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 01:57:41 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: 2024-06-18T01:57:41.812+0000 7feba5351000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-18T01:57:42.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:42 smithi130 ceph-mon[26123]: Standby manager daemon x started 2024-06-18T01:57:42.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:42 smithi130 ceph-mon[26123]: from='mgr.? 172.21.15.130:0/2652665630' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-06-18T01:57:42.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:42 smithi130 ceph-mon[26123]: from='mgr.? 172.21.15.130:0/2652665630' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-18T01:57:42.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:42 smithi130 ceph-mon[26123]: from='mgr.? 172.21.15.130:0/2652665630' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-06-18T01:57:42.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:42 smithi130 ceph-mon[26123]: from='mgr.? 172.21.15.130:0/2652665630' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-18T01:57:42.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:42 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/2699511909' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "85424ce1-096f-4fa9-b0e5-d1fe7b493345"}]: dispatch 2024-06-18T01:57:42.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:42 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/2699511909' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "85424ce1-096f-4fa9-b0e5-d1fe7b493345"}]': finished 2024-06-18T01:57:42.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:42 smithi130 ceph-mon[26123]: osdmap e5: 1 total, 0 up, 1 in 2024-06-18T01:57:42.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:42 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-18T01:57:42.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:42 smithi007 ceph-mon[25091]: Standby manager daemon x started 2024-06-18T01:57:42.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:42 smithi007 ceph-mon[25091]: from='mgr.? 172.21.15.130:0/2652665630' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-06-18T01:57:42.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:42 smithi007 ceph-mon[25091]: from='mgr.? 172.21.15.130:0/2652665630' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-18T01:57:42.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:42 smithi007 ceph-mon[25091]: from='mgr.? 172.21.15.130:0/2652665630' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-06-18T01:57:42.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:42 smithi007 ceph-mon[25091]: from='mgr.? 172.21.15.130:0/2652665630' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-18T01:57:42.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:42 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/2699511909' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "85424ce1-096f-4fa9-b0e5-d1fe7b493345"}]: dispatch 2024-06-18T01:57:42.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:42 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/2699511909' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "85424ce1-096f-4fa9-b0e5-d1fe7b493345"}]': finished 2024-06-18T01:57:42.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:42 smithi007 ceph-mon[25091]: osdmap e5: 1 total, 0 up, 1 in 2024-06-18T01:57:42.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:42 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-18T01:57:42.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:42 smithi007 ceph-mon[29879]: Standby manager daemon x started 2024-06-18T01:57:42.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:42 smithi007 ceph-mon[29879]: from='mgr.? 172.21.15.130:0/2652665630' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-06-18T01:57:42.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:42 smithi007 ceph-mon[29879]: from='mgr.? 172.21.15.130:0/2652665630' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-18T01:57:42.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:42 smithi007 ceph-mon[29879]: from='mgr.? 172.21.15.130:0/2652665630' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-06-18T01:57:42.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:42 smithi007 ceph-mon[29879]: from='mgr.? 172.21.15.130:0/2652665630' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-18T01:57:42.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:42 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/2699511909' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "85424ce1-096f-4fa9-b0e5-d1fe7b493345"}]: dispatch 2024-06-18T01:57:42.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:42 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/2699511909' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "85424ce1-096f-4fa9-b0e5-d1fe7b493345"}]': finished 2024-06-18T01:57:42.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:42 smithi007 ceph-mon[29879]: osdmap e5: 1 total, 0 up, 1 in 2024-06-18T01:57:42.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:42 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-18T01:57:43.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:43 smithi130 ceph-mon[26123]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:43.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:43 smithi130 ceph-mon[26123]: mgrmap e14: y(active, since 64s), standbys: x 2024-06-18T01:57:43.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:43 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-06-18T01:57:43.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:43 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/3020091605' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-18T01:57:43.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:43 smithi007 ceph-mon[25091]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:43.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:43 smithi007 ceph-mon[25091]: mgrmap e14: y(active, since 64s), standbys: x 2024-06-18T01:57:43.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:43 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-06-18T01:57:43.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:43 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/3020091605' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-18T01:57:43.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:43 smithi007 ceph-mon[29879]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:43.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:43 smithi007 ceph-mon[29879]: mgrmap e14: y(active, since 64s), standbys: x 2024-06-18T01:57:43.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:43 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-06-18T01:57:43.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:43 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/3020091605' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-18T01:57:45.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:45 smithi007 ceph-mon[25091]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:45.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:45 smithi007 ceph-mon[29879]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:45.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:45 smithi130 ceph-mon[26123]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:47.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:47 smithi130 ceph-mon[26123]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:47.823 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:47 smithi007 ceph-mon[25091]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:47.823 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:47 smithi007 ceph-mon[29879]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:47.824 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:57:47 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.7 - - [18/Jun/2024:01:57:47] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T01:57:48.593 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:48 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:48.593 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:48 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:48.593 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:48 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:48.593 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:48 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:48.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:48 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:48.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:48 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:49.766 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:49 smithi007 ceph-mon[25091]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:49.767 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:49 smithi007 ceph-mon[29879]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:49.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:49 smithi130 ceph-mon[26123]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:50.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:50 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-06-18T01:57:50.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:50 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:57:50.804 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:50 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-06-18T01:57:50.804 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:50 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:57:50.804 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:50 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-06-18T01:57:50.804 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:50 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:57:51.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:51 smithi007 ceph-mon[25091]: Deploying daemon osd.0 on smithi007 2024-06-18T01:57:51.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:51 smithi007 ceph-mon[25091]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:51.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:51 smithi007 ceph-mon[29879]: Deploying daemon osd.0 on smithi007 2024-06-18T01:57:51.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:51 smithi007 ceph-mon[29879]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:51.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:51 smithi130 ceph-mon[26123]: Deploying daemon osd.0 on smithi007 2024-06-18T01:57:51.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:51 smithi130 ceph-mon[26123]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:53.708 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:53 smithi007 ceph-mon[25091]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:53.708 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:53 smithi007 ceph-mon[29879]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:53.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:53 smithi130 ceph-mon[26123]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:55.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:55 smithi007 ceph-mon[25091]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:55.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:55 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:55.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:55 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:57:55.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:55 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:57:55.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:55 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:57:55.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:55 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:55.784 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:55 smithi007 ceph-mon[29879]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:55.784 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:55 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:55.784 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:55 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:57:55.784 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:55 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:57:55.784 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:55 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:57:55.784 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:55 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:55.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:55 smithi130 ceph-mon[26123]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:55.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:55 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:55.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:55 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:57:55.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:55 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:57:55.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:55 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:57:55.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:55 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:57.431 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:57:57 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.130 - - [18/Jun/2024:01:57:57] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T01:57:57.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:57 smithi130 ceph-mon[26123]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:57.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:57 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:57.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:57 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:57.901 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:57 smithi007 ceph-mon[25091]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:57.902 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:57 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:57.902 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:57 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:57.902 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:57 smithi007 ceph-mon[29879]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:57.902 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:57 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:57.902 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:57 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:57.933 INFO:teuthology.orchestra.run.smithi007.stdout:Created osd(s) 0 on host 'smithi007' 2024-06-18T01:57:58.653 DEBUG:teuthology.orchestra.run.smithi007:osd.0> sudo journalctl -f -n 0 -u ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.0.service 2024-06-18T01:57:58.655 INFO:tasks.cephadm:Deploying osd.1 on smithi007 with /dev/vg_nvme/lv_3... 2024-06-18T01:57:58.655 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-06-18T01:57:58.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:58 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:57:58.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:58 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:58.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:58 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:57:58.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:58 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:57:58.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:58 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-18T01:57:58.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:58 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:58.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:58 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:58.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:58 smithi130 ceph-mon[26123]: from='osd.0 [v2:172.21.15.7:6802/442622498,v1:172.21.15.7:6803/442622498]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-18T01:57:58.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:58 smithi130 ceph-mon[26123]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-18T01:57:58.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:58 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:57:58.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:58 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:58.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:58 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:57:58.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:58 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:57:58.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:58 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-18T01:57:58.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:58 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:58.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:58 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:58.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:58 smithi007 ceph-mon[25091]: from='osd.0 [v2:172.21.15.7:6802/442622498,v1:172.21.15.7:6803/442622498]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-18T01:57:58.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:58 smithi007 ceph-mon[25091]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-18T01:57:58.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:58 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:57:58.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:58 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:58.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:58 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:57:58.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:58 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:57:58.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:58 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-18T01:57:58.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:58 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:58.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:58 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:57:58.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:58 smithi007 ceph-mon[29879]: from='osd.0 [v2:172.21.15.7:6802/442622498,v1:172.21.15.7:6803/442622498]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-18T01:57:58.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:58 smithi007 ceph-mon[29879]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-18T01:57:59.733 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:59 smithi130 ceph-mon[26123]: Adjusting osd_memory_target on smithi007 to 15044M 2024-06-18T01:57:59.733 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:59 smithi130 ceph-mon[26123]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:59.733 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:59 smithi130 ceph-mon[26123]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-06-18T01:57:59.733 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:59 smithi130 ceph-mon[26123]: osdmap e6: 1 total, 0 up, 1 in 2024-06-18T01:57:59.733 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:59 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-18T01:57:59.734 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:59 smithi130 ceph-mon[26123]: from='osd.0 [v2:172.21.15.7:6802/442622498,v1:172.21.15.7:6803/442622498]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-06-18T01:57:59.734 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:57:59 smithi130 ceph-mon[26123]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-06-18T01:57:59.861 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:59 smithi007 ceph-mon[25091]: Adjusting osd_memory_target on smithi007 to 15044M 2024-06-18T01:57:59.861 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:59 smithi007 ceph-mon[25091]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:59.861 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:59 smithi007 ceph-mon[25091]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-06-18T01:57:59.861 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:59 smithi007 ceph-mon[25091]: osdmap e6: 1 total, 0 up, 1 in 2024-06-18T01:57:59.861 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:59 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-18T01:57:59.861 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:59 smithi007 ceph-mon[25091]: from='osd.0 [v2:172.21.15.7:6802/442622498,v1:172.21.15.7:6803/442622498]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-06-18T01:57:59.861 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:57:59 smithi007 ceph-mon[25091]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-06-18T01:57:59.861 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:59 smithi007 ceph-mon[29879]: Adjusting osd_memory_target on smithi007 to 15044M 2024-06-18T01:57:59.861 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:59 smithi007 ceph-mon[29879]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:57:59.861 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:59 smithi007 ceph-mon[29879]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-06-18T01:57:59.862 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:59 smithi007 ceph-mon[29879]: osdmap e6: 1 total, 0 up, 1 in 2024-06-18T01:57:59.862 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:59 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-18T01:57:59.862 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:59 smithi007 ceph-mon[29879]: from='osd.0 [v2:172.21.15.7:6802/442622498,v1:172.21.15.7:6803/442622498]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-06-18T01:57:59.862 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:57:59 smithi007 ceph-mon[29879]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-06-18T01:58:00.181 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 01:57:59 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0[33109]: 2024-06-18T01:57:59.953+0000 7f0d6458a700 -1 osd.0 0 waiting for initial osdmap 2024-06-18T01:58:00.181 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 01:57:59 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0[33109]: 2024-06-18T01:57:59.956+0000 7f0d5e720700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-18T01:58:00.690 INFO:teuthology.orchestra.run.smithi007.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-06-18T01:58:00.690 INFO:teuthology.orchestra.run.smithi007.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-06-18T01:58:00.690 INFO:teuthology.orchestra.run.smithi007.stderr: stderr: 10+0 records in 2024-06-18T01:58:00.690 INFO:teuthology.orchestra.run.smithi007.stderr:10+0 records out 2024-06-18T01:58:00.691 INFO:teuthology.orchestra.run.smithi007.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00942171 s, 1.1 GB/s 2024-06-18T01:58:00.691 INFO:teuthology.orchestra.run.smithi007.stderr:--> Zapping successful for: 2024-06-18T01:58:01.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:00 smithi130 ceph-mon[26123]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:58:01.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:00 smithi130 ceph-mon[26123]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-06-18T01:58:01.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:00 smithi130 ceph-mon[26123]: osdmap e7: 1 total, 0 up, 1 in 2024-06-18T01:58:01.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:00 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-18T01:58:01.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:00 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-18T01:58:01.392 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:00 smithi007 ceph-mon[25091]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:58:01.392 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:00 smithi007 ceph-mon[25091]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-06-18T01:58:01.392 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:00 smithi007 ceph-mon[25091]: osdmap e7: 1 total, 0 up, 1 in 2024-06-18T01:58:01.392 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:00 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-18T01:58:01.393 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:00 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-18T01:58:01.393 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:00 smithi007 ceph-mon[29879]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-18T01:58:01.393 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:00 smithi007 ceph-mon[29879]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-06-18T01:58:01.393 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:00 smithi007 ceph-mon[29879]: osdmap e7: 1 total, 0 up, 1 in 2024-06-18T01:58:01.393 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:00 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-18T01:58:01.393 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:00 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-18T01:58:01.422 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph orch daemon add osd smithi007:vg_nvme/lv_3 2024-06-18T01:58:02.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:01 smithi007 ceph-mon[25091]: purged_snaps scrub starts 2024-06-18T01:58:02.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:01 smithi007 ceph-mon[25091]: purged_snaps scrub ok 2024-06-18T01:58:02.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:01 smithi007 ceph-mon[25091]: osd.0 [v2:172.21.15.7:6802/442622498,v1:172.21.15.7:6803/442622498] boot 2024-06-18T01:58:02.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:01 smithi007 ceph-mon[25091]: osdmap e8: 1 total, 1 up, 1 in 2024-06-18T01:58:02.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:01 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-18T01:58:02.088 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:01 smithi007 ceph-mon[29879]: purged_snaps scrub starts 2024-06-18T01:58:02.088 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:01 smithi007 ceph-mon[29879]: purged_snaps scrub ok 2024-06-18T01:58:02.088 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:01 smithi007 ceph-mon[29879]: osd.0 [v2:172.21.15.7:6802/442622498,v1:172.21.15.7:6803/442622498] boot 2024-06-18T01:58:02.088 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:01 smithi007 ceph-mon[29879]: osdmap e8: 1 total, 1 up, 1 in 2024-06-18T01:58:02.088 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:01 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-18T01:58:02.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:01 smithi130 ceph-mon[26123]: purged_snaps scrub starts 2024-06-18T01:58:02.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:01 smithi130 ceph-mon[26123]: purged_snaps scrub ok 2024-06-18T01:58:02.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:01 smithi130 ceph-mon[26123]: osd.0 [v2:172.21.15.7:6802/442622498,v1:172.21.15.7:6803/442622498] boot 2024-06-18T01:58:02.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:01 smithi130 ceph-mon[26123]: osdmap e8: 1 total, 1 up, 1 in 2024-06-18T01:58:02.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:01 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-18T01:58:03.016 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:02 smithi007 ceph-mon[25091]: pgmap v40: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-06-18T01:58:03.016 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:02 smithi007 ceph-mon[25091]: osdmap e9: 1 total, 1 up, 1 in 2024-06-18T01:58:03.016 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:02 smithi007 ceph-mon[29879]: pgmap v40: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-06-18T01:58:03.016 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:02 smithi007 ceph-mon[29879]: osdmap e9: 1 total, 1 up, 1 in 2024-06-18T01:58:03.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:02 smithi130 ceph-mon[26123]: pgmap v40: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-06-18T01:58:03.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:02 smithi130 ceph-mon[26123]: osdmap e9: 1 total, 1 up, 1 in 2024-06-18T01:58:04.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:03 smithi007 ceph-mon[29879]: from='client.14244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T01:58:04.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:03 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-18T01:58:04.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:03 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-18T01:58:04.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:03 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:58:04.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:03 smithi007 ceph-mon[25091]: from='client.14244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T01:58:04.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:03 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-18T01:58:04.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:03 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-18T01:58:04.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:03 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:58:04.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:03 smithi130 ceph-mon[26123]: from='client.14244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T01:58:04.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:03 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-18T01:58:04.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:03 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-18T01:58:04.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:03 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:58:05.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:04 smithi130 ceph-mon[26123]: pgmap v42: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-06-18T01:58:05.411 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:04 smithi007 ceph-mon[25091]: pgmap v42: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-06-18T01:58:05.411 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:04 smithi007 ceph-mon[29879]: pgmap v42: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-06-18T01:58:07.158 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:58:06 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.7 - - [18/Jun/2024:01:58:06] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T01:58:07.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:07 smithi007 ceph-mon[25091]: pgmap v43: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-06-18T01:58:07.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:07 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:07.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:07 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:07.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:07 smithi007 ceph-mon[29879]: pgmap v43: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-06-18T01:58:07.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:07 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:07.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:07 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:07.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:07 smithi130 ceph-mon[26123]: pgmap v43: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-06-18T01:58:07.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:07 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:07.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:07 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:08.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:08 smithi007 ceph-mon[29879]: Detected new or changed devices on smithi007 2024-06-18T01:58:08.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:08 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/3226705534' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bf8ce607-af6a-4a49-b6f9-72b8ff585a90"}]: dispatch 2024-06-18T01:58:08.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:08 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/3226705534' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bf8ce607-af6a-4a49-b6f9-72b8ff585a90"}]': finished 2024-06-18T01:58:08.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:08 smithi007 ceph-mon[29879]: osdmap e10: 2 total, 1 up, 2 in 2024-06-18T01:58:08.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:08 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-18T01:58:08.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:08 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/2672506140' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-18T01:58:08.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:08 smithi007 ceph-mon[25091]: Detected new or changed devices on smithi007 2024-06-18T01:58:08.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:08 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/3226705534' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bf8ce607-af6a-4a49-b6f9-72b8ff585a90"}]: dispatch 2024-06-18T01:58:08.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:08 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/3226705534' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bf8ce607-af6a-4a49-b6f9-72b8ff585a90"}]': finished 2024-06-18T01:58:08.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:08 smithi007 ceph-mon[25091]: osdmap e10: 2 total, 1 up, 2 in 2024-06-18T01:58:08.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:08 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-18T01:58:08.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:08 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/2672506140' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-18T01:58:08.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:08 smithi130 ceph-mon[26123]: Detected new or changed devices on smithi007 2024-06-18T01:58:08.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:08 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/3226705534' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bf8ce607-af6a-4a49-b6f9-72b8ff585a90"}]: dispatch 2024-06-18T01:58:08.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:08 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/3226705534' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bf8ce607-af6a-4a49-b6f9-72b8ff585a90"}]': finished 2024-06-18T01:58:08.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:08 smithi130 ceph-mon[26123]: osdmap e10: 2 total, 1 up, 2 in 2024-06-18T01:58:08.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:08 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-18T01:58:08.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:08 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/2672506140' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-18T01:58:09.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:09 smithi130 ceph-mon[26123]: pgmap v45: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-06-18T01:58:09.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:09 smithi007 ceph-mon[25091]: pgmap v45: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-06-18T01:58:09.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:09 smithi007 ceph-mon[29879]: pgmap v45: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-06-18T01:58:11.740 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:11 smithi007 ceph-mon[25091]: pgmap v46: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-06-18T01:58:11.740 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:11 smithi007 ceph-mon[29879]: pgmap v46: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-06-18T01:58:11.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:11 smithi130 ceph-mon[26123]: pgmap v46: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-06-18T01:58:13.725 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:13 smithi007 ceph-mon[25091]: pgmap v47: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-06-18T01:58:13.726 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:13 smithi007 ceph-mon[29879]: pgmap v47: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-06-18T01:58:13.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:13 smithi130 ceph-mon[26123]: pgmap v47: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-06-18T01:58:14.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:14 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-06-18T01:58:14.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:14 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:58:14.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:14 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-06-18T01:58:14.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:14 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:58:14.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:14 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-06-18T01:58:14.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:14 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:58:15.659 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:15 smithi007 ceph-mon[25091]: pgmap v48: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-06-18T01:58:15.659 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:15 smithi007 ceph-mon[25091]: Deploying daemon osd.1 on smithi007 2024-06-18T01:58:15.660 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:15 smithi007 ceph-mon[29879]: pgmap v48: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-06-18T01:58:15.660 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:15 smithi007 ceph-mon[29879]: Deploying daemon osd.1 on smithi007 2024-06-18T01:58:15.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:15 smithi130 ceph-mon[26123]: pgmap v48: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-06-18T01:58:15.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:15 smithi130 ceph-mon[26123]: Deploying daemon osd.1 on smithi007 2024-06-18T01:58:17.495 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:58:17 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.130 - - [18/Jun/2024:01:58:17] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T01:58:17.785 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:17 smithi007 ceph-mon[25091]: pgmap v49: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-06-18T01:58:17.786 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:17 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:17.786 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:17 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:17.786 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:17 smithi007 ceph-mon[29879]: pgmap v49: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-06-18T01:58:17.786 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:17 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:17.786 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:17 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:17.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:17 smithi130 ceph-mon[26123]: pgmap v49: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-06-18T01:58:17.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:17 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:17.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:17 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:19.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:19 smithi130 ceph-mon[26123]: pgmap v50: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-06-18T01:58:19.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:19 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:19.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:19 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:58:19.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:19 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:58:19.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:19 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:58:19.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:19 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:19.813 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:19 smithi007 ceph-mon[29879]: pgmap v50: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-06-18T01:58:19.814 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:19 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:19.814 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:19 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:58:19.814 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:19 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:58:19.814 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:19 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:58:19.814 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:19 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:19.814 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:19 smithi007 ceph-mon[25091]: pgmap v50: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-06-18T01:58:19.814 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:19 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:19.814 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:19 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:58:19.814 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:19 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:58:19.814 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:19 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:58:19.814 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:19 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:21.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:21 smithi130 ceph-mon[26123]: pgmap v51: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-06-18T01:58:21.821 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:21 smithi007 ceph-mon[25091]: pgmap v51: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-06-18T01:58:21.821 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:21 smithi007 ceph-mon[29879]: pgmap v51: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-06-18T01:58:22.049 INFO:teuthology.orchestra.run.smithi007.stdout:Created osd(s) 1 on host 'smithi007' 2024-06-18T01:58:22.739 DEBUG:teuthology.orchestra.run.smithi007:osd.1> sudo journalctl -f -n 0 -u ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.1.service 2024-06-18T01:58:22.742 INFO:tasks.cephadm:Deploying osd.2 on smithi007 with /dev/vg_nvme/lv_2... 2024-06-18T01:58:22.742 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-06-18T01:58:23.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:23 smithi007 ceph-mon[25091]: pgmap v52: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-06-18T01:58:23.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:23 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:23.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:23 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:58:23.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:23 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:58:23.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:23 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:58:23.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:23 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-18T01:58:23.307 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:23 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-18T01:58:23.307 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:23 smithi007 ceph-mon[25091]: Adjusting osd_memory_target on smithi007 to 7522M 2024-06-18T01:58:23.307 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:23 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:23.307 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:23 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:23.307 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:23 smithi007 ceph-mon[25091]: from='osd.1 [v2:172.21.15.7:6810/919695983,v1:172.21.15.7:6811/919695983]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-18T01:58:23.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:23 smithi007 ceph-mon[29879]: pgmap v52: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-06-18T01:58:23.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:23 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:23.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:23 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:58:23.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:23 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:58:23.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:23 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:58:23.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:23 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-18T01:58:23.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:23 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-18T01:58:23.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:23 smithi007 ceph-mon[29879]: Adjusting osd_memory_target on smithi007 to 7522M 2024-06-18T01:58:23.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:23 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:23.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:23 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:23.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:23 smithi007 ceph-mon[29879]: from='osd.1 [v2:172.21.15.7:6810/919695983,v1:172.21.15.7:6811/919695983]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-18T01:58:23.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:23 smithi130 ceph-mon[26123]: pgmap v52: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-06-18T01:58:23.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:23 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:23.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:23 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:58:23.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:23 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:58:23.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:23 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:58:23.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:23 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-18T01:58:23.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:23 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-18T01:58:23.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:23 smithi130 ceph-mon[26123]: Adjusting osd_memory_target on smithi007 to 7522M 2024-06-18T01:58:23.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:23 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:23.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:23 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:23.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:23 smithi130 ceph-mon[26123]: from='osd.1 [v2:172.21.15.7:6810/919695983,v1:172.21.15.7:6811/919695983]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-18T01:58:24.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:24 smithi007 ceph-mon[25091]: from='osd.1 [v2:172.21.15.7:6810/919695983,v1:172.21.15.7:6811/919695983]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-06-18T01:58:24.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:24 smithi007 ceph-mon[25091]: osdmap e11: 2 total, 1 up, 2 in 2024-06-18T01:58:24.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:24 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-18T01:58:24.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:24 smithi007 ceph-mon[25091]: from='osd.1 [v2:172.21.15.7:6810/919695983,v1:172.21.15.7:6811/919695983]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-06-18T01:58:24.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:24 smithi007 ceph-mon[29879]: from='osd.1 [v2:172.21.15.7:6810/919695983,v1:172.21.15.7:6811/919695983]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-06-18T01:58:24.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:24 smithi007 ceph-mon[29879]: osdmap e11: 2 total, 1 up, 2 in 2024-06-18T01:58:24.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:24 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-18T01:58:24.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:24 smithi007 ceph-mon[29879]: from='osd.1 [v2:172.21.15.7:6810/919695983,v1:172.21.15.7:6811/919695983]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-06-18T01:58:24.683 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 01:58:24 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1[35976]: 2024-06-18T01:58:24.508+0000 7f1b7192d700 -1 osd.1 0 waiting for initial osdmap 2024-06-18T01:58:24.683 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 01:58:24 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1[35976]: 2024-06-18T01:58:24.512+0000 7f1b6bac3700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-18T01:58:24.773 INFO:teuthology.orchestra.run.smithi007.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-06-18T01:58:24.773 INFO:teuthology.orchestra.run.smithi007.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-06-18T01:58:24.773 INFO:teuthology.orchestra.run.smithi007.stderr: stderr: 10+0 records in 2024-06-18T01:58:24.773 INFO:teuthology.orchestra.run.smithi007.stderr:10+0 records out 2024-06-18T01:58:24.773 INFO:teuthology.orchestra.run.smithi007.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0101266 s, 1.0 GB/s 2024-06-18T01:58:24.773 INFO:teuthology.orchestra.run.smithi007.stderr:--> Zapping successful for: 2024-06-18T01:58:24.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:24 smithi130 ceph-mon[26123]: from='osd.1 [v2:172.21.15.7:6810/919695983,v1:172.21.15.7:6811/919695983]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-06-18T01:58:24.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:24 smithi130 ceph-mon[26123]: osdmap e11: 2 total, 1 up, 2 in 2024-06-18T01:58:24.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:24 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-18T01:58:24.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:24 smithi130 ceph-mon[26123]: from='osd.1 [v2:172.21.15.7:6810/919695983,v1:172.21.15.7:6811/919695983]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-06-18T01:58:25.370 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph orch daemon add osd smithi007:vg_nvme/lv_2 2024-06-18T01:58:25.788 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:25 smithi007 ceph-mon[25091]: pgmap v54: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-06-18T01:58:25.788 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:25 smithi007 ceph-mon[25091]: from='osd.1 [v2:172.21.15.7:6810/919695983,v1:172.21.15.7:6811/919695983]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-06-18T01:58:25.788 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:25 smithi007 ceph-mon[25091]: osdmap e12: 2 total, 1 up, 2 in 2024-06-18T01:58:25.789 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:25 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-18T01:58:25.789 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:25 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-18T01:58:25.789 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:25 smithi007 ceph-mon[29879]: pgmap v54: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-06-18T01:58:25.789 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:25 smithi007 ceph-mon[29879]: from='osd.1 [v2:172.21.15.7:6810/919695983,v1:172.21.15.7:6811/919695983]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-06-18T01:58:25.789 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:25 smithi007 ceph-mon[29879]: osdmap e12: 2 total, 1 up, 2 in 2024-06-18T01:58:25.789 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:25 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-18T01:58:25.789 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:25 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-18T01:58:25.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:25 smithi130 ceph-mon[26123]: pgmap v54: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-06-18T01:58:25.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:25 smithi130 ceph-mon[26123]: from='osd.1 [v2:172.21.15.7:6810/919695983,v1:172.21.15.7:6811/919695983]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-06-18T01:58:25.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:25 smithi130 ceph-mon[26123]: osdmap e12: 2 total, 1 up, 2 in 2024-06-18T01:58:25.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:25 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-18T01:58:25.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:25 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-18T01:58:26.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:26 smithi007 ceph-mon[25091]: purged_snaps scrub starts 2024-06-18T01:58:26.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:26 smithi007 ceph-mon[25091]: purged_snaps scrub ok 2024-06-18T01:58:26.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:26 smithi007 ceph-mon[25091]: osd.1 [v2:172.21.15.7:6810/919695983,v1:172.21.15.7:6811/919695983] boot 2024-06-18T01:58:26.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:26 smithi007 ceph-mon[25091]: osdmap e13: 2 total, 2 up, 2 in 2024-06-18T01:58:26.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:26 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-18T01:58:26.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:26 smithi007 ceph-mon[29879]: purged_snaps scrub starts 2024-06-18T01:58:26.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:26 smithi007 ceph-mon[29879]: purged_snaps scrub ok 2024-06-18T01:58:26.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:26 smithi007 ceph-mon[29879]: osd.1 [v2:172.21.15.7:6810/919695983,v1:172.21.15.7:6811/919695983] boot 2024-06-18T01:58:26.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:26 smithi007 ceph-mon[29879]: osdmap e13: 2 total, 2 up, 2 in 2024-06-18T01:58:26.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:26 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-18T01:58:26.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:26 smithi130 ceph-mon[26123]: purged_snaps scrub starts 2024-06-18T01:58:26.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:26 smithi130 ceph-mon[26123]: purged_snaps scrub ok 2024-06-18T01:58:26.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:26 smithi130 ceph-mon[26123]: osd.1 [v2:172.21.15.7:6810/919695983,v1:172.21.15.7:6811/919695983] boot 2024-06-18T01:58:26.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:26 smithi130 ceph-mon[26123]: osdmap e13: 2 total, 2 up, 2 in 2024-06-18T01:58:26.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:26 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-18T01:58:27.181 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:58:26 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.7 - - [18/Jun/2024:01:58:26] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T01:58:27.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:27 smithi130 ceph-mon[26123]: pgmap v57: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-06-18T01:58:27.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:27 smithi130 ceph-mon[26123]: osdmap e14: 2 total, 2 up, 2 in 2024-06-18T01:58:27.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:27 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:27.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:27 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:27.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:27 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:58:27.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:27 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:58:27.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:27 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:58:27.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:27 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:27.800 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:27 smithi007 ceph-mon[25091]: pgmap v57: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-06-18T01:58:27.800 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:27 smithi007 ceph-mon[25091]: osdmap e14: 2 total, 2 up, 2 in 2024-06-18T01:58:27.800 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:27 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:27.800 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:27 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:27.800 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:27 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:58:27.800 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:27 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:58:27.800 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:27 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:58:27.800 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:27 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:27.800 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:27 smithi007 ceph-mon[29879]: pgmap v57: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-06-18T01:58:27.801 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:27 smithi007 ceph-mon[29879]: osdmap e14: 2 total, 2 up, 2 in 2024-06-18T01:58:27.801 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:27 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:27.801 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:27 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:27.801 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:27 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:58:27.801 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:27 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:58:27.801 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:27 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:58:27.801 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:27 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:28.315 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:58:28 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.7 - - [18/Jun/2024:01:58:28] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T01:58:28.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:28 smithi007 ceph-mon[25091]: Detected new or changed devices on smithi007 2024-06-18T01:58:28.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:28 smithi007 ceph-mon[25091]: pgmap v59: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2024-06-18T01:58:28.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:28 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-18T01:58:28.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:28 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-18T01:58:28.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:28 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:58:28.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:28 smithi007 ceph-mon[25091]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-06-18T01:58:28.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:28 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:28.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:28 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:28.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:28 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:58:28.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:28 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:58:28.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:28 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:58:28.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:28 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:28.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:28 smithi007 ceph-mon[29879]: Detected new or changed devices on smithi007 2024-06-18T01:58:28.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:28 smithi007 ceph-mon[29879]: pgmap v59: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2024-06-18T01:58:28.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:28 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-18T01:58:28.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:28 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-18T01:58:28.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:28 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:58:28.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:28 smithi007 ceph-mon[29879]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-06-18T01:58:28.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:28 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:28.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:28 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:28.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:28 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:58:28.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:28 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:58:28.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:28 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:58:28.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:28 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:28.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:28 smithi130 ceph-mon[26123]: Detected new or changed devices on smithi007 2024-06-18T01:58:28.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:28 smithi130 ceph-mon[26123]: pgmap v59: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2024-06-18T01:58:28.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:28 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-18T01:58:28.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:28 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-18T01:58:28.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:28 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:58:28.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:28 smithi130 ceph-mon[26123]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-06-18T01:58:28.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:28 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:28.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:28 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:28.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:28 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:58:28.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:28 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:58:28.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:28 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:58:28.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:28 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:29.582 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:29 smithi007 ceph-mon[25091]: from='client.14271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T01:58:29.582 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:29 smithi007 ceph-mon[25091]: pgmap v60: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2024-06-18T01:58:29.582 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:29 smithi007 ceph-mon[25091]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-06-18T01:58:29.582 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:29 smithi007 ceph-mon[25091]: Cluster is now healthy 2024-06-18T01:58:29.583 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:29 smithi007 ceph-mon[29879]: from='client.14271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T01:58:29.583 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:29 smithi007 ceph-mon[29879]: pgmap v60: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2024-06-18T01:58:29.583 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:29 smithi007 ceph-mon[29879]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-06-18T01:58:29.583 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:29 smithi007 ceph-mon[29879]: Cluster is now healthy 2024-06-18T01:58:29.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:29 smithi130 ceph-mon[26123]: from='client.14271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T01:58:29.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:29 smithi130 ceph-mon[26123]: pgmap v60: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2024-06-18T01:58:29.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:29 smithi130 ceph-mon[26123]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-06-18T01:58:29.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:29 smithi130 ceph-mon[26123]: Cluster is now healthy 2024-06-18T01:58:31.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:31 smithi130 ceph-mon[26123]: pgmap v61: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2024-06-18T01:58:31.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:31 smithi007 ceph-mon[25091]: pgmap v61: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2024-06-18T01:58:31.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:31 smithi007 ceph-mon[29879]: pgmap v61: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2024-06-18T01:58:32.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:32 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/1771032010' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b8baceb4-66a4-4833-b235-88fb6b9b5bfe"}]: dispatch 2024-06-18T01:58:32.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:32 smithi130 ceph-mon[26123]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b8baceb4-66a4-4833-b235-88fb6b9b5bfe"}]: dispatch 2024-06-18T01:58:32.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:32 smithi130 ceph-mon[26123]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b8baceb4-66a4-4833-b235-88fb6b9b5bfe"}]': finished 2024-06-18T01:58:32.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:32 smithi130 ceph-mon[26123]: osdmap e15: 3 total, 2 up, 3 in 2024-06-18T01:58:32.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:32 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-18T01:58:32.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:32 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/3728485682' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-18T01:58:32.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:32 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/1771032010' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b8baceb4-66a4-4833-b235-88fb6b9b5bfe"}]: dispatch 2024-06-18T01:58:32.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:32 smithi007 ceph-mon[25091]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b8baceb4-66a4-4833-b235-88fb6b9b5bfe"}]: dispatch 2024-06-18T01:58:32.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:32 smithi007 ceph-mon[25091]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b8baceb4-66a4-4833-b235-88fb6b9b5bfe"}]': finished 2024-06-18T01:58:32.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:32 smithi007 ceph-mon[25091]: osdmap e15: 3 total, 2 up, 3 in 2024-06-18T01:58:32.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:32 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-18T01:58:32.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:32 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/3728485682' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-18T01:58:32.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:32 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/1771032010' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b8baceb4-66a4-4833-b235-88fb6b9b5bfe"}]: dispatch 2024-06-18T01:58:32.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:32 smithi007 ceph-mon[29879]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b8baceb4-66a4-4833-b235-88fb6b9b5bfe"}]: dispatch 2024-06-18T01:58:32.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:32 smithi007 ceph-mon[29879]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b8baceb4-66a4-4833-b235-88fb6b9b5bfe"}]': finished 2024-06-18T01:58:32.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:32 smithi007 ceph-mon[29879]: osdmap e15: 3 total, 2 up, 3 in 2024-06-18T01:58:32.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:32 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-18T01:58:32.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:32 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/3728485682' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-18T01:58:33.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:33 smithi130 ceph-mon[26123]: pgmap v63: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-06-18T01:58:33.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:33 smithi007 ceph-mon[25091]: pgmap v63: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-06-18T01:58:33.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:33 smithi007 ceph-mon[29879]: pgmap v63: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-06-18T01:58:35.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:35 smithi007 ceph-mon[25091]: pgmap v64: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-06-18T01:58:35.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:35 smithi007 ceph-mon[29879]: pgmap v64: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-06-18T01:58:35.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:35 smithi130 ceph-mon[26123]: pgmap v64: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-06-18T01:58:37.682 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:58:37 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.130 - - [18/Jun/2024:01:58:37] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T01:58:37.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:37 smithi007 ceph-mon[29879]: pgmap v65: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-06-18T01:58:37.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:37 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:37.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:37 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:37.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:37 smithi007 ceph-mon[25091]: pgmap v65: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-06-18T01:58:37.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:37 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:37.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:37 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:37.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:37 smithi130 ceph-mon[26123]: pgmap v65: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-06-18T01:58:37.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:37 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:37.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:37 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:38.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:38 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-06-18T01:58:38.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:38 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-06-18T01:58:38.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:38 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-06-18T01:58:38.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:38 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:58:38.843 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:38 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-06-18T01:58:38.843 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:38 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-06-18T01:58:38.843 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:38 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-06-18T01:58:38.843 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:38 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:58:38.843 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:38 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-06-18T01:58:38.843 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:38 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-06-18T01:58:38.843 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:38 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-06-18T01:58:38.843 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:38 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:58:39.741 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:39 smithi007 ceph-mon[25091]: pgmap v66: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-06-18T01:58:39.741 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:39 smithi007 ceph-mon[25091]: Deploying daemon osd.2 on smithi007 2024-06-18T01:58:39.741 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:39 smithi007 ceph-mon[29879]: pgmap v66: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-06-18T01:58:39.742 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:39 smithi007 ceph-mon[29879]: Deploying daemon osd.2 on smithi007 2024-06-18T01:58:39.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:39 smithi130 ceph-mon[26123]: pgmap v66: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-06-18T01:58:39.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:39 smithi130 ceph-mon[26123]: Deploying daemon osd.2 on smithi007 2024-06-18T01:58:41.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:41 smithi130 ceph-mon[26123]: pgmap v67: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-06-18T01:58:41.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:41 smithi007 ceph-mon[25091]: pgmap v67: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-06-18T01:58:41.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:41 smithi007 ceph-mon[29879]: pgmap v67: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-06-18T01:58:43.793 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:43 smithi007 ceph-mon[25091]: pgmap v68: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-06-18T01:58:43.793 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:43 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:43.793 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:43 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:58:43.793 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:43 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:58:43.794 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:43 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:58:43.794 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:43 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:43.794 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:43 smithi007 ceph-mon[29879]: pgmap v68: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-06-18T01:58:43.794 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:43 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:43.794 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:43 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:58:43.794 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:43 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:58:43.794 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:43 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:58:43.794 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:43 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:43.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:43 smithi130 ceph-mon[26123]: pgmap v68: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-06-18T01:58:43.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:43 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:43.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:43 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:58:43.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:43 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:58:43.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:43 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:58:43.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:43 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:45.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:45 smithi130 ceph-mon[26123]: pgmap v69: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-06-18T01:58:45.837 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:45 smithi007 ceph-mon[25091]: pgmap v69: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-06-18T01:58:45.837 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:45 smithi007 ceph-mon[29879]: pgmap v69: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-06-18T01:58:45.870 INFO:teuthology.orchestra.run.smithi007.stdout:Created osd(s) 2 on host 'smithi007' 2024-06-18T01:58:46.626 DEBUG:teuthology.orchestra.run.smithi007:osd.2> sudo journalctl -f -n 0 -u ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.2.service 2024-06-18T01:58:46.629 INFO:tasks.cephadm:Deploying osd.3 on smithi007 with /dev/vg_nvme/lv_1... 2024-06-18T01:58:46.629 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-06-18T01:58:47.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:46 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:47.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:46 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:58:47.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:46 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:58:47.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:46 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:58:47.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:46 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-18T01:58:47.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:46 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-18T01:58:47.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:46 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-18T01:58:47.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:46 smithi007 ceph-mon[25091]: Adjusting osd_memory_target on smithi007 to 5014M 2024-06-18T01:58:47.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:46 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:47.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:46 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:47.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:46 smithi007 ceph-mon[25091]: pgmap v70: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-06-18T01:58:47.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:46 smithi007 ceph-mon[25091]: from='osd.2 [v2:172.21.15.7:6818/3268637445,v1:172.21.15.7:6819/3268637445]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-18T01:58:47.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:46 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:47.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:46 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:58:47.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:46 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:58:47.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:46 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:58:47.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:46 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-18T01:58:47.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:46 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-18T01:58:47.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:46 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-18T01:58:47.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:46 smithi007 ceph-mon[29879]: Adjusting osd_memory_target on smithi007 to 5014M 2024-06-18T01:58:47.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:46 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:47.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:46 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:47.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:46 smithi007 ceph-mon[29879]: pgmap v70: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-06-18T01:58:47.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:46 smithi007 ceph-mon[29879]: from='osd.2 [v2:172.21.15.7:6818/3268637445,v1:172.21.15.7:6819/3268637445]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-18T01:58:47.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:46 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:47.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:46 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:58:47.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:46 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:58:47.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:46 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:58:47.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:46 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-18T01:58:47.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:46 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-18T01:58:47.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:46 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-18T01:58:47.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:46 smithi130 ceph-mon[26123]: Adjusting osd_memory_target on smithi007 to 5014M 2024-06-18T01:58:47.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:46 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:47.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:46 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:47.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:46 smithi130 ceph-mon[26123]: pgmap v70: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-06-18T01:58:47.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:46 smithi130 ceph-mon[26123]: from='osd.2 [v2:172.21.15.7:6818/3268637445,v1:172.21.15.7:6819/3268637445]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-18T01:58:47.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:47 smithi007 ceph-mon[25091]: from='osd.2 [v2:172.21.15.7:6818/3268637445,v1:172.21.15.7:6819/3268637445]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-06-18T01:58:47.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:47 smithi007 ceph-mon[25091]: osdmap e16: 3 total, 2 up, 3 in 2024-06-18T01:58:47.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:47 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-18T01:58:47.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:47 smithi007 ceph-mon[25091]: from='osd.2 [v2:172.21.15.7:6818/3268637445,v1:172.21.15.7:6819/3268637445]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-06-18T01:58:47.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:47 smithi007 ceph-mon[29879]: from='osd.2 [v2:172.21.15.7:6818/3268637445,v1:172.21.15.7:6819/3268637445]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-06-18T01:58:47.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:47 smithi007 ceph-mon[29879]: osdmap e16: 3 total, 2 up, 3 in 2024-06-18T01:58:47.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:47 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-18T01:58:47.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:47 smithi007 ceph-mon[29879]: from='osd.2 [v2:172.21.15.7:6818/3268637445,v1:172.21.15.7:6819/3268637445]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-06-18T01:58:47.933 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 01:58:47 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2[38899]: 2024-06-18T01:58:47.904+0000 7fa8c2cf5700 -1 osd.2 0 waiting for initial osdmap 2024-06-18T01:58:47.933 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 01:58:47 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2[38899]: 2024-06-18T01:58:47.907+0000 7fa8bb688700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-18T01:58:48.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:47 smithi130 ceph-mon[26123]: from='osd.2 [v2:172.21.15.7:6818/3268637445,v1:172.21.15.7:6819/3268637445]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-06-18T01:58:48.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:47 smithi130 ceph-mon[26123]: osdmap e16: 3 total, 2 up, 3 in 2024-06-18T01:58:48.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:47 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-18T01:58:48.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:47 smithi130 ceph-mon[26123]: from='osd.2 [v2:172.21.15.7:6818/3268637445,v1:172.21.15.7:6819/3268637445]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-06-18T01:58:48.254 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:58:48 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.7 - - [18/Jun/2024:01:58:48] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T01:58:49.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:48 smithi007 ceph-mon[25091]: from='osd.2 [v2:172.21.15.7:6818/3268637445,v1:172.21.15.7:6819/3268637445]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-06-18T01:58:49.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:48 smithi007 ceph-mon[25091]: osdmap e17: 3 total, 2 up, 3 in 2024-06-18T01:58:49.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:48 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-18T01:58:49.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:48 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-18T01:58:49.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:48 smithi007 ceph-mon[25091]: pgmap v73: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-06-18T01:58:49.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:48 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:49.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:48 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:49.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:48 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:58:49.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:48 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:58:49.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:48 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:58:49.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:48 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:49.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:48 smithi007 ceph-mon[29879]: from='osd.2 [v2:172.21.15.7:6818/3268637445,v1:172.21.15.7:6819/3268637445]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-06-18T01:58:49.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:48 smithi007 ceph-mon[29879]: osdmap e17: 3 total, 2 up, 3 in 2024-06-18T01:58:49.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:48 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-18T01:58:49.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:48 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-18T01:58:49.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:48 smithi007 ceph-mon[29879]: pgmap v73: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-06-18T01:58:49.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:48 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:49.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:48 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:49.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:48 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:58:49.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:48 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:58:49.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:48 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:58:49.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:48 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:49.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:48 smithi130 ceph-mon[26123]: from='osd.2 [v2:172.21.15.7:6818/3268637445,v1:172.21.15.7:6819/3268637445]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-06-18T01:58:49.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:48 smithi130 ceph-mon[26123]: osdmap e17: 3 total, 2 up, 3 in 2024-06-18T01:58:49.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:48 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-18T01:58:49.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:48 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-18T01:58:49.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:48 smithi130 ceph-mon[26123]: pgmap v73: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-06-18T01:58:49.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:48 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:49.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:48 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:49.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:48 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:58:49.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:48 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:58:49.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:48 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:58:49.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:48 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:50.015 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:49 smithi007 ceph-mon[25091]: purged_snaps scrub starts 2024-06-18T01:58:50.016 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:49 smithi007 ceph-mon[25091]: purged_snaps scrub ok 2024-06-18T01:58:50.016 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:49 smithi007 ceph-mon[25091]: osd.2 [v2:172.21.15.7:6818/3268637445,v1:172.21.15.7:6819/3268637445] boot 2024-06-18T01:58:50.016 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:49 smithi007 ceph-mon[25091]: osdmap e18: 3 total, 3 up, 3 in 2024-06-18T01:58:50.016 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:49 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-18T01:58:50.016 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:49 smithi007 ceph-mon[29879]: purged_snaps scrub starts 2024-06-18T01:58:50.016 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:49 smithi007 ceph-mon[29879]: purged_snaps scrub ok 2024-06-18T01:58:50.016 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:49 smithi007 ceph-mon[29879]: osd.2 [v2:172.21.15.7:6818/3268637445,v1:172.21.15.7:6819/3268637445] boot 2024-06-18T01:58:50.016 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:49 smithi007 ceph-mon[29879]: osdmap e18: 3 total, 3 up, 3 in 2024-06-18T01:58:50.016 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:49 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-18T01:58:50.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:49 smithi130 ceph-mon[26123]: purged_snaps scrub starts 2024-06-18T01:58:50.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:49 smithi130 ceph-mon[26123]: purged_snaps scrub ok 2024-06-18T01:58:50.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:49 smithi130 ceph-mon[26123]: osd.2 [v2:172.21.15.7:6818/3268637445,v1:172.21.15.7:6819/3268637445] boot 2024-06-18T01:58:50.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:49 smithi130 ceph-mon[26123]: osdmap e18: 3 total, 3 up, 3 in 2024-06-18T01:58:50.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:49 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-18T01:58:50.708 INFO:teuthology.orchestra.run.smithi007.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-06-18T01:58:50.708 INFO:teuthology.orchestra.run.smithi007.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-06-18T01:58:50.708 INFO:teuthology.orchestra.run.smithi007.stderr: stderr: 10+0 records in 2024-06-18T01:58:50.708 INFO:teuthology.orchestra.run.smithi007.stderr:10+0 records out 2024-06-18T01:58:50.708 INFO:teuthology.orchestra.run.smithi007.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00954435 s, 1.1 GB/s 2024-06-18T01:58:50.708 INFO:teuthology.orchestra.run.smithi007.stderr:--> Zapping successful for: 2024-06-18T01:58:51.048 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:50 smithi007 ceph-mon[25091]: osdmap e19: 3 total, 3 up, 3 in 2024-06-18T01:58:51.049 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:50 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-06-18T01:58:51.049 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:50 smithi007 ceph-mon[25091]: pgmap v76: 0 pgs: ; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-06-18T01:58:51.049 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:50 smithi007 ceph-mon[29879]: osdmap e19: 3 total, 3 up, 3 in 2024-06-18T01:58:51.049 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:50 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-06-18T01:58:51.049 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:50 smithi007 ceph-mon[29879]: pgmap v76: 0 pgs: ; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-06-18T01:58:51.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:50 smithi130 ceph-mon[26123]: osdmap e19: 3 total, 3 up, 3 in 2024-06-18T01:58:51.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:50 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-06-18T01:58:51.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:50 smithi130 ceph-mon[26123]: pgmap v76: 0 pgs: ; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-06-18T01:58:51.426 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph orch daemon add osd smithi007:vg_nvme/lv_1 2024-06-18T01:58:52.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:51 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-06-18T01:58:52.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:51 smithi007 ceph-mon[25091]: osdmap e20: 3 total, 3 up, 3 in 2024-06-18T01:58:52.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:51 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-06-18T01:58:52.085 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:51 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-06-18T01:58:52.085 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:51 smithi007 ceph-mon[29879]: osdmap e20: 3 total, 3 up, 3 in 2024-06-18T01:58:52.086 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:51 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-06-18T01:58:52.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:51 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-06-18T01:58:52.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:51 smithi130 ceph-mon[26123]: osdmap e20: 3 total, 3 up, 3 in 2024-06-18T01:58:52.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:51 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-06-18T01:58:52.785 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 01:58:52 smithi007 sudo[40113]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-18T01:58:52.785 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 01:58:52 smithi007 sudo[40113]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-06-18T01:58:52.785 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 01:58:52 smithi007 sudo[40113]: pam_unix(sudo:session): session closed for user root 2024-06-18T01:58:53.043 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 01:58:52 smithi007 sudo[40137]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-18T01:58:53.043 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 01:58:52 smithi007 sudo[40137]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-06-18T01:58:53.043 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 01:58:52 smithi007 sudo[40137]: pam_unix(sudo:session): session closed for user root 2024-06-18T01:58:53.043 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:52 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-06-18T01:58:53.043 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:52 smithi007 ceph-mon[25091]: osdmap e21: 3 total, 3 up, 3 in 2024-06-18T01:58:53.043 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:52 smithi007 ceph-mon[25091]: pgmap v79: 1 pgs: 1 creating+peering; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-06-18T01:58:53.043 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:52 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:53.044 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:52 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-06-18T01:58:53.044 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:52 smithi007 ceph-mon[29879]: osdmap e21: 3 total, 3 up, 3 in 2024-06-18T01:58:53.044 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:52 smithi007 ceph-mon[29879]: pgmap v79: 1 pgs: 1 creating+peering; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-06-18T01:58:53.044 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:52 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:53.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:52 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-06-18T01:58:53.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:52 smithi130 ceph-mon[26123]: osdmap e21: 3 total, 3 up, 3 in 2024-06-18T01:58:53.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:52 smithi130 ceph-mon[26123]: pgmap v79: 1 pgs: 1 creating+peering; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-06-18T01:58:53.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:52 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:53.681 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:58:53 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.7 - - [18/Jun/2024:01:58:53] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T01:58:53.682 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 01:58:53 smithi007 sudo[40199]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-18T01:58:53.682 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 01:58:53 smithi007 sudo[40199]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-06-18T01:58:53.682 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 01:58:53 smithi007 sudo[40199]: pam_unix(sudo:session): session closed for user root 2024-06-18T01:58:54.145 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 01:58:53 smithi007 sudo[40337]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-18T01:58:54.145 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 01:58:53 smithi007 sudo[40337]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-06-18T01:58:54.145 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 01:58:53 smithi007 sudo[40337]: pam_unix(sudo:session): session closed for user root 2024-06-18T01:58:54.146 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:53 smithi007 ceph-mon[25091]: osdmap e22: 3 total, 3 up, 3 in 2024-06-18T01:58:54.146 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:53 smithi007 ceph-mon[25091]: from='client.24205 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T01:58:54.146 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:53 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-18T01:58:54.146 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:53 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-18T01:58:54.146 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:53 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:58:54.146 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:53 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:54.146 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:53 smithi007 ceph-mon[25091]: Detected new or changed devices on smithi007 2024-06-18T01:58:54.146 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:53 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:54.146 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:53 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:58:54.146 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:53 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:58:54.146 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:53 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:58:54.146 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:53 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:54.147 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:53 smithi007 ceph-mon[29879]: osdmap e22: 3 total, 3 up, 3 in 2024-06-18T01:58:54.147 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:53 smithi007 ceph-mon[29879]: from='client.24205 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T01:58:54.147 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:53 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-18T01:58:54.147 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:53 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-18T01:58:54.147 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:53 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:58:54.147 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:53 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:54.147 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:53 smithi007 ceph-mon[29879]: Detected new or changed devices on smithi007 2024-06-18T01:58:54.147 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:53 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:54.147 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:53 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:58:54.147 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:53 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:58:54.147 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:53 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:58:54.147 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:53 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:54.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:53 smithi130 ceph-mon[26123]: osdmap e22: 3 total, 3 up, 3 in 2024-06-18T01:58:54.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:53 smithi130 ceph-mon[26123]: from='client.24205 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T01:58:54.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:53 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-18T01:58:54.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:53 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-18T01:58:54.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:53 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:58:54.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:53 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:54.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:53 smithi130 ceph-mon[26123]: Detected new or changed devices on smithi007 2024-06-18T01:58:54.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:53 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:54.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:53 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:58:54.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:53 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:58:54.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:53 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:58:54.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:53 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:54.431 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 01:58:54 smithi007 sudo[40357]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-18T01:58:54.431 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 01:58:54 smithi007 sudo[40357]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-06-18T01:58:54.432 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 01:58:54 smithi007 sudo[40357]: pam_unix(sudo:session): session closed for user root 2024-06-18T01:58:55.041 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 01:58:54 smithi007 sudo[40363]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-18T01:58:55.041 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 01:58:54 smithi007 sudo[40363]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-06-18T01:58:55.041 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 01:58:54 smithi007 sudo[40363]: pam_unix(sudo:session): session closed for user root 2024-06-18T01:58:55.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:55 smithi007 sudo[40391]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-18T01:58:55.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:55 smithi007 sudo[40391]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-06-18T01:58:55.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:55 smithi007 sudo[40391]: pam_unix(sudo:session): session closed for user root 2024-06-18T01:58:55.931 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:55 smithi007 ceph-mon[29879]: pgmap v81: 1 pgs: 1 creating+peering; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-06-18T01:58:55.982 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:55 smithi007 ceph-mon[29879]: mgrmap e15: y(active, since 2m), standbys: x 2024-06-18T01:58:55.982 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:55 smithi007 ceph-mon[29879]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-18T01:58:55.983 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:55 smithi007 sudo[40427]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-18T01:58:55.983 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:55 smithi007 sudo[40427]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-06-18T01:58:55.983 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:55 smithi007 sudo[40427]: pam_unix(sudo:session): session closed for user root 2024-06-18T01:58:55.983 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:55 smithi007 ceph-mon[25091]: pgmap v81: 1 pgs: 1 creating+peering; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-06-18T01:58:55.983 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:55 smithi007 ceph-mon[25091]: mgrmap e15: y(active, since 2m), standbys: x 2024-06-18T01:58:55.983 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:55 smithi007 ceph-mon[25091]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-18T01:58:56.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:55 smithi130 ceph-mon[26123]: pgmap v81: 1 pgs: 1 creating+peering; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-06-18T01:58:56.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:55 smithi130 ceph-mon[26123]: mgrmap e15: y(active, since 2m), standbys: x 2024-06-18T01:58:56.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:55 smithi130 ceph-mon[26123]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-18T01:58:56.431 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:56 smithi007 sudo[40431]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-18T01:58:56.431 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:56 smithi007 sudo[40431]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-06-18T01:58:56.431 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:56 smithi007 sudo[40431]: pam_unix(sudo:session): session closed for user root 2024-06-18T01:58:56.931 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:56 smithi007 sudo[40434]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-18T01:58:56.931 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:56 smithi007 sudo[40434]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-06-18T01:58:56.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:56 smithi007 sudo[40434]: pam_unix(sudo:session): session closed for user root 2024-06-18T01:58:57.038 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:56 smithi130 sudo[28664]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-18T01:58:57.038 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:56 smithi130 sudo[28664]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-06-18T01:58:57.038 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:56 smithi130 sudo[28664]: pam_unix(sudo:session): session closed for user root 2024-06-18T01:58:57.038 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:57 smithi130 sudo[28667]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-18T01:58:57.038 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:57 smithi130 sudo[28667]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-06-18T01:58:57.038 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:57 smithi130 sudo[28667]: pam_unix(sudo:session): session closed for user root 2024-06-18T01:58:57.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:57 smithi130 ceph-mon[26123]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-18T01:58:57.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:57 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-18T01:58:57.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:57 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-18T01:58:57.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:57 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-18T01:58:57.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:57 smithi130 ceph-mon[26123]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-18T01:58:57.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:57 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-18T01:58:57.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:57 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-18T01:58:57.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:57 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-18T01:58:57.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:57 smithi130 ceph-mon[26123]: pgmap v82: 1 pgs: 1 creating+peering; 0 B data, 17 MiB used, 268 GiB / 268 GiB avail 2024-06-18T01:58:57.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:57 smithi130 ceph-mon[26123]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-18T01:58:57.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:57 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/2599042718' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "45949dd3-a8f0-4310-a154-63faed8a3ea3"}]: dispatch 2024-06-18T01:58:57.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:57 smithi130 ceph-mon[26123]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "45949dd3-a8f0-4310-a154-63faed8a3ea3"}]: dispatch 2024-06-18T01:58:57.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:57 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-18T01:58:57.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:57 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-18T01:58:57.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:57 smithi130 ceph-mon[26123]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "45949dd3-a8f0-4310-a154-63faed8a3ea3"}]': finished 2024-06-18T01:58:57.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:57 smithi130 ceph-mon[26123]: osdmap e23: 4 total, 3 up, 4 in 2024-06-18T01:58:57.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:57 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-18T01:58:57.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:57 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-18T01:58:57.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:57 smithi007 ceph-mon[29879]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-18T01:58:57.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:57 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-18T01:58:57.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:57 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-18T01:58:57.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:57 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-18T01:58:57.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:57 smithi007 ceph-mon[29879]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-18T01:58:57.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:57 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-18T01:58:57.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:57 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-18T01:58:57.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:57 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-18T01:58:57.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:57 smithi007 ceph-mon[29879]: pgmap v82: 1 pgs: 1 creating+peering; 0 B data, 17 MiB used, 268 GiB / 268 GiB avail 2024-06-18T01:58:57.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:57 smithi007 ceph-mon[29879]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-18T01:58:57.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:57 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/2599042718' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "45949dd3-a8f0-4310-a154-63faed8a3ea3"}]: dispatch 2024-06-18T01:58:57.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:57 smithi007 ceph-mon[29879]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "45949dd3-a8f0-4310-a154-63faed8a3ea3"}]: dispatch 2024-06-18T01:58:57.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:57 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-18T01:58:57.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:57 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-18T01:58:57.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:57 smithi007 ceph-mon[29879]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "45949dd3-a8f0-4310-a154-63faed8a3ea3"}]': finished 2024-06-18T01:58:57.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:57 smithi007 ceph-mon[29879]: osdmap e23: 4 total, 3 up, 4 in 2024-06-18T01:58:57.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:57 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-18T01:58:57.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:57 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-18T01:58:57.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:57 smithi007 ceph-mon[25091]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-18T01:58:57.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:57 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-18T01:58:57.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:57 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-18T01:58:57.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:57 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-18T01:58:57.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:57 smithi007 ceph-mon[25091]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-18T01:58:57.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:57 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-18T01:58:57.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:57 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-18T01:58:57.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:57 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-18T01:58:57.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:57 smithi007 ceph-mon[25091]: pgmap v82: 1 pgs: 1 creating+peering; 0 B data, 17 MiB used, 268 GiB / 268 GiB avail 2024-06-18T01:58:57.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:57 smithi007 ceph-mon[25091]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-18T01:58:57.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:57 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/2599042718' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "45949dd3-a8f0-4310-a154-63faed8a3ea3"}]: dispatch 2024-06-18T01:58:57.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:57 smithi007 ceph-mon[25091]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "45949dd3-a8f0-4310-a154-63faed8a3ea3"}]: dispatch 2024-06-18T01:58:57.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:57 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-18T01:58:57.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:57 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-18T01:58:57.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:57 smithi007 ceph-mon[25091]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "45949dd3-a8f0-4310-a154-63faed8a3ea3"}]': finished 2024-06-18T01:58:57.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:57 smithi007 ceph-mon[25091]: osdmap e23: 4 total, 3 up, 4 in 2024-06-18T01:58:57.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:57 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-18T01:58:57.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:57 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-18T01:58:57.931 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:58:57 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.130 - - [18/Jun/2024:01:58:57] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T01:58:58.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:58 smithi130 ceph-mon[26123]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-18T01:58:58.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:58 smithi130 ceph-mon[26123]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-18T01:58:58.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:58 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:58.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:58 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/535651908' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-18T01:58:58.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:58 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:58.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:58 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:58.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:58 smithi007 ceph-mon[25091]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-18T01:58:58.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:58 smithi007 ceph-mon[25091]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-18T01:58:58.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:58 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:58.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:58 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/535651908' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-18T01:58:58.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:58 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:58.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:58 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:58.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:58 smithi007 ceph-mon[29879]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-18T01:58:58.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:58 smithi007 ceph-mon[29879]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-18T01:58:58.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:58 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:58.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:58 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/535651908' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-18T01:58:58.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:58 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:58.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:58 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:58:59.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:58:59 smithi130 ceph-mon[26123]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-06-18T01:58:59.386 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:58:59 smithi007 ceph-mon[25091]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-06-18T01:58:59.387 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:58:59 smithi007 ceph-mon[29879]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-06-18T01:59:01.413 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:01 smithi130 ceph-mon[26123]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-06-18T01:59:01.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:01 smithi007 ceph-mon[25091]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-06-18T01:59:01.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:01 smithi007 ceph-mon[29879]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-06-18T01:59:03.414 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:03 smithi007 ceph-mon[25091]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 141 KiB/s wr, 10 op/s 2024-06-18T01:59:03.414 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:03 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-06-18T01:59:03.414 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:03 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:59:03.414 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:03 smithi007 ceph-mon[29879]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 141 KiB/s wr, 10 op/s 2024-06-18T01:59:03.415 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:03 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-06-18T01:59:03.415 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:03 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:59:03.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:03 smithi130 ceph-mon[26123]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 141 KiB/s wr, 10 op/s 2024-06-18T01:59:03.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:03 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-06-18T01:59:03.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:03 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:59:04.324 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:04 smithi007 ceph-mon[25091]: Deploying daemon osd.3 on smithi007 2024-06-18T01:59:04.325 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:04 smithi007 ceph-mon[29879]: Deploying daemon osd.3 on smithi007 2024-06-18T01:59:04.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:04 smithi130 ceph-mon[26123]: Deploying daemon osd.3 on smithi007 2024-06-18T01:59:05.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:05 smithi007 ceph-mon[25091]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 104 KiB/s wr, 7 op/s 2024-06-18T01:59:05.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:05 smithi007 ceph-mon[29879]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 104 KiB/s wr, 7 op/s 2024-06-18T01:59:05.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:05 smithi130 ceph-mon[26123]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 104 KiB/s wr, 7 op/s 2024-06-18T01:59:06.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:06 smithi007 ceph-mon[25091]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 82 KiB/s wr, 5 op/s 2024-06-18T01:59:06.907 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:06 smithi007 ceph-mon[29879]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 82 KiB/s wr, 5 op/s 2024-06-18T01:59:07.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:06 smithi130 ceph-mon[26123]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 82 KiB/s wr, 5 op/s 2024-06-18T01:59:09.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:09 smithi007 ceph-mon[25091]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 68 KiB/s wr, 4 op/s 2024-06-18T01:59:09.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:09 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:09.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:09 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:59:09.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:09 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:59:09.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:09 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:59:09.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:09 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:09.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:09 smithi007 ceph-mon[29879]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 68 KiB/s wr, 4 op/s 2024-06-18T01:59:09.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:09 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:09.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:09 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:59:09.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:09 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:59:09.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:09 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:59:09.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:09 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:09.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:09 smithi130 ceph-mon[26123]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 68 KiB/s wr, 4 op/s 2024-06-18T01:59:09.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:09 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:09.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:09 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:59:09.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:09 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:59:09.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:09 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:59:09.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:09 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:11.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:11 smithi007 ceph-mon[25091]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-06-18T01:59:11.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:11 smithi007 ceph-mon[29879]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-06-18T01:59:11.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:11 smithi130 ceph-mon[26123]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-06-18T01:59:12.315 INFO:teuthology.orchestra.run.smithi007.stdout:Created osd(s) 3 on host 'smithi007' 2024-06-18T01:59:12.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:12 smithi007 ceph-mon[25091]: from='osd.3 [v2:172.21.15.7:6826/1700854068,v1:172.21.15.7:6827/1700854068]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-18T01:59:12.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:12 smithi007 ceph-mon[25091]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-18T01:59:12.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:12 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:12.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:12 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:59:12.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:12 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:59:12.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:12 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:59:12.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:12 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-18T01:59:12.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:12 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-18T01:59:12.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:12 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-18T01:59:12.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:12 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-18T01:59:12.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:12 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:12.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:12 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:12.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:12 smithi007 ceph-mon[29879]: from='osd.3 [v2:172.21.15.7:6826/1700854068,v1:172.21.15.7:6827/1700854068]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-18T01:59:12.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:12 smithi007 ceph-mon[29879]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-18T01:59:12.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:12 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:12.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:12 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:59:12.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:12 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:59:12.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:12 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:59:12.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:12 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-18T01:59:12.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:12 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-18T01:59:12.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:12 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-18T01:59:12.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:12 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-18T01:59:12.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:12 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:12.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:12 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:12.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:12 smithi130 ceph-mon[26123]: from='osd.3 [v2:172.21.15.7:6826/1700854068,v1:172.21.15.7:6827/1700854068]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-18T01:59:12.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:12 smithi130 ceph-mon[26123]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-18T01:59:12.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:12 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:12.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:12 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:59:12.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:12 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:59:12.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:12 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:59:12.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:12 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-18T01:59:12.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:12 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-18T01:59:12.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:12 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-18T01:59:12.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:12 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-18T01:59:12.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:12 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:12.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:12 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:12.936 DEBUG:teuthology.orchestra.run.smithi007:osd.3> sudo journalctl -f -n 0 -u ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.3.service 2024-06-18T01:59:12.938 INFO:tasks.cephadm:Deploying osd.4 on smithi130 with /dev/vg_nvme/lv_4... 2024-06-18T01:59:12.939 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-06-18T01:59:13.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:13 smithi130 ceph-mon[26123]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-06-18T01:59:13.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:13 smithi130 ceph-mon[26123]: Adjusting osd_memory_target on smithi007 to 3761M 2024-06-18T01:59:13.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:13 smithi130 ceph-mon[26123]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-06-18T01:59:13.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:13 smithi130 ceph-mon[26123]: osdmap e24: 4 total, 3 up, 4 in 2024-06-18T01:59:13.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:13 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-18T01:59:13.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:13 smithi130 ceph-mon[26123]: from='osd.3 [v2:172.21.15.7:6826/1700854068,v1:172.21.15.7:6827/1700854068]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-06-18T01:59:13.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:13 smithi130 ceph-mon[26123]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-06-18T01:59:13.682 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:59:13 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.7 - - [18/Jun/2024:01:59:13] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T01:59:13.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:13 smithi007 ceph-mon[25091]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-06-18T01:59:13.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:13 smithi007 ceph-mon[25091]: Adjusting osd_memory_target on smithi007 to 3761M 2024-06-18T01:59:13.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:13 smithi007 ceph-mon[25091]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-06-18T01:59:13.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:13 smithi007 ceph-mon[25091]: osdmap e24: 4 total, 3 up, 4 in 2024-06-18T01:59:13.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:13 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-18T01:59:13.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:13 smithi007 ceph-mon[25091]: from='osd.3 [v2:172.21.15.7:6826/1700854068,v1:172.21.15.7:6827/1700854068]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-06-18T01:59:13.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:13 smithi007 ceph-mon[25091]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-06-18T01:59:13.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:13 smithi007 ceph-mon[29879]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-06-18T01:59:13.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:13 smithi007 ceph-mon[29879]: Adjusting osd_memory_target on smithi007 to 3761M 2024-06-18T01:59:13.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:13 smithi007 ceph-mon[29879]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-06-18T01:59:13.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:13 smithi007 ceph-mon[29879]: osdmap e24: 4 total, 3 up, 4 in 2024-06-18T01:59:13.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:13 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-18T01:59:13.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:13 smithi007 ceph-mon[29879]: from='osd.3 [v2:172.21.15.7:6826/1700854068,v1:172.21.15.7:6827/1700854068]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-06-18T01:59:13.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:13 smithi007 ceph-mon[29879]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-06-18T01:59:13.683 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 01:59:13 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3[41915]: 2024-06-18T01:59:13.433+0000 7f2682068700 -1 osd.3 0 waiting for initial osdmap 2024-06-18T01:59:13.683 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 01:59:13 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3[41915]: 2024-06-18T01:59:13.437+0000 7f267ea03700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-18T01:59:14.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:14 smithi130 ceph-mon[26123]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-06-18T01:59:14.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:14 smithi130 ceph-mon[26123]: osdmap e25: 4 total, 3 up, 4 in 2024-06-18T01:59:14.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:14 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-18T01:59:14.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:14 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-18T01:59:14.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:14 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:14.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:14 smithi130 ceph-mon[26123]: Detected new or changed devices on smithi007 2024-06-18T01:59:14.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:14 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:14.881 INFO:teuthology.orchestra.run.smithi130.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-06-18T01:59:14.881 INFO:teuthology.orchestra.run.smithi130.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-06-18T01:59:14.881 INFO:teuthology.orchestra.run.smithi130.stderr: stderr: 10+0 records in 2024-06-18T01:59:14.881 INFO:teuthology.orchestra.run.smithi130.stderr:10+0 records out 2024-06-18T01:59:14.881 INFO:teuthology.orchestra.run.smithi130.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0110485 s, 949 MB/s 2024-06-18T01:59:14.881 INFO:teuthology.orchestra.run.smithi130.stderr:--> Zapping successful for: 2024-06-18T01:59:14.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:14 smithi007 ceph-mon[25091]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-06-18T01:59:14.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:14 smithi007 ceph-mon[25091]: osdmap e25: 4 total, 3 up, 4 in 2024-06-18T01:59:14.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:14 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-18T01:59:14.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:14 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-18T01:59:14.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:14 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:14.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:14 smithi007 ceph-mon[25091]: Detected new or changed devices on smithi007 2024-06-18T01:59:14.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:14 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:14.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:14 smithi007 ceph-mon[29879]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-06-18T01:59:14.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:14 smithi007 ceph-mon[29879]: osdmap e25: 4 total, 3 up, 4 in 2024-06-18T01:59:14.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:14 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-18T01:59:14.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:14 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-18T01:59:14.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:14 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:14.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:14 smithi007 ceph-mon[29879]: Detected new or changed devices on smithi007 2024-06-18T01:59:14.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:14 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:15.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:15 smithi130 ceph-mon[26123]: purged_snaps scrub starts 2024-06-18T01:59:15.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:15 smithi130 ceph-mon[26123]: purged_snaps scrub ok 2024-06-18T01:59:15.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:15 smithi130 ceph-mon[26123]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-06-18T01:59:15.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:15 smithi130 ceph-mon[26123]: osd.3 [v2:172.21.15.7:6826/1700854068,v1:172.21.15.7:6827/1700854068] boot 2024-06-18T01:59:15.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:15 smithi130 ceph-mon[26123]: osdmap e26: 4 total, 4 up, 4 in 2024-06-18T01:59:15.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:15 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-18T01:59:15.548 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph orch daemon add osd smithi130:vg_nvme/lv_4 2024-06-18T01:59:15.931 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:15 smithi007 ceph-mon[29879]: purged_snaps scrub starts 2024-06-18T01:59:15.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:15 smithi007 ceph-mon[29879]: purged_snaps scrub ok 2024-06-18T01:59:15.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:15 smithi007 ceph-mon[29879]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-06-18T01:59:15.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:15 smithi007 ceph-mon[29879]: osd.3 [v2:172.21.15.7:6826/1700854068,v1:172.21.15.7:6827/1700854068] boot 2024-06-18T01:59:15.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:15 smithi007 ceph-mon[29879]: osdmap e26: 4 total, 4 up, 4 in 2024-06-18T01:59:15.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:15 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-18T01:59:15.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:15 smithi007 ceph-mon[25091]: purged_snaps scrub starts 2024-06-18T01:59:15.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:15 smithi007 ceph-mon[25091]: purged_snaps scrub ok 2024-06-18T01:59:15.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:15 smithi007 ceph-mon[25091]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-06-18T01:59:15.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:15 smithi007 ceph-mon[25091]: osd.3 [v2:172.21.15.7:6826/1700854068,v1:172.21.15.7:6827/1700854068] boot 2024-06-18T01:59:15.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:15 smithi007 ceph-mon[25091]: osdmap e26: 4 total, 4 up, 4 in 2024-06-18T01:59:15.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:15 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-18T01:59:16.748 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:16 smithi130 ceph-mon[26123]: osdmap e27: 4 total, 4 up, 4 in 2024-06-18T01:59:16.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:16 smithi007 ceph-mon[25091]: osdmap e27: 4 total, 4 up, 4 in 2024-06-18T01:59:16.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:16 smithi007 ceph-mon[29879]: osdmap e27: 4 total, 4 up, 4 in 2024-06-18T01:59:17.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:17 smithi130 ceph-mon[26123]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-06-18T01:59:17.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:17 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-18T01:59:17.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:17 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-18T01:59:17.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:17 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:59:17.932 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:59:17 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.130 - - [18/Jun/2024:01:59:17] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T01:59:17.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:17 smithi007 ceph-mon[25091]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-06-18T01:59:17.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:17 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-18T01:59:17.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:17 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-18T01:59:17.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:17 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:59:17.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:17 smithi007 ceph-mon[29879]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-06-18T01:59:17.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:17 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-18T01:59:17.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:17 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-18T01:59:17.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:17 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:59:18.784 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:18 smithi130 ceph-mon[26123]: from='client.24215 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T01:59:18.785 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:18 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:18.785 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:18 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:18.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:18 smithi007 ceph-mon[25091]: from='client.24215 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T01:59:18.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:18 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:18.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:18 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:18.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:18 smithi007 ceph-mon[29879]: from='client.24215 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T01:59:18.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:18 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:18.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:18 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:19.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:19 smithi130 ceph-mon[26123]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-06-18T01:59:19.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:19 smithi007 ceph-mon[25091]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-06-18T01:59:19.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:19 smithi007 ceph-mon[29879]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-06-18T01:59:20.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:20 smithi130 ceph-mon[26123]: from='client.? 172.21.15.130:0/2747406731' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1ef21401-4fcf-4da8-8136-e1e44a29d238"}]: dispatch 2024-06-18T01:59:20.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:20 smithi130 ceph-mon[26123]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1ef21401-4fcf-4da8-8136-e1e44a29d238"}]: dispatch 2024-06-18T01:59:20.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:20 smithi130 ceph-mon[26123]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1ef21401-4fcf-4da8-8136-e1e44a29d238"}]': finished 2024-06-18T01:59:20.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:20 smithi130 ceph-mon[26123]: osdmap e28: 5 total, 4 up, 5 in 2024-06-18T01:59:20.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:20 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-18T01:59:20.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:20 smithi130 ceph-mon[26123]: from='client.? 172.21.15.130:0/2201297507' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-18T01:59:20.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:20 smithi007 ceph-mon[25091]: from='client.? 172.21.15.130:0/2747406731' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1ef21401-4fcf-4da8-8136-e1e44a29d238"}]: dispatch 2024-06-18T01:59:20.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:20 smithi007 ceph-mon[25091]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1ef21401-4fcf-4da8-8136-e1e44a29d238"}]: dispatch 2024-06-18T01:59:20.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:20 smithi007 ceph-mon[25091]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1ef21401-4fcf-4da8-8136-e1e44a29d238"}]': finished 2024-06-18T01:59:20.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:20 smithi007 ceph-mon[25091]: osdmap e28: 5 total, 4 up, 5 in 2024-06-18T01:59:20.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:20 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-18T01:59:20.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:20 smithi007 ceph-mon[25091]: from='client.? 172.21.15.130:0/2201297507' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-18T01:59:20.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:20 smithi007 ceph-mon[29879]: from='client.? 172.21.15.130:0/2747406731' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1ef21401-4fcf-4da8-8136-e1e44a29d238"}]: dispatch 2024-06-18T01:59:20.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:20 smithi007 ceph-mon[29879]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1ef21401-4fcf-4da8-8136-e1e44a29d238"}]: dispatch 2024-06-18T01:59:20.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:20 smithi007 ceph-mon[29879]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1ef21401-4fcf-4da8-8136-e1e44a29d238"}]': finished 2024-06-18T01:59:20.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:20 smithi007 ceph-mon[29879]: osdmap e28: 5 total, 4 up, 5 in 2024-06-18T01:59:20.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:20 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-18T01:59:20.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:20 smithi007 ceph-mon[29879]: from='client.? 172.21.15.130:0/2201297507' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-18T01:59:21.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:21 smithi130 ceph-mon[26123]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-06-18T01:59:21.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:21 smithi007 ceph-mon[25091]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-06-18T01:59:21.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:21 smithi007 ceph-mon[29879]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-06-18T01:59:23.697 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:23 smithi130 ceph-mon[26123]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-06-18T01:59:23.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:23 smithi007 ceph-mon[25091]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-06-18T01:59:23.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:23 smithi007 ceph-mon[29879]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-06-18T01:59:25.742 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:25 smithi130 ceph-mon[26123]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-06-18T01:59:25.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:25 smithi007 ceph-mon[25091]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-06-18T01:59:25.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:25 smithi007 ceph-mon[29879]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-06-18T01:59:26.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:26 smithi130 ceph-mon[26123]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-06-18T01:59:26.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:26 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-06-18T01:59:26.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:26 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:59:26.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:26 smithi130 ceph-mon[26123]: Deploying daemon osd.4 on smithi130 2024-06-18T01:59:26.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:26 smithi007 ceph-mon[25091]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-06-18T01:59:26.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:26 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-06-18T01:59:26.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:26 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:59:26.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:26 smithi007 ceph-mon[25091]: Deploying daemon osd.4 on smithi130 2024-06-18T01:59:26.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:26 smithi007 ceph-mon[29879]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-06-18T01:59:26.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:26 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-06-18T01:59:26.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:26 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:59:26.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:26 smithi007 ceph-mon[29879]: Deploying daemon osd.4 on smithi130 2024-06-18T01:59:29.259 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:29 smithi130 ceph-mon[26123]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-06-18T01:59:29.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:29 smithi007 ceph-mon[25091]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-06-18T01:59:29.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:29 smithi007 ceph-mon[29879]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-06-18T01:59:29.854 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:59:29 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.7 - - [18/Jun/2024:01:59:29] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T01:59:30.931 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:30 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:30.931 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:30 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:30.931 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:30 smithi130 ceph-mon[26123]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-06-18T01:59:30.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:30 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:30.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:30 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:30.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:30 smithi007 ceph-mon[25091]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-06-18T01:59:30.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:30 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:30.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:30 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:30.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:30 smithi007 ceph-mon[29879]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-06-18T01:59:32.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:32 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:32.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:32 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:59:32.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:32 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:59:32.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:32 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:59:32.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:32 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:32.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:32 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:32.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:32 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:59:32.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:32 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:59:32.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:32 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:59:32.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:32 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:32.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:32 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:32.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:32 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:59:32.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:32 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:59:32.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:32 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:59:32.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:32 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:33.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:33 smithi130 ceph-mon[26123]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-06-18T01:59:33.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:33 smithi007 ceph-mon[25091]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-06-18T01:59:33.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:33 smithi007 ceph-mon[29879]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-06-18T01:59:34.339 INFO:teuthology.orchestra.run.smithi130.stdout:Created osd(s) 4 on host 'smithi130' 2024-06-18T01:59:34.951 DEBUG:teuthology.orchestra.run.smithi130:osd.4> sudo journalctl -f -n 0 -u ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.4.service 2024-06-18T01:59:34.954 INFO:tasks.cephadm:Deploying osd.5 on smithi130 with /dev/vg_nvme/lv_3... 2024-06-18T01:59:34.954 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-06-18T01:59:35.620 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:35 smithi130 ceph-mon[26123]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-06-18T01:59:35.620 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:35 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:35.620 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:35 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:59:35.620 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:35 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:59:35.620 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:35 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:59:35.620 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:35 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-18T01:59:35.620 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:35 smithi130 ceph-mon[26123]: Adjusting osd_memory_target on smithi130 to 16064M 2024-06-18T01:59:35.620 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:35 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:35.620 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:35 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:35.620 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:35 smithi130 ceph-mon[26123]: from='osd.4 [v2:172.21.15.130:6800/626781335,v1:172.21.15.130:6801/626781335]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-18T01:59:35.620 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:35 smithi130 ceph-mon[26123]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-18T01:59:35.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:35 smithi007 ceph-mon[29879]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-06-18T01:59:35.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:35 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:35.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:35 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:59:35.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:35 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:59:35.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:35 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:59:35.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:35 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-18T01:59:35.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:35 smithi007 ceph-mon[29879]: Adjusting osd_memory_target on smithi130 to 16064M 2024-06-18T01:59:35.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:35 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:35.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:35 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:35.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:35 smithi007 ceph-mon[29879]: from='osd.4 [v2:172.21.15.130:6800/626781335,v1:172.21.15.130:6801/626781335]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-18T01:59:35.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:35 smithi007 ceph-mon[29879]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-18T01:59:35.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:35 smithi007 ceph-mon[25091]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-06-18T01:59:35.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:35 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:35.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:35 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:59:35.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:35 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:59:35.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:35 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:59:35.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:35 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-18T01:59:35.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:35 smithi007 ceph-mon[25091]: Adjusting osd_memory_target on smithi130 to 16064M 2024-06-18T01:59:35.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:35 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:35.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:35 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:35.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:35 smithi007 ceph-mon[25091]: from='osd.4 [v2:172.21.15.130:6800/626781335,v1:172.21.15.130:6801/626781335]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-18T01:59:35.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:35 smithi007 ceph-mon[25091]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-18T01:59:36.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:36 smithi130 ceph-mon[26123]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-06-18T01:59:36.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:36 smithi130 ceph-mon[26123]: osdmap e29: 5 total, 4 up, 5 in 2024-06-18T01:59:36.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:36 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-18T01:59:36.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:36 smithi130 ceph-mon[26123]: from='osd.4 [v2:172.21.15.130:6800/626781335,v1:172.21.15.130:6801/626781335]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T01:59:36.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:36 smithi130 ceph-mon[26123]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T01:59:36.794 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 01:59:36 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4[30805]: 2024-06-18T01:59:36.544+0000 7f063dba6700 -1 osd.4 0 waiting for initial osdmap 2024-06-18T01:59:36.794 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 01:59:36 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4[30805]: 2024-06-18T01:59:36.548+0000 7f0638d3e700 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-18T01:59:36.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:36 smithi007 ceph-mon[25091]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-06-18T01:59:36.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:36 smithi007 ceph-mon[25091]: osdmap e29: 5 total, 4 up, 5 in 2024-06-18T01:59:36.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:36 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-18T01:59:36.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:36 smithi007 ceph-mon[25091]: from='osd.4 [v2:172.21.15.130:6800/626781335,v1:172.21.15.130:6801/626781335]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T01:59:36.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:36 smithi007 ceph-mon[25091]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T01:59:36.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:36 smithi007 ceph-mon[29879]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-06-18T01:59:36.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:36 smithi007 ceph-mon[29879]: osdmap e29: 5 total, 4 up, 5 in 2024-06-18T01:59:36.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:36 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-18T01:59:36.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:36 smithi007 ceph-mon[29879]: from='osd.4 [v2:172.21.15.130:6800/626781335,v1:172.21.15.130:6801/626781335]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T01:59:36.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:36 smithi007 ceph-mon[29879]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T01:59:37.002 INFO:teuthology.orchestra.run.smithi130.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-06-18T01:59:37.002 INFO:teuthology.orchestra.run.smithi130.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-06-18T01:59:37.002 INFO:teuthology.orchestra.run.smithi130.stderr: stderr: 10+0 records in 2024-06-18T01:59:37.002 INFO:teuthology.orchestra.run.smithi130.stderr:10+0 records out 2024-06-18T01:59:37.002 INFO:teuthology.orchestra.run.smithi130.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0121749 s, 861 MB/s 2024-06-18T01:59:37.002 INFO:teuthology.orchestra.run.smithi130.stderr: stderr: 2024-06-18T01:59:37.003 INFO:teuthology.orchestra.run.smithi130.stderr:--> Zapping successful for: 2024-06-18T01:59:37.596 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:37 smithi130 ceph-mon[26123]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-06-18T01:59:37.596 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:37 smithi130 ceph-mon[26123]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-06-18T01:59:37.596 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:37 smithi130 ceph-mon[26123]: osdmap e30: 5 total, 4 up, 5 in 2024-06-18T01:59:37.596 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:37 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-18T01:59:37.596 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:37 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-18T01:59:37.596 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:37 smithi130 ceph-mon[26123]: osd.4 [v2:172.21.15.130:6800/626781335,v1:172.21.15.130:6801/626781335] boot 2024-06-18T01:59:37.596 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:37 smithi130 ceph-mon[26123]: osdmap e31: 5 total, 5 up, 5 in 2024-06-18T01:59:37.596 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:37 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-18T01:59:37.620 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph orch daemon add osd smithi130:vg_nvme/lv_3 2024-06-18T01:59:37.896 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:59:37 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.130 - - [18/Jun/2024:01:59:37] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T01:59:37.897 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:37 smithi007 ceph-mon[25091]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-06-18T01:59:37.897 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:37 smithi007 ceph-mon[25091]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-06-18T01:59:37.897 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:37 smithi007 ceph-mon[25091]: osdmap e30: 5 total, 4 up, 5 in 2024-06-18T01:59:37.897 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:37 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-18T01:59:37.897 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:37 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-18T01:59:37.897 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:37 smithi007 ceph-mon[25091]: osd.4 [v2:172.21.15.130:6800/626781335,v1:172.21.15.130:6801/626781335] boot 2024-06-18T01:59:37.897 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:37 smithi007 ceph-mon[25091]: osdmap e31: 5 total, 5 up, 5 in 2024-06-18T01:59:37.897 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:37 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-18T01:59:37.898 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:37 smithi007 ceph-mon[29879]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-06-18T01:59:37.898 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:37 smithi007 ceph-mon[29879]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-06-18T01:59:37.898 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:37 smithi007 ceph-mon[29879]: osdmap e30: 5 total, 4 up, 5 in 2024-06-18T01:59:37.898 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:37 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-18T01:59:37.898 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:37 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-18T01:59:37.898 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:37 smithi007 ceph-mon[29879]: osd.4 [v2:172.21.15.130:6800/626781335,v1:172.21.15.130:6801/626781335] boot 2024-06-18T01:59:37.898 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:37 smithi007 ceph-mon[29879]: osdmap e31: 5 total, 5 up, 5 in 2024-06-18T01:59:37.898 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:37 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-18T01:59:38.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:38 smithi007 ceph-mon[25091]: purged_snaps scrub starts 2024-06-18T01:59:38.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:38 smithi007 ceph-mon[25091]: purged_snaps scrub ok 2024-06-18T01:59:38.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:38 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:38.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:38 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:38.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:38 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:59:38.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:38 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:59:38.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:38 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:59:38.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:38 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:38.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:38 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-06-18T01:59:38.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:38 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-06-18T01:59:38.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:38 smithi007 ceph-mon[25091]: osdmap e32: 5 total, 5 up, 5 in 2024-06-18T01:59:38.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:38 smithi007 ceph-mon[29879]: purged_snaps scrub starts 2024-06-18T01:59:38.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:38 smithi007 ceph-mon[29879]: purged_snaps scrub ok 2024-06-18T01:59:38.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:38 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:38.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:38 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:38.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:38 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:59:38.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:38 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:59:38.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:38 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:59:38.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:38 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:38.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:38 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-06-18T01:59:38.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:38 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-06-18T01:59:38.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:38 smithi007 ceph-mon[29879]: osdmap e32: 5 total, 5 up, 5 in 2024-06-18T01:59:39.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:38 smithi130 ceph-mon[26123]: purged_snaps scrub starts 2024-06-18T01:59:39.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:38 smithi130 ceph-mon[26123]: purged_snaps scrub ok 2024-06-18T01:59:39.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:38 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:39.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:38 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:39.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:38 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:59:39.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:38 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:59:39.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:38 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:59:39.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:38 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:39.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:38 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-06-18T01:59:39.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:38 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-06-18T01:59:39.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:38 smithi130 ceph-mon[26123]: osdmap e32: 5 total, 5 up, 5 in 2024-06-18T01:59:39.780 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:39 smithi130 ceph-mon[26123]: Detected new or changed devices on smithi130 2024-06-18T01:59:39.780 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:39 smithi130 ceph-mon[26123]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2024-06-18T01:59:39.780 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:39 smithi130 ceph-mon[26123]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-06-18T01:59:39.780 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:39 smithi130 ceph-mon[26123]: osdmap e33: 5 total, 5 up, 5 in 2024-06-18T01:59:39.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:39 smithi007 ceph-mon[25091]: Detected new or changed devices on smithi130 2024-06-18T01:59:39.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:39 smithi007 ceph-mon[25091]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2024-06-18T01:59:39.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:39 smithi007 ceph-mon[25091]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-06-18T01:59:39.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:39 smithi007 ceph-mon[25091]: osdmap e33: 5 total, 5 up, 5 in 2024-06-18T01:59:39.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:39 smithi007 ceph-mon[29879]: Detected new or changed devices on smithi130 2024-06-18T01:59:39.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:39 smithi007 ceph-mon[29879]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2024-06-18T01:59:39.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:39 smithi007 ceph-mon[29879]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-06-18T01:59:39.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:39 smithi007 ceph-mon[29879]: osdmap e33: 5 total, 5 up, 5 in 2024-06-18T01:59:40.432 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:59:40 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.130 - - [18/Jun/2024:01:59:40] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T01:59:41.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:41 smithi007 ceph-mon[25091]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2024-06-18T01:59:41.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:41 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:41.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:41 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:41.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:41 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:59:41.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:41 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:59:41.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:41 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:59:41.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:41 smithi007 ceph-mon[25091]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2024-06-18T01:59:41.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:41 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:41.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:41 smithi007 ceph-mon[25091]: from='client.24242 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T01:59:41.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:41 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-18T01:59:41.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:41 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-18T01:59:41.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:41 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:59:41.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:41 smithi007 ceph-mon[25091]: osdmap e34: 5 total, 5 up, 5 in 2024-06-18T01:59:41.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:41 smithi007 ceph-mon[25091]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-06-18T01:59:41.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:41 smithi007 ceph-mon[25091]: Cluster is now healthy 2024-06-18T01:59:41.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:41 smithi007 ceph-mon[29879]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2024-06-18T01:59:41.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:41 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:41.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:41 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:41.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:41 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:59:41.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:41 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:59:41.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:41 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:59:41.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:41 smithi007 ceph-mon[29879]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2024-06-18T01:59:41.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:41 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:41.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:41 smithi007 ceph-mon[29879]: from='client.24242 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T01:59:41.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:41 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-18T01:59:41.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:41 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-18T01:59:41.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:41 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:59:41.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:41 smithi007 ceph-mon[29879]: osdmap e34: 5 total, 5 up, 5 in 2024-06-18T01:59:41.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:41 smithi007 ceph-mon[29879]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-06-18T01:59:41.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:41 smithi007 ceph-mon[29879]: Cluster is now healthy 2024-06-18T01:59:41.497 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:41 smithi130 ceph-mon[26123]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2024-06-18T01:59:41.497 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:41 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:41.497 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:41 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:41.497 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:41 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:59:41.497 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:41 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:59:41.497 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:41 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:59:41.497 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:41 smithi130 ceph-mon[26123]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2024-06-18T01:59:41.498 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:41 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:41.498 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:41 smithi130 ceph-mon[26123]: from='client.24242 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T01:59:41.498 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:41 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-18T01:59:41.498 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:41 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-18T01:59:41.498 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:41 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:59:41.498 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:41 smithi130 ceph-mon[26123]: osdmap e34: 5 total, 5 up, 5 in 2024-06-18T01:59:41.498 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:41 smithi130 ceph-mon[26123]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-06-18T01:59:41.498 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:41 smithi130 ceph-mon[26123]: Cluster is now healthy 2024-06-18T01:59:42.790 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:42 smithi130 ceph-mon[26123]: osdmap e35: 5 total, 5 up, 5 in 2024-06-18T01:59:42.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:42 smithi007 ceph-mon[25091]: osdmap e35: 5 total, 5 up, 5 in 2024-06-18T01:59:42.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:42 smithi007 ceph-mon[29879]: osdmap e35: 5 total, 5 up, 5 in 2024-06-18T01:59:43.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:43 smithi007 ceph-mon[25091]: pgmap v119: 1 pgs: 1 peering; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 142 KiB/s, 0 objects/s recovering 2024-06-18T01:59:43.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:43 smithi007 ceph-mon[25091]: from='client.? 172.21.15.130:0/886772594' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "56d30fd0-94e8-4f04-8a7b-fa3e1078eb8d"}]: dispatch 2024-06-18T01:59:43.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:43 smithi007 ceph-mon[25091]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "56d30fd0-94e8-4f04-8a7b-fa3e1078eb8d"}]: dispatch 2024-06-18T01:59:43.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:43 smithi007 ceph-mon[25091]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "56d30fd0-94e8-4f04-8a7b-fa3e1078eb8d"}]': finished 2024-06-18T01:59:43.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:43 smithi007 ceph-mon[25091]: osdmap e36: 6 total, 5 up, 6 in 2024-06-18T01:59:43.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:43 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-18T01:59:43.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:43 smithi007 ceph-mon[29879]: pgmap v119: 1 pgs: 1 peering; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 142 KiB/s, 0 objects/s recovering 2024-06-18T01:59:43.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:43 smithi007 ceph-mon[29879]: from='client.? 172.21.15.130:0/886772594' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "56d30fd0-94e8-4f04-8a7b-fa3e1078eb8d"}]: dispatch 2024-06-18T01:59:43.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:43 smithi007 ceph-mon[29879]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "56d30fd0-94e8-4f04-8a7b-fa3e1078eb8d"}]: dispatch 2024-06-18T01:59:43.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:43 smithi007 ceph-mon[29879]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "56d30fd0-94e8-4f04-8a7b-fa3e1078eb8d"}]': finished 2024-06-18T01:59:43.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:43 smithi007 ceph-mon[29879]: osdmap e36: 6 total, 5 up, 6 in 2024-06-18T01:59:43.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:43 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-18T01:59:44.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:43 smithi130 ceph-mon[26123]: pgmap v119: 1 pgs: 1 peering; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 142 KiB/s, 0 objects/s recovering 2024-06-18T01:59:44.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:43 smithi130 ceph-mon[26123]: from='client.? 172.21.15.130:0/886772594' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "56d30fd0-94e8-4f04-8a7b-fa3e1078eb8d"}]: dispatch 2024-06-18T01:59:44.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:43 smithi130 ceph-mon[26123]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "56d30fd0-94e8-4f04-8a7b-fa3e1078eb8d"}]: dispatch 2024-06-18T01:59:44.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:43 smithi130 ceph-mon[26123]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "56d30fd0-94e8-4f04-8a7b-fa3e1078eb8d"}]': finished 2024-06-18T01:59:44.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:43 smithi130 ceph-mon[26123]: osdmap e36: 6 total, 5 up, 6 in 2024-06-18T01:59:44.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:43 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-18T01:59:44.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:44 smithi007 ceph-mon[25091]: from='client.? 172.21.15.130:0/920453407' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-18T01:59:44.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:44 smithi007 ceph-mon[29879]: from='client.? 172.21.15.130:0/920453407' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-18T01:59:45.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:44 smithi130 ceph-mon[26123]: from='client.? 172.21.15.130:0/920453407' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-18T01:59:45.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:45 smithi007 ceph-mon[25091]: pgmap v121: 1 pgs: 1 peering; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 114 KiB/s, 0 objects/s recovering 2024-06-18T01:59:45.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:45 smithi007 ceph-mon[29879]: pgmap v121: 1 pgs: 1 peering; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 114 KiB/s, 0 objects/s recovering 2024-06-18T01:59:45.995 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:45 smithi130 ceph-mon[26123]: pgmap v121: 1 pgs: 1 peering; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 114 KiB/s, 0 objects/s recovering 2024-06-18T01:59:46.695 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:46 smithi130 ceph-mon[26123]: pgmap v122: 1 pgs: 1 peering; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-06-18T01:59:46.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:46 smithi007 ceph-mon[25091]: pgmap v122: 1 pgs: 1 peering; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-06-18T01:59:46.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:46 smithi007 ceph-mon[29879]: pgmap v122: 1 pgs: 1 peering; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-06-18T01:59:49.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:49 smithi130 ceph-mon[26123]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-06-18T01:59:49.573 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:49 smithi007 ceph-mon[25091]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-06-18T01:59:49.573 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:49 smithi007 ceph-mon[29879]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-06-18T01:59:49.901 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 01:59:49 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.7 - - [18/Jun/2024:01:59:49] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T01:59:51.143 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:50 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:51.143 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:50 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:51.143 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:50 smithi130 ceph-mon[26123]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-06-18T01:59:51.143 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:50 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-06-18T01:59:51.143 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:50 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:59:51.143 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:50 smithi130 ceph-mon[26123]: Deploying daemon osd.5 on smithi130 2024-06-18T01:59:51.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:50 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:51.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:50 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:51.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:50 smithi007 ceph-mon[25091]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-06-18T01:59:51.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:50 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-06-18T01:59:51.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:50 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:59:51.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:50 smithi007 ceph-mon[25091]: Deploying daemon osd.5 on smithi130 2024-06-18T01:59:51.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:50 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:51.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:50 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:51.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:50 smithi007 ceph-mon[29879]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-06-18T01:59:51.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:50 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-06-18T01:59:51.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:50 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:59:51.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:50 smithi007 ceph-mon[29879]: Deploying daemon osd.5 on smithi130 2024-06-18T01:59:53.453 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:53 smithi130 ceph-mon[26123]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-06-18T01:59:53.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:53 smithi007 ceph-mon[25091]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-06-18T01:59:53.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:53 smithi007 ceph-mon[29879]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-06-18T01:59:55.335 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:55 smithi130 ceph-mon[26123]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-06-18T01:59:55.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:55 smithi007 ceph-mon[25091]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-06-18T01:59:55.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:55 smithi007 ceph-mon[29879]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-06-18T01:59:57.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:56 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:57.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:56 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:59:57.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:56 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:59:57.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:56 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:59:57.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:56 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:57.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:56 smithi130 ceph-mon[26123]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-06-18T01:59:57.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:56 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:57.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:56 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:59:57.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:56 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:59:57.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:56 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:59:57.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:56 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:57.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:56 smithi007 ceph-mon[25091]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-06-18T01:59:57.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:56 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:57.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:56 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:59:57.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:56 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:59:57.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:56 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:59:57.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:56 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:57.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:56 smithi007 ceph-mon[29879]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-06-18T01:59:58.476 INFO:teuthology.orchestra.run.smithi130.stdout:Created osd(s) 5 on host 'smithi130' 2024-06-18T01:59:59.091 DEBUG:teuthology.orchestra.run.smithi130:osd.5> sudo journalctl -f -n 0 -u ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.5.service 2024-06-18T01:59:59.094 INFO:tasks.cephadm:Deploying osd.6 on smithi130 with /dev/vg_nvme/lv_2... 2024-06-18T01:59:59.094 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-06-18T01:59:59.708 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:59 smithi130 ceph-mon[26123]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-06-18T01:59:59.708 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:59 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:59.708 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:59 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:59:59.708 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:59 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:59:59.708 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:59 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:59:59.708 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:59 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-18T01:59:59.708 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:59 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-18T01:59:59.708 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:59 smithi130 ceph-mon[26123]: Adjusting osd_memory_target on smithi130 to 8032M 2024-06-18T01:59:59.708 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:59 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:59.708 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:59 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:59.708 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:59 smithi130 ceph-mon[26123]: from='osd.5 [v2:172.21.15.130:6808/4245072316,v1:172.21.15.130:6809/4245072316]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-18T01:59:59.708 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 01:59:59 smithi130 ceph-mon[26123]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-18T01:59:59.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:59 smithi007 ceph-mon[25091]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-06-18T01:59:59.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:59 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:59.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:59 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:59:59.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:59 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:59:59.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:59 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:59:59.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:59 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-18T01:59:59.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:59 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-18T01:59:59.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:59 smithi007 ceph-mon[25091]: Adjusting osd_memory_target on smithi130 to 8032M 2024-06-18T01:59:59.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:59 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:59.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:59 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:59.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:59 smithi007 ceph-mon[25091]: from='osd.5 [v2:172.21.15.130:6808/4245072316,v1:172.21.15.130:6809/4245072316]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-18T01:59:59.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 01:59:59 smithi007 ceph-mon[25091]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-18T01:59:59.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:59 smithi007 ceph-mon[29879]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-06-18T01:59:59.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:59 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:59.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:59 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T01:59:59.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:59 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T01:59:59.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:59 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T01:59:59.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:59 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-18T01:59:59.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:59 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-18T01:59:59.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:59 smithi007 ceph-mon[29879]: Adjusting osd_memory_target on smithi130 to 8032M 2024-06-18T01:59:59.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:59 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:59.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:59 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T01:59:59.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:59 smithi007 ceph-mon[29879]: from='osd.5 [v2:172.21.15.130:6808/4245072316,v1:172.21.15.130:6809/4245072316]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-18T01:59:59.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 01:59:59 smithi007 ceph-mon[29879]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-18T02:00:00.431 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:00:00 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.130 - - [18/Jun/2024:02:00:00] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:00:00.701 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:00 smithi130 ceph-mon[26123]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-06-18T02:00:00.702 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:00 smithi130 ceph-mon[26123]: osdmap e37: 6 total, 5 up, 6 in 2024-06-18T02:00:00.702 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:00 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-18T02:00:00.702 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:00 smithi130 ceph-mon[26123]: from='osd.5 [v2:172.21.15.130:6808/4245072316,v1:172.21.15.130:6809/4245072316]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:00:00.702 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:00 smithi130 ceph-mon[26123]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:00:00.702 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:00 smithi130 ceph-mon[26123]: overall HEALTH_OK 2024-06-18T02:00:00.702 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:00 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:00.702 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:00 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:00.702 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:00 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:00:00.702 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:00 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:00:00.702 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:00 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:00:00.702 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:00 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:00.703 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:00:00 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5[33677]: 2024-06-18T02:00:00.540+0000 7ff070cd5700 -1 osd.5 0 waiting for initial osdmap 2024-06-18T02:00:00.703 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:00:00 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5[33677]: 2024-06-18T02:00:00.545+0000 7ff06b66c700 -1 osd.5 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-18T02:00:00.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:00 smithi007 ceph-mon[25091]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-06-18T02:00:00.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:00 smithi007 ceph-mon[25091]: osdmap e37: 6 total, 5 up, 6 in 2024-06-18T02:00:00.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:00 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-18T02:00:00.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:00 smithi007 ceph-mon[25091]: from='osd.5 [v2:172.21.15.130:6808/4245072316,v1:172.21.15.130:6809/4245072316]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:00:00.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:00 smithi007 ceph-mon[25091]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:00:00.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:00 smithi007 ceph-mon[25091]: overall HEALTH_OK 2024-06-18T02:00:00.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:00 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:00.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:00 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:00.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:00 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:00:00.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:00 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:00:00.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:00 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:00:00.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:00 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:00.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:00 smithi007 ceph-mon[29879]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-06-18T02:00:00.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:00 smithi007 ceph-mon[29879]: osdmap e37: 6 total, 5 up, 6 in 2024-06-18T02:00:00.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:00 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-18T02:00:00.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:00 smithi007 ceph-mon[29879]: from='osd.5 [v2:172.21.15.130:6808/4245072316,v1:172.21.15.130:6809/4245072316]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:00:00.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:00 smithi007 ceph-mon[29879]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:00:00.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:00 smithi007 ceph-mon[29879]: overall HEALTH_OK 2024-06-18T02:00:00.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:00 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:00.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:00 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:00.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:00 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:00:00.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:00 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:00:00.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:00 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:00:00.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:00 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:01.214 INFO:teuthology.orchestra.run.smithi130.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-06-18T02:00:01.214 INFO:teuthology.orchestra.run.smithi130.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-06-18T02:00:01.214 INFO:teuthology.orchestra.run.smithi130.stderr: stderr: 10+0 records in 2024-06-18T02:00:01.214 INFO:teuthology.orchestra.run.smithi130.stderr:10+0 records out 2024-06-18T02:00:01.214 INFO:teuthology.orchestra.run.smithi130.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0149371 s, 702 MB/s 2024-06-18T02:00:01.214 INFO:teuthology.orchestra.run.smithi130.stderr:--> Zapping successful for: 2024-06-18T02:00:01.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:01 smithi130 ceph-mon[26123]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-06-18T02:00:01.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:01 smithi130 ceph-mon[26123]: Detected new or changed devices on smithi130 2024-06-18T02:00:01.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:01 smithi130 ceph-mon[26123]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-06-18T02:00:01.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:01 smithi130 ceph-mon[26123]: osdmap e38: 6 total, 5 up, 6 in 2024-06-18T02:00:01.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:01 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-18T02:00:01.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:01 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-18T02:00:01.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:01 smithi130 ceph-mon[26123]: osd.5 [v2:172.21.15.130:6808/4245072316,v1:172.21.15.130:6809/4245072316] boot 2024-06-18T02:00:01.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:01 smithi130 ceph-mon[26123]: osdmap e39: 6 total, 6 up, 6 in 2024-06-18T02:00:01.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:01 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-18T02:00:01.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:01 smithi007 ceph-mon[25091]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-06-18T02:00:01.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:01 smithi007 ceph-mon[25091]: Detected new or changed devices on smithi130 2024-06-18T02:00:01.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:01 smithi007 ceph-mon[25091]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-06-18T02:00:01.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:01 smithi007 ceph-mon[25091]: osdmap e38: 6 total, 5 up, 6 in 2024-06-18T02:00:01.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:01 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-18T02:00:01.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:01 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-18T02:00:01.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:01 smithi007 ceph-mon[25091]: osd.5 [v2:172.21.15.130:6808/4245072316,v1:172.21.15.130:6809/4245072316] boot 2024-06-18T02:00:01.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:01 smithi007 ceph-mon[25091]: osdmap e39: 6 total, 6 up, 6 in 2024-06-18T02:00:01.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:01 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-18T02:00:01.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:01 smithi007 ceph-mon[29879]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-06-18T02:00:01.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:01 smithi007 ceph-mon[29879]: Detected new or changed devices on smithi130 2024-06-18T02:00:01.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:01 smithi007 ceph-mon[29879]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-06-18T02:00:01.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:01 smithi007 ceph-mon[29879]: osdmap e38: 6 total, 5 up, 6 in 2024-06-18T02:00:01.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:01 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-18T02:00:01.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:01 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-18T02:00:01.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:01 smithi007 ceph-mon[29879]: osd.5 [v2:172.21.15.130:6808/4245072316,v1:172.21.15.130:6809/4245072316] boot 2024-06-18T02:00:01.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:01 smithi007 ceph-mon[29879]: osdmap e39: 6 total, 6 up, 6 in 2024-06-18T02:00:01.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:01 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-18T02:00:02.182 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph orch daemon add osd smithi130:vg_nvme/lv_2 2024-06-18T02:00:02.675 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:00:02 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.130 - - [18/Jun/2024:02:00:02] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:00:02.680 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:02 smithi130 ceph-mon[26123]: purged_snaps scrub starts 2024-06-18T02:00:02.681 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:02 smithi130 ceph-mon[26123]: purged_snaps scrub ok 2024-06-18T02:00:02.681 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:02 smithi130 ceph-mon[26123]: osdmap e40: 6 total, 6 up, 6 in 2024-06-18T02:00:02.681 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:02 smithi130 ceph-mon[26123]: pgmap v134: 1 pgs: 1 remapped+peering; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-06-18T02:00:02.681 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:02 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:02.681 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:02 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:02.682 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:02 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:00:02.682 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:02 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:00:02.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:02 smithi007 ceph-mon[25091]: purged_snaps scrub starts 2024-06-18T02:00:02.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:02 smithi007 ceph-mon[25091]: purged_snaps scrub ok 2024-06-18T02:00:02.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:02 smithi007 ceph-mon[25091]: osdmap e40: 6 total, 6 up, 6 in 2024-06-18T02:00:02.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:02 smithi007 ceph-mon[25091]: pgmap v134: 1 pgs: 1 remapped+peering; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-06-18T02:00:02.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:02 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:02.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:02 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:02.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:02 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:00:02.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:02 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:00:02.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:02 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:00:02.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:02 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:02.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:02 smithi007 ceph-mon[29879]: purged_snaps scrub starts 2024-06-18T02:00:02.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:02 smithi007 ceph-mon[29879]: purged_snaps scrub ok 2024-06-18T02:00:02.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:02 smithi007 ceph-mon[29879]: osdmap e40: 6 total, 6 up, 6 in 2024-06-18T02:00:02.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:02 smithi007 ceph-mon[29879]: pgmap v134: 1 pgs: 1 remapped+peering; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-06-18T02:00:02.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:02 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:02.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:02 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:02.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:02 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:00:02.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:02 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:00:02.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:02 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:00:02.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:02 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:03.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:02 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:00:03.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:02 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:03.693 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:03 smithi130 ceph-mon[26123]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-06-18T02:00:03.693 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:03 smithi130 ceph-mon[26123]: osdmap e41: 6 total, 6 up, 6 in 2024-06-18T02:00:04.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:03 smithi007 ceph-mon[25091]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-06-18T02:00:04.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:03 smithi007 ceph-mon[25091]: osdmap e41: 6 total, 6 up, 6 in 2024-06-18T02:00:04.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:03 smithi007 ceph-mon[29879]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-06-18T02:00:04.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:03 smithi007 ceph-mon[29879]: osdmap e41: 6 total, 6 up, 6 in 2024-06-18T02:00:04.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:04 smithi130 ceph-mon[26123]: osdmap e42: 6 total, 6 up, 6 in 2024-06-18T02:00:04.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:04 smithi130 ceph-mon[26123]: from='client.24269 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:00:04.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:04 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-18T02:00:04.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:04 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-18T02:00:04.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:04 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:00:04.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:04 smithi130 ceph-mon[26123]: pgmap v137: 1 pgs: 1 remapped+peering; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-06-18T02:00:05.083 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:04 smithi007 ceph-mon[25091]: osdmap e42: 6 total, 6 up, 6 in 2024-06-18T02:00:05.083 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:04 smithi007 ceph-mon[25091]: from='client.24269 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:00:05.083 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:04 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-18T02:00:05.083 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:04 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-18T02:00:05.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:04 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:00:05.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:04 smithi007 ceph-mon[25091]: pgmap v137: 1 pgs: 1 remapped+peering; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-06-18T02:00:05.084 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:04 smithi007 ceph-mon[29879]: osdmap e42: 6 total, 6 up, 6 in 2024-06-18T02:00:05.084 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:04 smithi007 ceph-mon[29879]: from='client.24269 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:00:05.084 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:04 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-18T02:00:05.084 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:04 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-18T02:00:05.084 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:04 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:00:05.084 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:04 smithi007 ceph-mon[29879]: pgmap v137: 1 pgs: 1 remapped+peering; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-06-18T02:00:05.970 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:05 smithi130 ceph-mon[26123]: osdmap e43: 6 total, 6 up, 6 in 2024-06-18T02:00:06.096 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:05 smithi007 ceph-mon[25091]: osdmap e43: 6 total, 6 up, 6 in 2024-06-18T02:00:06.096 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:05 smithi007 ceph-mon[29879]: osdmap e43: 6 total, 6 up, 6 in 2024-06-18T02:00:06.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:06 smithi007 ceph-mon[25091]: pgmap v139: 1 pgs: 1 remapped+peering; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-06-18T02:00:06.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:06 smithi007 ceph-mon[29879]: pgmap v139: 1 pgs: 1 remapped+peering; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-06-18T02:00:07.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:06 smithi130 ceph-mon[26123]: pgmap v139: 1 pgs: 1 remapped+peering; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-06-18T02:00:08.395 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:08 smithi130 ceph-mon[26123]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-06-18T02:00:08.396 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:08 smithi130 ceph-mon[26123]: Cluster is now healthy 2024-06-18T02:00:08.501 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:08 smithi007 ceph-mon[25091]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-06-18T02:00:08.501 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:08 smithi007 ceph-mon[25091]: Cluster is now healthy 2024-06-18T02:00:08.501 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:08 smithi007 ceph-mon[29879]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-06-18T02:00:08.502 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:08 smithi007 ceph-mon[29879]: Cluster is now healthy 2024-06-18T02:00:09.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:09 smithi007 ceph-mon[25091]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-06-18T02:00:09.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:09 smithi007 ceph-mon[25091]: from='client.? 172.21.15.130:0/4113873194' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "31a78fc2-4f3b-4eaf-bf58-b257d16be18d"}]: dispatch 2024-06-18T02:00:09.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:09 smithi007 ceph-mon[25091]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "31a78fc2-4f3b-4eaf-bf58-b257d16be18d"}]: dispatch 2024-06-18T02:00:09.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:09 smithi007 ceph-mon[25091]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "31a78fc2-4f3b-4eaf-bf58-b257d16be18d"}]': finished 2024-06-18T02:00:09.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:09 smithi007 ceph-mon[25091]: osdmap e44: 7 total, 6 up, 7 in 2024-06-18T02:00:09.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:09 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-18T02:00:09.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:09 smithi007 ceph-mon[29879]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-06-18T02:00:09.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:09 smithi007 ceph-mon[29879]: from='client.? 172.21.15.130:0/4113873194' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "31a78fc2-4f3b-4eaf-bf58-b257d16be18d"}]: dispatch 2024-06-18T02:00:09.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:09 smithi007 ceph-mon[29879]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "31a78fc2-4f3b-4eaf-bf58-b257d16be18d"}]: dispatch 2024-06-18T02:00:09.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:09 smithi007 ceph-mon[29879]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "31a78fc2-4f3b-4eaf-bf58-b257d16be18d"}]': finished 2024-06-18T02:00:09.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:09 smithi007 ceph-mon[29879]: osdmap e44: 7 total, 6 up, 7 in 2024-06-18T02:00:09.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:09 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-18T02:00:09.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:09 smithi130 ceph-mon[26123]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-06-18T02:00:09.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:09 smithi130 ceph-mon[26123]: from='client.? 172.21.15.130:0/4113873194' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "31a78fc2-4f3b-4eaf-bf58-b257d16be18d"}]: dispatch 2024-06-18T02:00:09.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:09 smithi130 ceph-mon[26123]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "31a78fc2-4f3b-4eaf-bf58-b257d16be18d"}]: dispatch 2024-06-18T02:00:09.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:09 smithi130 ceph-mon[26123]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "31a78fc2-4f3b-4eaf-bf58-b257d16be18d"}]': finished 2024-06-18T02:00:09.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:09 smithi130 ceph-mon[26123]: osdmap e44: 7 total, 6 up, 7 in 2024-06-18T02:00:09.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:09 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-18T02:00:10.181 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:00:09 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.7 - - [18/Jun/2024:02:00:09] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:00:10.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:10 smithi130 ceph-mon[26123]: from='client.? 172.21.15.130:0/3961171184' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-18T02:00:10.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:10 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:10.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:10 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:10.681 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:10 smithi007 ceph-mon[29879]: from='client.? 172.21.15.130:0/3961171184' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-18T02:00:10.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:10 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:10.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:10 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:10.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:10 smithi007 ceph-mon[25091]: from='client.? 172.21.15.130:0/3961171184' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-18T02:00:10.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:10 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:10.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:10 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:11.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:11 smithi130 ceph-mon[26123]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-06-18T02:00:11.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:11 smithi007 ceph-mon[25091]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-06-18T02:00:11.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:11 smithi007 ceph-mon[29879]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-06-18T02:00:13.479 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:13 smithi130 ceph-mon[26123]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-06-18T02:00:13.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:13 smithi007 ceph-mon[25091]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-06-18T02:00:13.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:13 smithi007 ceph-mon[29879]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-06-18T02:00:15.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:15 smithi130 ceph-mon[26123]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-06-18T02:00:15.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:15 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-06-18T02:00:15.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:15 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:00:15.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:15 smithi007 ceph-mon[25091]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-06-18T02:00:15.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:15 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-06-18T02:00:15.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:15 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:00:15.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:15 smithi007 ceph-mon[29879]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-06-18T02:00:15.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:15 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-06-18T02:00:15.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:15 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:00:16.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:16 smithi130 ceph-mon[26123]: Deploying daemon osd.6 on smithi130 2024-06-18T02:00:16.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:16 smithi007 ceph-mon[25091]: Deploying daemon osd.6 on smithi130 2024-06-18T02:00:16.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:16 smithi007 ceph-mon[29879]: Deploying daemon osd.6 on smithi130 2024-06-18T02:00:17.443 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:17 smithi130 ceph-mon[26123]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-06-18T02:00:17.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:17 smithi007 ceph-mon[25091]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-06-18T02:00:17.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:17 smithi007 ceph-mon[29879]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-06-18T02:00:19.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:19 smithi007 ceph-mon[25091]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-06-18T02:00:19.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:19 smithi007 ceph-mon[29879]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-06-18T02:00:19.691 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:19 smithi130 ceph-mon[26123]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-06-18T02:00:21.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:21 smithi130 ceph-mon[26123]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-06-18T02:00:21.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:21 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:21.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:21 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:00:21.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:21 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:00:21.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:21 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:00:21.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:21 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:21.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:21 smithi007 ceph-mon[25091]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-06-18T02:00:21.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:21 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:21.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:21 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:00:21.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:21 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:00:21.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:21 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:00:21.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:21 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:21.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:21 smithi007 ceph-mon[29879]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-06-18T02:00:21.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:21 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:21.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:21 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:00:21.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:21 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:00:21.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:21 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:00:21.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:21 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:22.931 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:00:22 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.130 - - [18/Jun/2024:02:00:22] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:00:23.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:23 smithi130 ceph-mon[26123]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-06-18T02:00:23.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:23 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:23.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:23 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:23.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:23 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:00:23.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:23 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:00:23.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:23 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:00:23.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:23 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:23.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:23 smithi007 ceph-mon[25091]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-06-18T02:00:23.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:23 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:23.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:23 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:23.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:23 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:00:23.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:23 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:00:23.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:23 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:00:23.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:23 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:23.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:23 smithi007 ceph-mon[29879]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-06-18T02:00:23.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:23 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:23.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:23 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:23.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:23 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:00:23.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:23 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:00:23.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:23 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:00:23.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:23 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:24.309 INFO:teuthology.orchestra.run.smithi130.stdout:Created osd(s) 6 on host 'smithi130' 2024-06-18T02:00:24.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:24 smithi130 ceph-mon[26123]: from='osd.6 [v2:172.21.15.130:6816/2703402227,v1:172.21.15.130:6817/2703402227]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-06-18T02:00:24.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:24 smithi130 ceph-mon[26123]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-06-18T02:00:24.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:24 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:24.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:24 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:00:24.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:24 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:00:24.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:24 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:00:24.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:24 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:24.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:24 smithi007 ceph-mon[25091]: from='osd.6 [v2:172.21.15.130:6816/2703402227,v1:172.21.15.130:6817/2703402227]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-06-18T02:00:24.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:24 smithi007 ceph-mon[25091]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-06-18T02:00:24.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:24 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:24.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:24 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:00:24.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:24 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:00:24.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:24 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:00:24.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:24 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:24.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:24 smithi007 ceph-mon[29879]: from='osd.6 [v2:172.21.15.130:6816/2703402227,v1:172.21.15.130:6817/2703402227]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-06-18T02:00:24.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:24 smithi007 ceph-mon[29879]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-06-18T02:00:24.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:24 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:24.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:24 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:00:24.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:24 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:00:24.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:24 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:00:24.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:24 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:24.937 DEBUG:teuthology.orchestra.run.smithi130:osd.6> sudo journalctl -f -n 0 -u ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.6.service 2024-06-18T02:00:24.939 INFO:tasks.cephadm:Deploying osd.7 on smithi130 with /dev/vg_nvme/lv_1... 2024-06-18T02:00:24.940 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-06-18T02:00:25.592 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:25 smithi130 ceph-mon[26123]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-06-18T02:00:25.592 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:25 smithi130 ceph-mon[26123]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-06-18T02:00:25.592 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:25 smithi130 ceph-mon[26123]: osdmap e45: 7 total, 6 up, 7 in 2024-06-18T02:00:25.592 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:25 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-18T02:00:25.592 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:25 smithi130 ceph-mon[26123]: from='osd.6 [v2:172.21.15.130:6816/2703402227,v1:172.21.15.130:6817/2703402227]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:00:25.592 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:25 smithi130 ceph-mon[26123]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:00:25.593 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:00:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[36581]: 2024-06-18T02:00:25.539+0000 7f6e40b19700 -1 osd.6 0 waiting for initial osdmap 2024-06-18T02:00:25.593 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:00:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[36581]: 2024-06-18T02:00:25.546+0000 7f6e37ca9700 -1 osd.6 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-18T02:00:25.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:25 smithi007 ceph-mon[25091]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-06-18T02:00:25.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:25 smithi007 ceph-mon[25091]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-06-18T02:00:25.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:25 smithi007 ceph-mon[25091]: osdmap e45: 7 total, 6 up, 7 in 2024-06-18T02:00:25.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:25 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-18T02:00:25.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:25 smithi007 ceph-mon[25091]: from='osd.6 [v2:172.21.15.130:6816/2703402227,v1:172.21.15.130:6817/2703402227]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:00:25.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:25 smithi007 ceph-mon[25091]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:00:25.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:25 smithi007 ceph-mon[29879]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-06-18T02:00:25.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:25 smithi007 ceph-mon[29879]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-06-18T02:00:25.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:25 smithi007 ceph-mon[29879]: osdmap e45: 7 total, 6 up, 7 in 2024-06-18T02:00:25.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:25 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-18T02:00:25.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:25 smithi007 ceph-mon[29879]: from='osd.6 [v2:172.21.15.130:6816/2703402227,v1:172.21.15.130:6817/2703402227]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:00:25.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:25 smithi007 ceph-mon[29879]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:00:26.431 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:00:26 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.130 - - [18/Jun/2024:02:00:26] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:00:26.666 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:26 smithi130 ceph-mon[26123]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-06-18T02:00:26.666 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:26 smithi130 ceph-mon[26123]: osdmap e46: 7 total, 6 up, 7 in 2024-06-18T02:00:26.666 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:26 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-18T02:00:26.667 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:26 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-18T02:00:26.667 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:26 smithi130 ceph-mon[26123]: osd.6 [v2:172.21.15.130:6816/2703402227,v1:172.21.15.130:6817/2703402227] boot 2024-06-18T02:00:26.667 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:26 smithi130 ceph-mon[26123]: osdmap e47: 7 total, 7 up, 7 in 2024-06-18T02:00:26.667 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:26 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-18T02:00:26.667 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:26 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:26.667 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:26 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:26.667 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:26 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:00:26.667 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:26 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:00:26.667 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:26 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:00:26.667 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:26 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:26.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:26 smithi007 ceph-mon[25091]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-06-18T02:00:26.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:26 smithi007 ceph-mon[25091]: osdmap e46: 7 total, 6 up, 7 in 2024-06-18T02:00:26.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:26 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-18T02:00:26.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:26 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-18T02:00:26.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:26 smithi007 ceph-mon[25091]: osd.6 [v2:172.21.15.130:6816/2703402227,v1:172.21.15.130:6817/2703402227] boot 2024-06-18T02:00:26.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:26 smithi007 ceph-mon[25091]: osdmap e47: 7 total, 7 up, 7 in 2024-06-18T02:00:26.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:26 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-18T02:00:26.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:26 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:26.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:26 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:26.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:26 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:00:26.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:26 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:00:26.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:26 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:00:26.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:26 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:26.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:26 smithi007 ceph-mon[29879]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-06-18T02:00:26.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:26 smithi007 ceph-mon[29879]: osdmap e46: 7 total, 6 up, 7 in 2024-06-18T02:00:26.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:26 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-18T02:00:26.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:26 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-18T02:00:26.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:26 smithi007 ceph-mon[29879]: osd.6 [v2:172.21.15.130:6816/2703402227,v1:172.21.15.130:6817/2703402227] boot 2024-06-18T02:00:26.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:26 smithi007 ceph-mon[29879]: osdmap e47: 7 total, 7 up, 7 in 2024-06-18T02:00:26.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:26 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-18T02:00:26.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:26 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:26.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:26 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:26.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:26 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:00:26.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:26 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:00:26.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:26 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:00:26.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:26 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:27.774 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:27 smithi130 ceph-mon[26123]: purged_snaps scrub starts 2024-06-18T02:00:27.774 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:27 smithi130 ceph-mon[26123]: purged_snaps scrub ok 2024-06-18T02:00:27.774 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:27 smithi130 ceph-mon[26123]: pgmap v153: 1 pgs: 1 remapped+peering; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-06-18T02:00:27.775 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:27 smithi130 ceph-mon[26123]: osdmap e48: 7 total, 7 up, 7 in 2024-06-18T02:00:27.795 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:27 smithi007 ceph-mon[25091]: purged_snaps scrub starts 2024-06-18T02:00:27.795 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:27 smithi007 ceph-mon[25091]: purged_snaps scrub ok 2024-06-18T02:00:27.795 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:27 smithi007 ceph-mon[25091]: pgmap v153: 1 pgs: 1 remapped+peering; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-06-18T02:00:27.795 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:27 smithi007 ceph-mon[25091]: osdmap e48: 7 total, 7 up, 7 in 2024-06-18T02:00:27.796 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:27 smithi007 ceph-mon[29879]: purged_snaps scrub starts 2024-06-18T02:00:27.796 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:27 smithi007 ceph-mon[29879]: purged_snaps scrub ok 2024-06-18T02:00:27.796 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:27 smithi007 ceph-mon[29879]: pgmap v153: 1 pgs: 1 remapped+peering; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-06-18T02:00:27.796 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:27 smithi007 ceph-mon[29879]: osdmap e48: 7 total, 7 up, 7 in 2024-06-18T02:00:27.917 INFO:teuthology.orchestra.run.smithi130.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-06-18T02:00:27.917 INFO:teuthology.orchestra.run.smithi130.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-06-18T02:00:27.917 INFO:teuthology.orchestra.run.smithi130.stderr: stderr: 10+0 records in 2024-06-18T02:00:27.917 INFO:teuthology.orchestra.run.smithi130.stderr:10+0 records out 2024-06-18T02:00:27.917 INFO:teuthology.orchestra.run.smithi130.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0119661 s, 876 MB/s 2024-06-18T02:00:27.917 INFO:teuthology.orchestra.run.smithi130.stderr:--> Zapping successful for: 2024-06-18T02:00:28.735 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph orch daemon add osd smithi130:vg_nvme/lv_1 2024-06-18T02:00:28.743 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:28 smithi007 ceph-mon[25091]: osdmap e49: 7 total, 7 up, 7 in 2024-06-18T02:00:28.743 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:28 smithi007 ceph-mon[25091]: pgmap v156: 1 pgs: 1 remapped+peering; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2024-06-18T02:00:28.743 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:28 smithi007 ceph-mon[29879]: osdmap e49: 7 total, 7 up, 7 in 2024-06-18T02:00:28.743 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:28 smithi007 ceph-mon[29879]: pgmap v156: 1 pgs: 1 remapped+peering; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2024-06-18T02:00:29.038 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:28 smithi130 ceph-mon[26123]: osdmap e49: 7 total, 7 up, 7 in 2024-06-18T02:00:29.038 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:28 smithi130 ceph-mon[26123]: pgmap v156: 1 pgs: 1 remapped+peering; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2024-06-18T02:00:29.997 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:29 smithi007 ceph-mon[25091]: osdmap e50: 7 total, 7 up, 7 in 2024-06-18T02:00:29.997 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:29 smithi007 ceph-mon[29879]: osdmap e50: 7 total, 7 up, 7 in 2024-06-18T02:00:30.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:29 smithi130 ceph-mon[26123]: osdmap e50: 7 total, 7 up, 7 in 2024-06-18T02:00:30.431 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:00:29 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.7 - - [18/Jun/2024:02:00:29] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:00:30.794 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:30 smithi007 ceph-mon[25091]: osdmap e51: 7 total, 7 up, 7 in 2024-06-18T02:00:30.794 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:30 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:30.794 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:30 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:30.794 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:30 smithi007 ceph-mon[25091]: pgmap v159: 1 pgs: 1 remapped+peering; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2024-06-18T02:00:30.794 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:30 smithi007 ceph-mon[29879]: osdmap e51: 7 total, 7 up, 7 in 2024-06-18T02:00:30.794 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:30 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:30.794 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:30 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:30.795 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:30 smithi007 ceph-mon[29879]: pgmap v159: 1 pgs: 1 remapped+peering; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2024-06-18T02:00:31.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:30 smithi130 ceph-mon[26123]: osdmap e51: 7 total, 7 up, 7 in 2024-06-18T02:00:31.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:30 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:31.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:30 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:31.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:30 smithi130 ceph-mon[26123]: pgmap v159: 1 pgs: 1 remapped+peering; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2024-06-18T02:00:31.989 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:31 smithi007 ceph-mon[25091]: from='client.24296 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:00:31.989 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:31 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-18T02:00:31.989 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:31 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-18T02:00:31.989 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:31 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:00:31.989 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:31 smithi007 ceph-mon[29879]: from='client.24296 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:00:31.989 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:31 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-18T02:00:31.989 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:31 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-18T02:00:31.990 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:31 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:00:32.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:31 smithi130 ceph-mon[26123]: from='client.24296 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:00:32.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:31 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-18T02:00:32.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:31 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-18T02:00:32.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:31 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:00:33.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:32 smithi130 ceph-mon[26123]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-06-18T02:00:33.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:32 smithi007 ceph-mon[25091]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-06-18T02:00:33.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:32 smithi007 ceph-mon[29879]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-06-18T02:00:34.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:33 smithi130 ceph-mon[26123]: from='client.? 172.21.15.130:0/1774072482' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cae59855-0c86-4a06-bc4e-fbee75a57976"}]: dispatch 2024-06-18T02:00:34.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:33 smithi130 ceph-mon[26123]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cae59855-0c86-4a06-bc4e-fbee75a57976"}]: dispatch 2024-06-18T02:00:34.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:33 smithi130 ceph-mon[26123]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cae59855-0c86-4a06-bc4e-fbee75a57976"}]': finished 2024-06-18T02:00:34.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:33 smithi130 ceph-mon[26123]: osdmap e52: 8 total, 7 up, 8 in 2024-06-18T02:00:34.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:33 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-18T02:00:34.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:33 smithi007 ceph-mon[25091]: from='client.? 172.21.15.130:0/1774072482' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cae59855-0c86-4a06-bc4e-fbee75a57976"}]: dispatch 2024-06-18T02:00:34.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:33 smithi007 ceph-mon[25091]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cae59855-0c86-4a06-bc4e-fbee75a57976"}]: dispatch 2024-06-18T02:00:34.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:33 smithi007 ceph-mon[25091]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cae59855-0c86-4a06-bc4e-fbee75a57976"}]': finished 2024-06-18T02:00:34.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:33 smithi007 ceph-mon[25091]: osdmap e52: 8 total, 7 up, 8 in 2024-06-18T02:00:34.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:33 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-18T02:00:34.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:33 smithi007 ceph-mon[29879]: from='client.? 172.21.15.130:0/1774072482' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cae59855-0c86-4a06-bc4e-fbee75a57976"}]: dispatch 2024-06-18T02:00:34.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:33 smithi007 ceph-mon[29879]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cae59855-0c86-4a06-bc4e-fbee75a57976"}]: dispatch 2024-06-18T02:00:34.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:33 smithi007 ceph-mon[29879]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cae59855-0c86-4a06-bc4e-fbee75a57976"}]': finished 2024-06-18T02:00:34.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:33 smithi007 ceph-mon[29879]: osdmap e52: 8 total, 7 up, 8 in 2024-06-18T02:00:34.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:33 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-18T02:00:35.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:34 smithi130 ceph-mon[26123]: from='client.? 172.21.15.130:0/2348789349' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-18T02:00:35.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:34 smithi130 ceph-mon[26123]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-06-18T02:00:35.083 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:34 smithi007 ceph-mon[25091]: from='client.? 172.21.15.130:0/2348789349' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-18T02:00:35.083 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:34 smithi007 ceph-mon[25091]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-06-18T02:00:35.083 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:34 smithi007 ceph-mon[29879]: from='client.? 172.21.15.130:0/2348789349' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-18T02:00:35.083 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:34 smithi007 ceph-mon[29879]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-06-18T02:00:36.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:36 smithi130 ceph-mon[26123]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-06-18T02:00:36.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:36 smithi007 ceph-mon[25091]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-06-18T02:00:36.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:36 smithi007 ceph-mon[29879]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-06-18T02:00:38.149 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:38 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-06-18T02:00:38.150 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:38 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-06-18T02:00:38.431 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:38 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-06-18T02:00:38.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:38 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-06-18T02:00:38.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:38 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-06-18T02:00:38.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:38 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-06-18T02:00:39.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:39 smithi130 ceph-mon[26123]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-06-18T02:00:39.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:39 smithi007 ceph-mon[25091]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-06-18T02:00:39.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:39 smithi007 ceph-mon[29879]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-06-18T02:00:40.147 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:40 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-06-18T02:00:40.147 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:40 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:00:40.147 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:40 smithi130 ceph-mon[26123]: Deploying daemon osd.7 on smithi130 2024-06-18T02:00:40.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:40 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-06-18T02:00:40.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:40 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:00:40.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:40 smithi007 ceph-mon[25091]: Deploying daemon osd.7 on smithi130 2024-06-18T02:00:40.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:40 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-06-18T02:00:40.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:40 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:00:40.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:40 smithi007 ceph-mon[29879]: Deploying daemon osd.7 on smithi130 2024-06-18T02:00:41.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:41 smithi130 ceph-mon[26123]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-06-18T02:00:41.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:41 smithi007 ceph-mon[25091]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-06-18T02:00:41.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:41 smithi007 ceph-mon[29879]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-06-18T02:00:43.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:43 smithi130 ceph-mon[26123]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-06-18T02:00:43.681 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:43 smithi007 ceph-mon[29879]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-06-18T02:00:43.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:43 smithi007 ceph-mon[25091]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-06-18T02:00:45.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:45 smithi130 ceph-mon[26123]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-06-18T02:00:45.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:45 smithi007 ceph-mon[25091]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-06-18T02:00:45.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:45 smithi007 ceph-mon[29879]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-06-18T02:00:46.426 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:46 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:46.426 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:46 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:00:46.426 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:46 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:00:46.427 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:46 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:00:46.427 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:46 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:46.427 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:46 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:46.427 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:46 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:46.427 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:46 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:00:46.427 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:46 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:00:46.427 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:46 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:00:46.427 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:46 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:46.682 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:00:46 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.130 - - [18/Jun/2024:02:00:46] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:00:46.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:46 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:46.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:46 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:00:46.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:46 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:00:46.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:46 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:00:46.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:46 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:46.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:46 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:46.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:46 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:46.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:46 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:00:46.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:46 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:00:46.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:46 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:00:46.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:46 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:46.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:46 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:46.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:46 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:00:46.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:46 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:00:46.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:46 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:00:46.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:46 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:46.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:46 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:46.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:46 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:46.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:46 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:00:46.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:46 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:00:46.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:46 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:00:46.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:46 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:47.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:47 smithi007 ceph-mon[25091]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-06-18T02:00:47.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:47 smithi007 ceph-mon[25091]: Detected new or changed devices on smithi130 2024-06-18T02:00:47.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:47 smithi007 ceph-mon[29879]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-06-18T02:00:47.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:47 smithi007 ceph-mon[29879]: Detected new or changed devices on smithi130 2024-06-18T02:00:47.769 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:47 smithi130 ceph-mon[26123]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-06-18T02:00:47.769 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:47 smithi130 ceph-mon[26123]: Detected new or changed devices on smithi130 2024-06-18T02:00:49.304 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:00:49 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.130 - - [18/Jun/2024:02:00:49] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:00:49.619 INFO:teuthology.orchestra.run.smithi130.stdout:Created osd(s) 7 on host 'smithi130' 2024-06-18T02:00:49.655 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:49 smithi007 ceph-mon[25091]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-06-18T02:00:49.656 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:49 smithi007 ceph-mon[25091]: from='osd.7 [v2:172.21.15.130:6824/3045894159,v1:172.21.15.130:6825/3045894159]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-18T02:00:49.656 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:49 smithi007 ceph-mon[25091]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-18T02:00:49.656 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:49 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:49.656 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:49 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:49.656 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:49 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:00:49.656 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:49 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:00:49.656 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:49 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:00:49.656 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:49 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:49.656 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:49 smithi007 ceph-mon[29879]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-06-18T02:00:49.657 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:49 smithi007 ceph-mon[29879]: from='osd.7 [v2:172.21.15.130:6824/3045894159,v1:172.21.15.130:6825/3045894159]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-18T02:00:49.657 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:49 smithi007 ceph-mon[29879]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-18T02:00:49.657 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:49 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:49.657 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:49 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:49.657 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:49 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:00:49.657 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:49 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:00:49.657 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:49 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:00:49.657 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:49 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:49.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:49 smithi130 ceph-mon[26123]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-06-18T02:00:49.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:49 smithi130 ceph-mon[26123]: from='osd.7 [v2:172.21.15.130:6824/3045894159,v1:172.21.15.130:6825/3045894159]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-18T02:00:49.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:49 smithi130 ceph-mon[26123]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-18T02:00:49.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:49 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:49.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:49 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:49.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:49 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:00:49.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:49 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:00:49.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:49 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:00:49.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:49 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:50.272 DEBUG:teuthology.orchestra.run.smithi130:osd.7> sudo journalctl -f -n 0 -u ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.7.service 2024-06-18T02:00:50.275 INFO:tasks.cephadm:Waiting for 8 OSDs to come up... 2024-06-18T02:00:50.275 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph osd stat -f json 2024-06-18T02:00:50.301 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:00:50 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.7 - - [18/Jun/2024:02:00:50] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:00:50.543 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:00:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[39665]: 2024-06-18T02:00:50.417+0000 7f6f9eba7700 -1 osd.7 0 waiting for initial osdmap 2024-06-18T02:00:50.544 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:00:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[39665]: 2024-06-18T02:00:50.424+0000 7f6f9753a700 -1 osd.7 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-18T02:00:50.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:50 smithi130 ceph-mon[26123]: Detected new or changed devices on smithi130 2024-06-18T02:00:50.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:50 smithi130 ceph-mon[26123]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-06-18T02:00:50.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:50 smithi130 ceph-mon[26123]: osdmap e53: 8 total, 7 up, 8 in 2024-06-18T02:00:50.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:50 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-18T02:00:50.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:50 smithi130 ceph-mon[26123]: from='osd.7 [v2:172.21.15.130:6824/3045894159,v1:172.21.15.130:6825/3045894159]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:00:50.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:50 smithi130 ceph-mon[26123]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:00:50.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:50 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:50.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:50 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:00:50.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:50 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:00:50.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:50 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:00:50.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:50 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:00:50.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:50 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:00:50.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:50 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:00:50.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:50 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:00:50.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:50 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:50.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:50 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:50.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:50 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:50.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:50 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:50.601 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:50 smithi007 ceph-mon[25091]: Detected new or changed devices on smithi130 2024-06-18T02:00:50.601 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:50 smithi007 ceph-mon[25091]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-06-18T02:00:50.601 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:50 smithi007 ceph-mon[25091]: osdmap e53: 8 total, 7 up, 8 in 2024-06-18T02:00:50.601 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:50 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-18T02:00:50.601 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:50 smithi007 ceph-mon[25091]: from='osd.7 [v2:172.21.15.130:6824/3045894159,v1:172.21.15.130:6825/3045894159]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:00:50.601 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:50 smithi007 ceph-mon[25091]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:00:50.601 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:50 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:50.601 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:50 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:00:50.601 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:50 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:00:50.601 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:50 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:00:50.602 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:50 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:00:50.602 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:50 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:00:50.602 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:50 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:00:50.602 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:50 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:00:50.602 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:50 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:50.602 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:50 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:50.602 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:50 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:50.602 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:50 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:50.602 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:50 smithi007 ceph-mon[29879]: Detected new or changed devices on smithi130 2024-06-18T02:00:50.602 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:50 smithi007 ceph-mon[29879]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-06-18T02:00:50.602 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:50 smithi007 ceph-mon[29879]: osdmap e53: 8 total, 7 up, 8 in 2024-06-18T02:00:50.603 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:50 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-18T02:00:50.603 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:50 smithi007 ceph-mon[29879]: from='osd.7 [v2:172.21.15.130:6824/3045894159,v1:172.21.15.130:6825/3045894159]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:00:50.603 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:50 smithi007 ceph-mon[29879]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:00:50.603 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:50 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:50.603 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:50 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:00:50.603 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:50 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:00:50.603 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:50 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:00:50.603 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:50 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:00:50.603 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:50 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:00:50.603 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:50 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:00:50.603 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:50 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:00:50.603 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:50 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:50.604 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:50 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:50.604 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:50 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:50.604 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:50 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:00:51.675 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:51 smithi007 ceph-mon[25091]: Adjusting osd_memory_target on smithi130 to 4016M 2024-06-18T02:00:51.675 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:51 smithi007 ceph-mon[25091]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-06-18T02:00:51.675 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:51 smithi007 ceph-mon[25091]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-06-18T02:00:51.676 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:51 smithi007 ceph-mon[25091]: osdmap e54: 8 total, 7 up, 8 in 2024-06-18T02:00:51.676 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:51 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-18T02:00:51.676 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:51 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-18T02:00:51.676 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:51 smithi007 ceph-mon[25091]: osd.7 [v2:172.21.15.130:6824/3045894159,v1:172.21.15.130:6825/3045894159] boot 2024-06-18T02:00:51.676 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:51 smithi007 ceph-mon[25091]: osdmap e55: 8 total, 8 up, 8 in 2024-06-18T02:00:51.676 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:51 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-18T02:00:51.676 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:51 smithi007 ceph-mon[29879]: Adjusting osd_memory_target on smithi130 to 4016M 2024-06-18T02:00:51.676 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:51 smithi007 ceph-mon[29879]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-06-18T02:00:51.676 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:51 smithi007 ceph-mon[29879]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-06-18T02:00:51.676 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:51 smithi007 ceph-mon[29879]: osdmap e54: 8 total, 7 up, 8 in 2024-06-18T02:00:51.676 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:51 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-18T02:00:51.677 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:51 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-18T02:00:51.677 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:51 smithi007 ceph-mon[29879]: osd.7 [v2:172.21.15.130:6824/3045894159,v1:172.21.15.130:6825/3045894159] boot 2024-06-18T02:00:51.677 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:51 smithi007 ceph-mon[29879]: osdmap e55: 8 total, 8 up, 8 in 2024-06-18T02:00:51.677 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:51 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-18T02:00:51.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:51 smithi130 ceph-mon[26123]: Adjusting osd_memory_target on smithi130 to 4016M 2024-06-18T02:00:51.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:51 smithi130 ceph-mon[26123]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-06-18T02:00:51.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:51 smithi130 ceph-mon[26123]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-06-18T02:00:51.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:51 smithi130 ceph-mon[26123]: osdmap e54: 8 total, 7 up, 8 in 2024-06-18T02:00:51.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:51 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-18T02:00:51.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:51 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-18T02:00:51.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:51 smithi130 ceph-mon[26123]: osd.7 [v2:172.21.15.130:6824/3045894159,v1:172.21.15.130:6825/3045894159] boot 2024-06-18T02:00:51.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:51 smithi130 ceph-mon[26123]: osdmap e55: 8 total, 8 up, 8 in 2024-06-18T02:00:51.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:51 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-18T02:00:52.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:52 smithi007 ceph-mon[25091]: purged_snaps scrub starts 2024-06-18T02:00:52.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:52 smithi007 ceph-mon[25091]: purged_snaps scrub ok 2024-06-18T02:00:52.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:52 smithi007 ceph-mon[25091]: osdmap e56: 8 total, 8 up, 8 in 2024-06-18T02:00:52.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:52 smithi007 ceph-mon[29879]: purged_snaps scrub starts 2024-06-18T02:00:52.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:52 smithi007 ceph-mon[29879]: purged_snaps scrub ok 2024-06-18T02:00:52.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:52 smithi007 ceph-mon[29879]: osdmap e56: 8 total, 8 up, 8 in 2024-06-18T02:00:52.721 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-06-18T02:00:52.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:52 smithi130 ceph-mon[26123]: purged_snaps scrub starts 2024-06-18T02:00:52.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:52 smithi130 ceph-mon[26123]: purged_snaps scrub ok 2024-06-18T02:00:52.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:52 smithi130 ceph-mon[26123]: osdmap e56: 8 total, 8 up, 8 in 2024-06-18T02:00:53.551 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":57,"num_osds":8,"num_up_osds":8,"osd_up_since":1718676050,"num_in_osds":8,"osd_in_since":1718676033,"num_remapped_pgs":1} 2024-06-18T02:00:53.551 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph osd dump --format=json 2024-06-18T02:00:53.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:53 smithi007 ceph-mon[25091]: pgmap v175: 1 pgs: 1 remapped+peering; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:00:53.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:53 smithi007 ceph-mon[25091]: osdmap e57: 8 total, 8 up, 8 in 2024-06-18T02:00:53.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:53 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/2256911981' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-06-18T02:00:53.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:53 smithi007 ceph-mon[29879]: pgmap v175: 1 pgs: 1 remapped+peering; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:00:53.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:53 smithi007 ceph-mon[29879]: osdmap e57: 8 total, 8 up, 8 in 2024-06-18T02:00:53.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:53 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/2256911981' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-06-18T02:00:53.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:53 smithi130 ceph-mon[26123]: pgmap v175: 1 pgs: 1 remapped+peering; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:00:53.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:53 smithi130 ceph-mon[26123]: osdmap e57: 8 total, 8 up, 8 in 2024-06-18T02:00:53.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:53 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/2256911981' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-06-18T02:00:53.816 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/mon.a/config 2024-06-18T02:00:55.553 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-06-18T02:00:55.553 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":59,"fsid":"cd9a3408-2d15-11ef-bc9d-c7b262605968","created":"2024-06-18T01:55:40.695434+0000","modified":"2024-06-18T02:00:55.420298+0000","last_up_change":"2024-06-18T02:00:50.673310+0000","last_in_change":"2024-06-18T02:00:33.124275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-18T01:58:50.432227+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"85424ce1-096f-4fa9-b0e5-d1fe7b493345","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":442622498},{"type":"v1","addr":"172.21.15.7:6803","nonce":442622498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":442622498},{"type":"v1","addr":"172.21.15.7:6805","nonce":442622498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":442622498},{"type":"v1","addr":"172.21.15.7:6809","nonce":442622498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":442622498},{"type":"v1","addr":"172.21.15.7:6807","nonce":442622498}]},"public_addr":"172.21.15.7:6803/442622498","cluster_addr":"172.21.15.7:6805/442622498","heartbeat_back_addr":"172.21.15.7:6809/442622498","heartbeat_front_addr":"172.21.15.7:6807/442622498","state":["exists","up"]},{"osd":1,"uuid":"bf8ce607-af6a-4a49-b6f9-72b8ff585a90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":919695983},{"type":"v1","addr":"172.21.15.7:6811","nonce":919695983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":919695983},{"type":"v1","addr":"172.21.15.7:6813","nonce":919695983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":919695983},{"type":"v1","addr":"172.21.15.7:6817","nonce":919695983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":919695983},{"type":"v1","addr":"172.21.15.7:6815","nonce":919695983}]},"public_addr":"172.21.15.7:6811/919695983","cluster_addr":"172.21.15.7:6813/919695983","heartbeat_back_addr":"172.21.15.7:6817/919695983","heartbeat_front_addr":"172.21.15.7:6815/919695983","state":["exists","up"]},{"osd":2,"uuid":"b8baceb4-66a4-4833-b235-88fb6b9b5bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3268637445},{"type":"v1","addr":"172.21.15.7:6819","nonce":3268637445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":3268637445},{"type":"v1","addr":"172.21.15.7:6821","nonce":3268637445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3268637445},{"type":"v1","addr":"172.21.15.7:6825","nonce":3268637445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3268637445},{"type":"v1","addr":"172.21.15.7:6823","nonce":3268637445}]},"public_addr":"172.21.15.7:6819/3268637445","cluster_addr":"172.21.15.7:6821/3268637445","heartbeat_back_addr":"172.21.15.7:6825/3268637445","heartbeat_front_addr":"172.21.15.7:6823/3268637445","state":["exists","up"]},{"osd":3,"uuid":"45949dd3-a8f0-4310-a154-63faed8a3ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":1700854068},{"type":"v1","addr":"172.21.15.7:6827","nonce":1700854068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":1700854068},{"type":"v1","addr":"172.21.15.7:6829","nonce":1700854068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1700854068},{"type":"v1","addr":"172.21.15.7:6833","nonce":1700854068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":1700854068},{"type":"v1","addr":"172.21.15.7:6831","nonce":1700854068}]},"public_addr":"172.21.15.7:6827/1700854068","cluster_addr":"172.21.15.7:6829/1700854068","heartbeat_back_addr":"172.21.15.7:6833/1700854068","heartbeat_front_addr":"172.21.15.7:6831/1700854068","state":["exists","up"]},{"osd":4,"uuid":"1ef21401-4fcf-4da8-8136-e1e44a29d238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":626781335},{"type":"v1","addr":"172.21.15.130:6801","nonce":626781335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":626781335},{"type":"v1","addr":"172.21.15.130:6803","nonce":626781335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":626781335},{"type":"v1","addr":"172.21.15.130:6807","nonce":626781335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":626781335},{"type":"v1","addr":"172.21.15.130:6805","nonce":626781335}]},"public_addr":"172.21.15.130:6801/626781335","cluster_addr":"172.21.15.130:6803/626781335","heartbeat_back_addr":"172.21.15.130:6807/626781335","heartbeat_front_addr":"172.21.15.130:6805/626781335","state":["exists","up"]},{"osd":5,"uuid":"56d30fd0-94e8-4f04-8a7b-fa3e1078eb8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":4245072316},{"type":"v1","addr":"172.21.15.130:6809","nonce":4245072316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":4245072316},{"type":"v1","addr":"172.21.15.130:6811","nonce":4245072316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":4245072316},{"type":"v1","addr":"172.21.15.130:6815","nonce":4245072316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":4245072316},{"type":"v1","addr":"172.21.15.130:6813","nonce":4245072316}]},"public_addr":"172.21.15.130:6809/4245072316","cluster_addr":"172.21.15.130:6811/4245072316","heartbeat_back_addr":"172.21.15.130:6815/4245072316","heartbeat_front_addr":"172.21.15.130:6813/4245072316","state":["exists","up"]},{"osd":6,"uuid":"31a78fc2-4f3b-4eaf-bf58-b257d16be18d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":2703402227},{"type":"v1","addr":"172.21.15.130:6817","nonce":2703402227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":2703402227},{"type":"v1","addr":"172.21.15.130:6819","nonce":2703402227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":2703402227},{"type":"v1","addr":"172.21.15.130:6823","nonce":2703402227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":2703402227},{"type":"v1","addr":"172.21.15.130:6821","nonce":2703402227}]},"public_addr":"172.21.15.130:6817/2703402227","cluster_addr":"172.21.15.130:6819/2703402227","heartbeat_back_addr":"172.21.15.130:6823/2703402227","heartbeat_front_addr":"172.21.15.130:6821/2703402227","state":["exists","up"]},{"osd":7,"uuid":"cae59855-0c86-4a06-bc4e-fbee75a57976","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":3045894159},{"type":"v1","addr":"172.21.15.130:6825","nonce":3045894159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":3045894159},{"type":"v1","addr":"172.21.15.130:6827","nonce":3045894159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":3045894159},{"type":"v1","addr":"172.21.15.130:6831","nonce":3045894159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":3045894159},{"type":"v1","addr":"172.21.15.130:6829","nonce":3045894159}]},"public_addr":"172.21.15.130:6825/3045894159","cluster_addr":"172.21.15.130:6827/3045894159","heartbeat_back_addr":"172.21.15.130:6831/3045894159","heartbeat_front_addr":"172.21.15.130:6829/3045894159","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-06-18T01:57:59.162295+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-06-18T01:58:23.512469+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-06-18T01:58:47.185844+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-06-18T01:59:12.529139+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-06-18T01:59:35.610446+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-06-18T01:59:59.769056+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-06-18T02:00:24.666285+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-06-18T02:00:49.551354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/586006455":"2024-06-19T01:56:37.880404+0000","172.21.15.7:6801/4064257282":"2024-06-19T01:56:37.880404+0000","172.21.15.7:0/2859032966":"2024-06-19T01:56:37.880404+0000","172.21.15.7:6800/4064257282":"2024-06-19T01:56:37.880404+0000","172.21.15.7:0/2197821776":"2024-06-19T01:56:15.429295+0000","172.21.15.7:0/1098197333":"2024-06-19T01:56:15.429295+0000","172.21.15.7:0/3239039203":"2024-06-19T01:56:15.429295+0000","172.21.15.7:0/3183920300":"2024-06-19T01:56:37.880404+0000","172.21.15.7:6800/81675152":"2024-06-19T01:56:15.429295+0000","172.21.15.7:6801/81675152":"2024-06-19T01:56:15.429295+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-18T02:00:55.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:55 smithi007 ceph-mon[25091]: pgmap v177: 1 pgs: 1 remapped+peering; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:00:55.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:55 smithi007 ceph-mon[25091]: osdmap e58: 8 total, 8 up, 8 in 2024-06-18T02:00:55.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:55 smithi007 ceph-mon[29879]: pgmap v177: 1 pgs: 1 remapped+peering; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:00:55.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:55 smithi007 ceph-mon[29879]: osdmap e58: 8 total, 8 up, 8 in 2024-06-18T02:00:55.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:55 smithi130 ceph-mon[26123]: pgmap v177: 1 pgs: 1 remapped+peering; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:00:55.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:55 smithi130 ceph-mon[26123]: osdmap e58: 8 total, 8 up, 8 in 2024-06-18T02:00:56.108 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-18T01:58:50.432227+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-06-18T02:00:56.108 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-06-18T02:00:56.330 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/mon.a/config 2024-06-18T02:00:56.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:56 smithi007 ceph-mon[25091]: osdmap e59: 8 total, 8 up, 8 in 2024-06-18T02:00:56.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:56 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/424378069' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-18T02:00:56.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:56 smithi007 ceph-mon[29879]: osdmap e59: 8 total, 8 up, 8 in 2024-06-18T02:00:56.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:56 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/424378069' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-18T02:00:56.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:56 smithi130 ceph-mon[26123]: osdmap e59: 8 total, 8 up, 8 in 2024-06-18T02:00:56.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:56 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/424378069' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-18T02:00:57.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:57 smithi007 ceph-mon[25091]: pgmap v180: 1 pgs: 1 remapped+peering; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:00:57.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:57 smithi007 ceph-mon[29879]: pgmap v180: 1 pgs: 1 remapped+peering; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:00:57.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:57 smithi130 ceph-mon[26123]: pgmap v180: 1 pgs: 1 remapped+peering; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:00:57.890 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-06-18T02:00:58.450 INFO:tasks.cephadm:Adding prometheus.a on smithi130 2024-06-18T02:00:58.451 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph orch apply prometheus '1;smithi130=a' 2024-06-18T02:00:58.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:58 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/2999018306' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-18T02:00:58.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:58 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/2999018306' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-18T02:00:58.721 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:58 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/2999018306' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-18T02:00:59.689 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:00:59 smithi130 ceph-mon[26123]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-06-18T02:00:59.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:00:59 smithi007 ceph-mon[25091]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-06-18T02:00:59.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:00:59 smithi007 ceph-mon[29879]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-06-18T02:01:00.344 INFO:teuthology.orchestra.run.smithi130.stdout:Scheduled prometheus update... 2024-06-18T02:01:01.062 DEBUG:teuthology.orchestra.run.smithi130:prometheus.a> sudo journalctl -f -n 0 -u ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@prometheus.a.service 2024-06-18T02:01:01.065 INFO:tasks.cephadm:Adding node-exporter.a on smithi007 2024-06-18T02:01:01.065 INFO:tasks.cephadm:Adding node-exporter.b on smithi130 2024-06-18T02:01:01.065 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph orch apply node-exporter '2;smithi007=a;smithi130=b' 2024-06-18T02:01:01.596 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:01:01 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: ignoring --setuser ceph since I am not root 2024-06-18T02:01:01.596 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:01:01 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: ignoring --setgroup ceph since I am not root 2024-06-18T02:01:01.596 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:01:01 smithi130 ceph-mgr[27668]: -- 172.21.15.130:0/2561501863 <== mon.2 v2:172.21.15.130:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e9b1630340 con 0x55e9b1609000 2024-06-18T02:01:01.596 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:01:01 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: 2024-06-18T02:01:01.520+0000 7f222922b000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-18T02:01:01.597 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:01 smithi130 ceph-mon[26123]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-06-18T02:01:01.597 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:01 smithi130 ceph-mon[26123]: from='client.24332 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi130=a", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:01:01.597 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:01 smithi130 ceph-mon[26123]: Saving service prometheus spec with placement smithi130=a;count:1 2024-06-18T02:01:01.597 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:01 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:01:01.597 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:01 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:01:01.597 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:01 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:01:01.597 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:01 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:01:01.597 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:01 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:01:01.597 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:01 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-06-18T02:01:01.606 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:01:01 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: ignoring --setuser ceph since I am not root 2024-06-18T02:01:01.606 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:01:01 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: ignoring --setgroup ceph since I am not root 2024-06-18T02:01:01.606 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:01:01 smithi007 ceph-mgr[25326]: -- 172.21.15.7:0/3173712665 <== mon.0 v2:172.21.15.7:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d7c6056340 con 0x55d7c602e800 2024-06-18T02:01:01.606 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:01:01 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T02:01:01.533+0000 7fd06c312000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-18T02:01:01.607 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:01 smithi007 ceph-mon[25091]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-06-18T02:01:01.607 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:01 smithi007 ceph-mon[25091]: from='client.24332 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi130=a", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:01:01.607 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:01 smithi007 ceph-mon[25091]: Saving service prometheus spec with placement smithi130=a;count:1 2024-06-18T02:01:01.607 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:01 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:01:01.607 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:01 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:01:01.607 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:01 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:01:01.607 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:01 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:01:01.607 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:01 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:01:01.607 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:01 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-06-18T02:01:01.608 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:01 smithi007 ceph-mon[29879]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-06-18T02:01:01.608 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:01 smithi007 ceph-mon[29879]: from='client.24332 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi130=a", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:01:01.608 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:01 smithi007 ceph-mon[29879]: Saving service prometheus spec with placement smithi130=a;count:1 2024-06-18T02:01:01.608 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:01 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:01:01.608 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:01 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:01:01.608 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:01 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:01:01.608 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:01 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:01:01.608 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:01 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' 2024-06-18T02:01:01.608 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:01 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-06-18T02:01:01.931 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:01:01 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T02:01:01.671+0000 7fd06c312000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-18T02:01:01.931 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:01:01 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T02:01:01.773+0000 7fd06c312000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-18T02:01:02.043 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:01:01 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: 2024-06-18T02:01:01.654+0000 7f222922b000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-18T02:01:02.043 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:01:01 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: 2024-06-18T02:01:01.753+0000 7f222922b000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-18T02:01:02.346 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:01:02 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: 2024-06-18T02:01:02.061+0000 7f222922b000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-18T02:01:02.346 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:01:02 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: 2024-06-18T02:01:02.145+0000 7f222922b000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-18T02:01:02.357 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:01:02 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T02:01:02.093+0000 7fd06c312000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-18T02:01:02.357 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:01:02 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T02:01:02.179+0000 7fd06c312000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-18T02:01:02.627 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:02 smithi130 ceph-mon[26123]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-06-18T02:01:02.627 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:02 smithi130 ceph-mon[26123]: mgrmap e16: y(active, since 4m), standbys: x 2024-06-18T02:01:02.681 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:02 smithi007 ceph-mon[29879]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-06-18T02:01:02.681 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:02 smithi007 ceph-mon[29879]: mgrmap e16: y(active, since 4m), standbys: x 2024-06-18T02:01:02.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:02 smithi007 ceph-mon[25091]: from='mgr.14152 172.21.15.7:0/364938161' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-06-18T02:01:02.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:02 smithi007 ceph-mon[25091]: mgrmap e16: y(active, since 4m), standbys: x 2024-06-18T02:01:03.560 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:01:03 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: 2024-06-18T02:01:03.301+0000 7f222922b000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-18T02:01:03.560 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:01:03 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: 2024-06-18T02:01:03.474+0000 7f222922b000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-18T02:01:03.617 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:01:03 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T02:01:03.361+0000 7fd06c312000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-18T02:01:03.617 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:01:03 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T02:01:03.532+0000 7fd06c312000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-18T02:01:03.617 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:01:03 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T02:01:03.617+0000 7fd06c312000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-18T02:01:03.885 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:01:03 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: 2024-06-18T02:01:03.560+0000 7f222922b000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-18T02:01:04.171 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:01:03 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: 2024-06-18T02:01:03.885+0000 7f222922b000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-18T02:01:04.171 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:01:03 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: 2024-06-18T02:01:03.980+0000 7f222922b000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-18T02:01:04.171 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:01:04 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: 2024-06-18T02:01:04.080+0000 7f222922b000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-18T02:01:04.386 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:01:03 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T02:01:03.944+0000 7fd06c312000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-18T02:01:04.386 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:01:04 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T02:01:04.038+0000 7fd06c312000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-18T02:01:04.386 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:01:04 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T02:01:04.135+0000 7fd06c312000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-18T02:01:04.533 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:01:04 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: 2024-06-18T02:01:04.332+0000 7f222922b000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-18T02:01:04.681 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:01:04 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T02:01:04.386+0000 7fd06c312000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-18T02:01:05.043 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:01:04 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: 2024-06-18T02:01:04.791+0000 7f222922b000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-18T02:01:05.181 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:01:04 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T02:01:04.848+0000 7fd06c312000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-18T02:01:05.401 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:01:05 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: 2024-06-18T02:01:05.305+0000 7f222922b000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-18T02:01:05.452 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:01:05 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T02:01:05.355+0000 7fd06c312000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-18T02:01:05.707 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:01:05 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: 2024-06-18T02:01:05.402+0000 7f222922b000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-18T02:01:05.707 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:01:05 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: 2024-06-18T02:01:05.707+0000 7f222922b000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-18T02:01:05.761 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:01:05 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T02:01:05.452+0000 7fd06c312000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-18T02:01:05.978 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:01:05 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: 2024-06-18T02:01:05.800+0000 7f222922b000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-18T02:01:06.181 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:01:05 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T02:01:05.761+0000 7fd06c312000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-18T02:01:06.181 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:01:05 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T02:01:05.855+0000 7fd06c312000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-18T02:01:06.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:01:06 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: 2024-06-18T02:01:06.217+0000 7f222922b000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-18T02:01:06.481 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:01:06 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T02:01:06.278+0000 7fd06c312000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-18T02:01:06.481 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:01:06 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T02:01:06.429+0000 7fd06c312000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-18T02:01:06.590 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:01:06 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: 2024-06-18T02:01:06.351+0000 7f222922b000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-18T02:01:06.590 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:01:06 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: 2024-06-18T02:01:06.444+0000 7f222922b000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-18T02:01:06.590 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:01:06 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: 2024-06-18T02:01:06.558+0000 7f222922b000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-18T02:01:06.756 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:01:06 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T02:01:06.534+0000 7fd06c312000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-18T02:01:06.756 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:01:06 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T02:01:06.660+0000 7fd06c312000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-18T02:01:07.043 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:01:06 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: 2024-06-18T02:01:06.647+0000 7f222922b000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-18T02:01:07.543 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:01:07 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: 2024-06-18T02:01:07.186+0000 7f222922b000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-18T02:01:07.605 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:01:06 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T02:01:06.756+0000 7fd06c312000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-18T02:01:07.605 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:01:07 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T02:01:07.338+0000 7fd06c312000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-18T02:01:07.931 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:01:07 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T02:01:07.724+0000 7fd06c312000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-18T02:01:07.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:07 smithi007 ceph-mon[25091]: Standby manager daemon x restarted 2024-06-18T02:01:07.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:07 smithi007 ceph-mon[25091]: Standby manager daemon x started 2024-06-18T02:01:07.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:07 smithi007 ceph-mon[25091]: from='mgr.? 172.21.15.130:0/2493685991' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-06-18T02:01:07.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:07 smithi007 ceph-mon[25091]: from='mgr.? 172.21.15.130:0/2493685991' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-18T02:01:07.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:07 smithi007 ceph-mon[25091]: from='mgr.? 172.21.15.130:0/2493685991' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-06-18T02:01:07.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:07 smithi007 ceph-mon[25091]: from='mgr.? 172.21.15.130:0/2493685991' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-18T02:01:07.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:07 smithi007 ceph-mon[29879]: Standby manager daemon x restarted 2024-06-18T02:01:07.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:07 smithi007 ceph-mon[29879]: Standby manager daemon x started 2024-06-18T02:01:07.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:07 smithi007 ceph-mon[29879]: from='mgr.? 172.21.15.130:0/2493685991' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-06-18T02:01:07.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:07 smithi007 ceph-mon[29879]: from='mgr.? 172.21.15.130:0/2493685991' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-18T02:01:07.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:07 smithi007 ceph-mon[29879]: from='mgr.? 172.21.15.130:0/2493685991' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-06-18T02:01:07.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:07 smithi007 ceph-mon[29879]: from='mgr.? 172.21.15.130:0/2493685991' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-18T02:01:08.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:07 smithi130 ceph-mon[26123]: Standby manager daemon x restarted 2024-06-18T02:01:08.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:07 smithi130 ceph-mon[26123]: Standby manager daemon x started 2024-06-18T02:01:08.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:07 smithi130 ceph-mon[26123]: from='mgr.? 172.21.15.130:0/2493685991' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-06-18T02:01:08.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:07 smithi130 ceph-mon[26123]: from='mgr.? 172.21.15.130:0/2493685991' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-18T02:01:08.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:07 smithi130 ceph-mon[26123]: from='mgr.? 172.21.15.130:0/2493685991' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-06-18T02:01:08.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:07 smithi130 ceph-mon[26123]: from='mgr.? 172.21.15.130:0/2493685991' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-18T02:01:08.044 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:01:07 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: 2024-06-18T02:01:07.546+0000 7f222922b000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-18T02:01:08.044 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:01:07 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: [18/Jun/2024:02:01:07] ENGINE Bus STARTING 2024-06-18T02:01:08.044 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:01:07 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: CherryPy Checker: 2024-06-18T02:01:08.044 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:01:07 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: The Application mounted at '' has an empty config. 2024-06-18T02:01:08.045 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:01:07 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: 2024-06-18T02:01:08.045 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:01:07 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: [18/Jun/2024:02:01:07] ENGINE Serving on http://:::9283 2024-06-18T02:01:08.045 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:01:07 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: [18/Jun/2024:02:01:07] ENGINE Bus STARTED 2024-06-18T02:01:08.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:08 smithi007 ceph-mon[25091]: mgrmap e17: y(active, since 4m), standbys: x 2024-06-18T02:01:08.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:08 smithi007 ceph-mon[25091]: Active manager daemon y restarted 2024-06-18T02:01:08.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:08 smithi007 ceph-mon[25091]: Activating manager daemon y 2024-06-18T02:01:08.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:08 smithi007 ceph-mon[25091]: osdmap e60: 8 total, 8 up, 8 in 2024-06-18T02:01:08.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:08 smithi007 ceph-mon[29879]: mgrmap e17: y(active, since 4m), standbys: x 2024-06-18T02:01:08.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:08 smithi007 ceph-mon[29879]: Active manager daemon y restarted 2024-06-18T02:01:08.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:08 smithi007 ceph-mon[29879]: Activating manager daemon y 2024-06-18T02:01:08.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:08 smithi007 ceph-mon[29879]: osdmap e60: 8 total, 8 up, 8 in 2024-06-18T02:01:08.932 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:01:08 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: [18/Jun/2024:02:01:08] ENGINE Bus STARTING 2024-06-18T02:01:08.933 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:01:08 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: CherryPy Checker: 2024-06-18T02:01:08.933 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:01:08 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: The Application mounted at '' has an empty config. 2024-06-18T02:01:08.933 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:01:08 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T02:01:08.933 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:01:08 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: [18/Jun/2024:02:01:08] ENGINE Serving on http://:::9283 2024-06-18T02:01:08.933 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:01:08 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: [18/Jun/2024:02:01:08] ENGINE Bus STARTED 2024-06-18T02:01:08.945 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:08 smithi130 ceph-mon[26123]: mgrmap e17: y(active, since 4m), standbys: x 2024-06-18T02:01:08.945 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:08 smithi130 ceph-mon[26123]: Active manager daemon y restarted 2024-06-18T02:01:08.946 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:08 smithi130 ceph-mon[26123]: Activating manager daemon y 2024-06-18T02:01:08.946 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:08 smithi130 ceph-mon[26123]: osdmap e60: 8 total, 8 up, 8 in 2024-06-18T02:01:09.211 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:01:08 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: [18/Jun/2024:02:01:08] ENGINE Bus STARTING 2024-06-18T02:01:09.211 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: [18/Jun/2024:02:01:09] ENGINE Serving on https://172.21.15.7:7150 2024-06-18T02:01:09.211 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: [18/Jun/2024:02:01:09] ENGINE Bus STARTED 2024-06-18T02:01:09.639 INFO:teuthology.orchestra.run.smithi130.stdout:Scheduled node-exporter update... 2024-06-18T02:01:09.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[25091]: mgrmap e18: y(active, starting, since 0.889684s), standbys: x 2024-06-18T02:01:09.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-18T02:01:09.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-18T02:01:09.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-18T02:01:09.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-06-18T02:01:09.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-06-18T02:01:09.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-18T02:01:09.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-18T02:01:09.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-18T02:01:09.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-18T02:01:09.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-18T02:01:09.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-18T02:01:09.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-18T02:01:09.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-18T02:01:09.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-18T02:01:09.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-18T02:01:09.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-18T02:01:09.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[25091]: Manager daemon y is now available 2024-06-18T02:01:09.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:09.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:01:09.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:01:09.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:01:09.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:01:09.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi130", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:01:09.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi007", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:01:09.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:09.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi130", "name": "osd_memory_target"}]': finished 2024-06-18T02:01:09.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[25091]: Updating smithi130:/etc/ceph/ceph.conf 2024-06-18T02:01:09.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi007", "name": "osd_memory_target"}]': finished 2024-06-18T02:01:09.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[25091]: Updating smithi007:/etc/ceph/ceph.conf 2024-06-18T02:01:09.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-06-18T02:01:09.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-06-18T02:01:09.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[25091]: [18/Jun/2024:02:01:08] ENGINE Bus STARTING 2024-06-18T02:01:09.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[25091]: Updating smithi007:/etc/ceph/ceph.client.admin.keyring 2024-06-18T02:01:09.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[25091]: Updating smithi130:/etc/ceph/ceph.client.admin.keyring 2024-06-18T02:01:09.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[25091]: [18/Jun/2024:02:01:09] ENGINE Serving on https://172.21.15.7:7150 2024-06-18T02:01:09.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[25091]: [18/Jun/2024:02:01:09] ENGINE Bus STARTED 2024-06-18T02:01:09.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:09.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:09.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:09.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:09.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-06-18T02:01:09.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[29879]: mgrmap e18: y(active, starting, since 0.889684s), standbys: x 2024-06-18T02:01:09.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-18T02:01:09.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-18T02:01:09.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-18T02:01:09.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-06-18T02:01:09.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-06-18T02:01:09.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-18T02:01:09.942 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-18T02:01:09.942 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-18T02:01:09.942 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-18T02:01:09.942 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-18T02:01:09.943 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-18T02:01:09.943 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-18T02:01:09.943 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-18T02:01:09.943 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-18T02:01:09.943 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-18T02:01:09.943 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-18T02:01:09.943 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[29879]: Manager daemon y is now available 2024-06-18T02:01:09.943 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:09.943 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:01:09.943 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:01:09.943 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:01:09.943 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:01:09.943 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi130", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:01:09.943 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi007", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:01:09.944 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:09.944 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi130", "name": "osd_memory_target"}]': finished 2024-06-18T02:01:09.944 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[29879]: Updating smithi130:/etc/ceph/ceph.conf 2024-06-18T02:01:09.944 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi007", "name": "osd_memory_target"}]': finished 2024-06-18T02:01:09.944 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[29879]: Updating smithi007:/etc/ceph/ceph.conf 2024-06-18T02:01:09.944 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-06-18T02:01:09.944 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-06-18T02:01:09.944 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[29879]: [18/Jun/2024:02:01:08] ENGINE Bus STARTING 2024-06-18T02:01:09.944 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[29879]: Updating smithi007:/etc/ceph/ceph.client.admin.keyring 2024-06-18T02:01:09.944 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[29879]: Updating smithi130:/etc/ceph/ceph.client.admin.keyring 2024-06-18T02:01:09.944 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[29879]: [18/Jun/2024:02:01:09] ENGINE Serving on https://172.21.15.7:7150 2024-06-18T02:01:09.944 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[29879]: [18/Jun/2024:02:01:09] ENGINE Bus STARTED 2024-06-18T02:01:09.944 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:09.944 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:09.945 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:09.945 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:09.945 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:09 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-06-18T02:01:09.971 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:09 smithi130 ceph-mon[26123]: mgrmap e18: y(active, starting, since 0.889684s), standbys: x 2024-06-18T02:01:09.971 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:09 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-18T02:01:09.971 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:09 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-18T02:01:09.971 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:09 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-18T02:01:09.971 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:09 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-06-18T02:01:09.971 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:09 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-06-18T02:01:09.971 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:09 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-18T02:01:09.971 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:09 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-18T02:01:09.972 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:09 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-18T02:01:09.972 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:09 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-18T02:01:09.972 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:09 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-18T02:01:09.972 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:09 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-18T02:01:09.972 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:09 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-18T02:01:09.972 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:09 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-18T02:01:09.972 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:09 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-18T02:01:09.972 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:09 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-18T02:01:09.972 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:09 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-18T02:01:09.972 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:09 smithi130 ceph-mon[26123]: Manager daemon y is now available 2024-06-18T02:01:09.972 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:09 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:09.972 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:09 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:01:09.972 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:09 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:01:09.972 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:09 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:01:09.973 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:09 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:01:09.973 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:09 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi130", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:01:09.973 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:09 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi007", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:01:09.973 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:09 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:09.973 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:09 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi130", "name": "osd_memory_target"}]': finished 2024-06-18T02:01:09.973 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:09 smithi130 ceph-mon[26123]: Updating smithi130:/etc/ceph/ceph.conf 2024-06-18T02:01:09.973 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:09 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi007", "name": "osd_memory_target"}]': finished 2024-06-18T02:01:09.973 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:09 smithi130 ceph-mon[26123]: Updating smithi007:/etc/ceph/ceph.conf 2024-06-18T02:01:09.973 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:09 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-06-18T02:01:09.973 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:09 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-06-18T02:01:09.973 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:09 smithi130 ceph-mon[26123]: [18/Jun/2024:02:01:08] ENGINE Bus STARTING 2024-06-18T02:01:09.973 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:09 smithi130 ceph-mon[26123]: Updating smithi007:/etc/ceph/ceph.client.admin.keyring 2024-06-18T02:01:09.973 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:09 smithi130 ceph-mon[26123]: Updating smithi130:/etc/ceph/ceph.client.admin.keyring 2024-06-18T02:01:09.973 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:09 smithi130 ceph-mon[26123]: [18/Jun/2024:02:01:09] ENGINE Serving on https://172.21.15.7:7150 2024-06-18T02:01:09.974 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:09 smithi130 ceph-mon[26123]: [18/Jun/2024:02:01:09] ENGINE Bus STARTED 2024-06-18T02:01:09.974 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:09 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:09.974 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:09 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:09.974 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:09 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:09.974 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:09 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:09.974 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:09 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-06-18T02:01:10.310 DEBUG:teuthology.orchestra.run.smithi007:node-exporter.a> sudo journalctl -f -n 0 -u ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@node-exporter.a.service 2024-06-18T02:01:10.313 DEBUG:teuthology.orchestra.run.smithi130:node-exporter.b> sudo journalctl -f -n 0 -u ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@node-exporter.b.service 2024-06-18T02:01:10.315 INFO:tasks.cephadm:Adding alertmanager.a on smithi007 2024-06-18T02:01:10.315 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph orch apply alertmanager '1;smithi007=a' 2024-06-18T02:01:10.452 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:01:10 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.7 - - [18/Jun/2024:02:01:10] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:01:10.769 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:10 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-06-18T02:01:10.769 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:10 smithi007 ceph-mon[25091]: mgrmap e19: y(active, since 1.89862s), standbys: x 2024-06-18T02:01:10.769 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:10 smithi007 ceph-mon[25091]: from='client.24350 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi007=a;smithi130=b", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:01:10.769 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:10 smithi007 ceph-mon[25091]: pgmap v3: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:10.769 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:10 smithi007 ceph-mon[25091]: Saving service node-exporter spec with placement smithi007=a;smithi130=b;count:2 2024-06-18T02:01:10.769 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:10 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:10.769 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:10 smithi007 ceph-mon[25091]: Deploying daemon prometheus.a on smithi130 2024-06-18T02:01:10.769 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:10 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:10.769 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:10 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:10.769 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:10 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-06-18T02:01:10.770 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:10 smithi007 ceph-mon[29879]: mgrmap e19: y(active, since 1.89862s), standbys: x 2024-06-18T02:01:10.770 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:10 smithi007 ceph-mon[29879]: from='client.24350 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi007=a;smithi130=b", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:01:10.770 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:10 smithi007 ceph-mon[29879]: pgmap v3: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:10.770 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:10 smithi007 ceph-mon[29879]: Saving service node-exporter spec with placement smithi007=a;smithi130=b;count:2 2024-06-18T02:01:10.770 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:10 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:10.770 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:10 smithi007 ceph-mon[29879]: Deploying daemon prometheus.a on smithi130 2024-06-18T02:01:10.770 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:10 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:10.770 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:10 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:10.916 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:10 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-06-18T02:01:10.916 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:10 smithi130 ceph-mon[26123]: mgrmap e19: y(active, since 1.89862s), standbys: x 2024-06-18T02:01:10.916 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:10 smithi130 ceph-mon[26123]: from='client.24350 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi007=a;smithi130=b", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:01:10.916 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:10 smithi130 ceph-mon[26123]: pgmap v3: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:10.916 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:10 smithi130 ceph-mon[26123]: Saving service node-exporter spec with placement smithi007=a;smithi130=b;count:2 2024-06-18T02:01:10.916 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:10 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:10.916 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:10 smithi130 ceph-mon[26123]: Deploying daemon prometheus.a on smithi130 2024-06-18T02:01:10.917 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:10 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:10.917 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:10 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:11.748 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:11 smithi007 ceph-mon[25091]: pgmap v4: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:11.748 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:11 smithi007 ceph-mon[25091]: mgrmap e20: y(active, since 2s), standbys: x 2024-06-18T02:01:11.748 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:11 smithi007 ceph-mon[29879]: pgmap v4: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:11.748 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:11 smithi007 ceph-mon[29879]: mgrmap e20: y(active, since 2s), standbys: x 2024-06-18T02:01:12.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:11 smithi130 ceph-mon[26123]: pgmap v4: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:12.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:11 smithi130 ceph-mon[26123]: mgrmap e20: y(active, since 2s), standbys: x 2024-06-18T02:01:12.986 INFO:teuthology.orchestra.run.smithi130.stdout:Scheduled alertmanager update... 2024-06-18T02:01:14.265 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:13 smithi130 ceph-mon[26123]: pgmap v5: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:14.265 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:13 smithi130 ceph-mon[26123]: from='client.24371 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi007=a", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:01:14.266 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:13 smithi130 ceph-mon[26123]: Saving service alertmanager spec with placement smithi007=a;count:1 2024-06-18T02:01:14.266 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:13 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:14.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:13 smithi007 ceph-mon[25091]: pgmap v5: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:14.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:13 smithi007 ceph-mon[25091]: from='client.24371 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi007=a", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:01:14.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:13 smithi007 ceph-mon[25091]: Saving service alertmanager spec with placement smithi007=a;count:1 2024-06-18T02:01:14.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:13 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:14.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:13 smithi007 ceph-mon[29879]: pgmap v5: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:14.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:13 smithi007 ceph-mon[29879]: from='client.24371 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi007=a", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:01:14.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:13 smithi007 ceph-mon[29879]: Saving service alertmanager spec with placement smithi007=a;count:1 2024-06-18T02:01:14.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:13 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:14.711 DEBUG:teuthology.orchestra.run.smithi007:alertmanager.a> sudo journalctl -f -n 0 -u ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@alertmanager.a.service 2024-06-18T02:01:14.714 INFO:tasks.cephadm:Adding grafana.a on smithi130 2024-06-18T02:01:14.714 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph orch apply grafana '1;smithi130=a' 2024-06-18T02:01:16.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:15 smithi130 ceph-mon[26123]: pgmap v6: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:16.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:15 smithi007 ceph-mon[25091]: pgmap v6: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:16.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:15 smithi007 ceph-mon[29879]: pgmap v6: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:18.170 INFO:teuthology.orchestra.run.smithi130.stdout:Scheduled grafana update... 2024-06-18T02:01:18.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:17 smithi130 ceph-mon[26123]: pgmap v7: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:18.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:17 smithi007 ceph-mon[25091]: pgmap v7: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:18.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:17 smithi007 ceph-mon[29879]: pgmap v7: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:19.074 DEBUG:teuthology.orchestra.run.smithi130:grafana.a> sudo journalctl -f -n 0 -u ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@grafana.a.service 2024-06-18T02:01:19.076 INFO:tasks.cephadm:Setting up client nodes... 2024-06-18T02:01:19.077 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-06-18T02:01:19.404 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:19 smithi007 ceph-mon[25091]: from='client.24377 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi130=a", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:01:19.404 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:19 smithi007 ceph-mon[25091]: Saving service grafana spec with placement smithi130=a;count:1 2024-06-18T02:01:19.404 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:19 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:19.405 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:19 smithi007 ceph-mon[29879]: from='client.24377 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi130=a", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:01:19.405 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:19 smithi007 ceph-mon[29879]: Saving service grafana spec with placement smithi130=a;count:1 2024-06-18T02:01:19.405 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:19 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:19.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:19 smithi130 ceph-mon[26123]: from='client.24377 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi130=a", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:01:19.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:19 smithi130 ceph-mon[26123]: Saving service grafana spec with placement smithi130=a;count:1 2024-06-18T02:01:19.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:19 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:20.427 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:20 smithi007 ceph-mon[25091]: pgmap v8: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:20.427 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:20 smithi007 ceph-mon[29879]: pgmap v8: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:20.450 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:20 smithi130 ceph-mon[26123]: pgmap v8: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:21.280 INFO:teuthology.orchestra.run.smithi007.stdout:[client.0] 2024-06-18T02:01:21.281 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQBx6nBmE/+aEBAAUZZ0OUDmGoGqYTcCm0szyQ== 2024-06-18T02:01:21.793 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:01:21 smithi130 systemd[1]: Starting Ceph prometheus.a for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:01:21.913 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-06-18T02:01:21.913 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-06-18T02:01:21.914 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-06-18T02:01:21.952 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-06-18T02:01:22.160 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:01:21 smithi130 podman[42226]: 2024-06-18 02:01:21.79907462 +0000 UTC m=+0.017818361 image pull 514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d quay.io/prometheus/prometheus:v2.33.4 2024-06-18T02:01:22.160 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:01:21 smithi130 podman[42226]: 2024-06-18 02:01:21.900024763 +0000 UTC m=+0.118768495 container create 71be092acb00c2c950ffdd45ade4450a3ed83e46fa11749c314a43ef4ab10a54 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-06-18T02:01:22.160 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:01:22 smithi130 podman[42226]: 2024-06-18 02:01:22.16085046 +0000 UTC m=+0.379594205 container init 71be092acb00c2c950ffdd45ade4450a3ed83e46fa11749c314a43ef4ab10a54 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-06-18T02:01:22.431 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:22 smithi007 ceph-mon[29879]: pgmap v9: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:22.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:22 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/413735978' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-06-18T02:01:22.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:22 smithi007 ceph-mon[29879]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-06-18T02:01:22.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:22 smithi007 ceph-mon[29879]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-06-18T02:01:22.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:22 smithi007 ceph-mon[25091]: pgmap v9: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:22.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:22 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/413735978' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-06-18T02:01:22.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:22 smithi007 ceph-mon[25091]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-06-18T02:01:22.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:22 smithi007 ceph-mon[25091]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-06-18T02:01:22.435 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:22 smithi130 ceph-mon[26123]: pgmap v9: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:22.435 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:22 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/413735978' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-06-18T02:01:22.435 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:22 smithi130 ceph-mon[26123]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-06-18T02:01:22.435 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:22 smithi130 ceph-mon[26123]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-06-18T02:01:22.436 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:01:22 smithi130 podman[42226]: 2024-06-18 02:01:22.16411551 +0000 UTC m=+0.382859249 container start 71be092acb00c2c950ffdd45ade4450a3ed83e46fa11749c314a43ef4ab10a54 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-06-18T02:01:22.436 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:01:22 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[42259]: ts=2024-06-18T02:01:22.187Z caller=main.go:475 level=info msg="No time or size retention was set so using the default time retention" duration=15d 2024-06-18T02:01:22.436 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:01:22 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[42259]: ts=2024-06-18T02:01:22.187Z caller=main.go:512 level=info msg="Starting Prometheus" version="(version=2.33.4, branch=HEAD, revision=83032011a5d3e6102624fe58241a374a7201fee8)" 2024-06-18T02:01:22.436 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:01:22 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[42259]: ts=2024-06-18T02:01:22.187Z caller=main.go:517 level=info build_context="(go=go1.17.7, user=root@d13bf69e7be8, date=20220222-16:51:28)" 2024-06-18T02:01:22.436 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:01:22 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[42259]: ts=2024-06-18T02:01:22.187Z caller=main.go:518 level=info host_details="(Linux 5.14.0-460.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024 x86_64 smithi130 (none))" 2024-06-18T02:01:22.436 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:01:22 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[42259]: ts=2024-06-18T02:01:22.187Z caller=main.go:519 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-06-18T02:01:22.436 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:01:22 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[42259]: ts=2024-06-18T02:01:22.187Z caller=main.go:520 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-06-18T02:01:22.436 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:01:22 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[42259]: ts=2024-06-18T02:01:22.188Z caller=web.go:570 level=info component=web msg="Start listening for connections" address=:9095 2024-06-18T02:01:22.436 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:01:22 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[42259]: ts=2024-06-18T02:01:22.189Z caller=main.go:923 level=info msg="Starting TSDB ..." 2024-06-18T02:01:22.437 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:01:22 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[42259]: ts=2024-06-18T02:01:22.190Z caller=tls_config.go:195 level=info component=web msg="TLS is disabled." http2=false 2024-06-18T02:01:22.437 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:01:22 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[42259]: ts=2024-06-18T02:01:22.191Z caller=head.go:493 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-06-18T02:01:22.437 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:01:22 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[42259]: ts=2024-06-18T02:01:22.191Z caller=head.go:527 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.546µs 2024-06-18T02:01:22.437 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:01:22 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[42259]: ts=2024-06-18T02:01:22.191Z caller=head.go:533 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-06-18T02:01:22.437 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:01:22 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[42259]: ts=2024-06-18T02:01:22.192Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=0 2024-06-18T02:01:22.437 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:01:22 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[42259]: ts=2024-06-18T02:01:22.192Z caller=head.go:610 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=17.917µs wal_replay_duration=688.073µs total_replay_duration=717.53µs 2024-06-18T02:01:22.437 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:01:22 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[42259]: ts=2024-06-18T02:01:22.193Z caller=main.go:944 level=info fs_type=XFS_SUPER_MAGIC 2024-06-18T02:01:22.437 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:01:22 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[42259]: ts=2024-06-18T02:01:22.193Z caller=main.go:947 level=info msg="TSDB started" 2024-06-18T02:01:22.437 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:01:22 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[42259]: ts=2024-06-18T02:01:22.193Z caller=main.go:1128 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-06-18T02:01:22.437 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:01:22 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[42259]: ts=2024-06-18T02:01:22.207Z caller=main.go:1165 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=14.196808ms db_storage=711ns remote_storage=1.147µs web_handler=300ns query_engine=456ns scrape=378.568µs scrape_sd=17.57µs notify=819ns notify_sd=1.249µs rules=13.616701ms 2024-06-18T02:01:22.437 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:01:22 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[42259]: ts=2024-06-18T02:01:22.207Z caller=main.go:896 level=info msg="Server is ready to receive web requests." 2024-06-18T02:01:22.437 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:01:22 smithi130 bash[42226]: 71be092acb00c2c950ffdd45ade4450a3ed83e46fa11749c314a43ef4ab10a54 2024-06-18T02:01:22.437 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:01:22 smithi130 systemd[1]: Started Ceph prometheus.a for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:01:23.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:23 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:23.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:23 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:01:23.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:23 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:01:23.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:23 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:01:23.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:23 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:23.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:23 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:01:23.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:23 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-06-18T02:01:23.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:23 smithi130 ceph-mon[26123]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-06-18T02:01:23.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:23 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.130:9095"}]: dispatch 2024-06-18T02:01:23.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:23 smithi130 ceph-mon[26123]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.130:9095"}]: dispatch 2024-06-18T02:01:23.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:23 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:23.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:23 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:01:23.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:23 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:01:23.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:23 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:01:23.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:23 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:23.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:23 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:01:23.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:23 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:01:23.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:23 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:01:23.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:23 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:01:23.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:23 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:23.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:23 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:01:23.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:23 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:23.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:23 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:01:23.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:23 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:01:23.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:23 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:01:23.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:23 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:23.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:23 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:01:23.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:23 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-06-18T02:01:23.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:23 smithi007 ceph-mon[29879]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-06-18T02:01:23.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:23 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.130:9095"}]: dispatch 2024-06-18T02:01:23.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:23 smithi007 ceph-mon[29879]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.130:9095"}]: dispatch 2024-06-18T02:01:23.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:23 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:23.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:23 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:01:23.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:23 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:01:23.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:23 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:01:23.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:23 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:23.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:23 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:01:23.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:23 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:01:23.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:23 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:01:23.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:23 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:01:23.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:23 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:23.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:23 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:01:23.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:23 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:23.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:23 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:01:23.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:23 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:01:23.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:23 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:01:23.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:23 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:23.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:23 smithi007 ceph-mon[25091]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:01:23.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:23 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-06-18T02:01:23.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:23 smithi007 ceph-mon[25091]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-06-18T02:01:23.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:23 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.130:9095"}]: dispatch 2024-06-18T02:01:23.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:23 smithi007 ceph-mon[25091]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.130:9095"}]: dispatch 2024-06-18T02:01:23.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:23 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:23.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:23 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:01:23.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:23 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:01:23.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:23 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:01:23.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:23 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:23.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:23 smithi007 ceph-mon[25091]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:01:23.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:23 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:01:23.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:23 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:01:23.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:23 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:01:23.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:23 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:23.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:23 smithi007 ceph-mon[25091]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:01:24.079 INFO:teuthology.orchestra.run.smithi130.stdout:[client.1] 2024-06-18T02:01:24.079 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQB06nBm3i6IBBAAvCcu/Bnaj8e49C6jHM43Og== 2024-06-18T02:01:24.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:24 smithi130 ceph-mon[26123]: pgmap v10: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:24.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:24 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:24.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:24 smithi130 ceph-mon[26123]: from='client.? 172.21.15.130:0/398450397' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-06-18T02:01:24.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:24 smithi130 ceph-mon[26123]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-06-18T02:01:24.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:24 smithi130 ceph-mon[26123]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-06-18T02:01:24.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:24 smithi007 ceph-mon[25091]: pgmap v10: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:24.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:24 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:24.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:24 smithi007 ceph-mon[25091]: from='client.? 172.21.15.130:0/398450397' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-06-18T02:01:24.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:24 smithi007 ceph-mon[25091]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-06-18T02:01:24.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:24 smithi007 ceph-mon[25091]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-06-18T02:01:24.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:24 smithi007 ceph-mon[29879]: pgmap v10: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:24.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:24 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:24.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:24 smithi007 ceph-mon[29879]: from='client.? 172.21.15.130:0/398450397' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-06-18T02:01:24.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:24 smithi007 ceph-mon[29879]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-06-18T02:01:24.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:24 smithi007 ceph-mon[29879]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-06-18T02:01:25.182 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:01:24 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.130 - - [18/Jun/2024:02:01:24] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:01:25.665 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-06-18T02:01:25.665 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-06-18T02:01:25.665 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-06-18T02:01:25.703 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-06-18T02:01:25.704 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-06-18T02:01:25.704 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph mgr dump --format=json 2024-06-18T02:01:25.936 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/mon.a/config 2024-06-18T02:01:25.977 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:25 smithi130 ceph-mon[26123]: pgmap v11: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:25.977 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:25 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:26.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:25 smithi007 ceph-mon[25091]: pgmap v11: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:26.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:25 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:26.041 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:25 smithi007 ceph-mon[29879]: pgmap v11: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:26.042 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:25 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:27.819 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-06-18T02:01:27.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:27 smithi007 ceph-mon[25091]: pgmap v12: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:27.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:27 smithi007 ceph-mon[29879]: pgmap v12: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:28.244 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:27 smithi130 ceph-mon[26123]: pgmap v12: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:28.517 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":20,"active_gid":14430,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":644881545},{"type":"v1","addr":"172.21.15.7:6801","nonce":644881545}]},"active_addr":"172.21.15.7:6801/644881545","active_change":"2024-06-18T02:01:07.727203+0000","active_mgr_features":4540138303579357183,"available":true,"standbys":[{"gid":24338,"name":"x","mgr_features":4540138303579357183,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.7:8443/","prometheus":"http://172.21.15.7:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":60,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":640466922}]},{"addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":3007699255}]},{"addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":1809748982}]},{"addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":3866859053}]}]}} 2024-06-18T02:01:28.523 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-06-18T02:01:28.523 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-06-18T02:01:28.523 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph osd dump --format=json 2024-06-18T02:01:28.752 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/mon.a/config 2024-06-18T02:01:29.093 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:28 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/399185032' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-06-18T02:01:29.093 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:28 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/399185032' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-06-18T02:01:29.122 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:28 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/399185032' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-06-18T02:01:29.930 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:29 smithi007 ceph-mon[25091]: pgmap v13: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:29.930 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:29 smithi007 ceph-mon[29879]: pgmap v13: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:30.222 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:29 smithi130 ceph-mon[26123]: pgmap v13: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:30.524 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:01:30 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.130 - - [18/Jun/2024:02:01:30] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:01:30.525 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:01:30 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.7 - - [18/Jun/2024:02:01:30] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:01:30.729 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-06-18T02:01:30.729 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":60,"fsid":"cd9a3408-2d15-11ef-bc9d-c7b262605968","created":"2024-06-18T01:55:40.695434+0000","modified":"2024-06-18T02:01:07.726762+0000","last_up_change":"2024-06-18T02:00:50.673310+0000","last_in_change":"2024-06-18T02:00:33.124275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-18T01:58:50.432227+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"85424ce1-096f-4fa9-b0e5-d1fe7b493345","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":442622498},{"type":"v1","addr":"172.21.15.7:6803","nonce":442622498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":442622498},{"type":"v1","addr":"172.21.15.7:6805","nonce":442622498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":442622498},{"type":"v1","addr":"172.21.15.7:6809","nonce":442622498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":442622498},{"type":"v1","addr":"172.21.15.7:6807","nonce":442622498}]},"public_addr":"172.21.15.7:6803/442622498","cluster_addr":"172.21.15.7:6805/442622498","heartbeat_back_addr":"172.21.15.7:6809/442622498","heartbeat_front_addr":"172.21.15.7:6807/442622498","state":["exists","up"]},{"osd":1,"uuid":"bf8ce607-af6a-4a49-b6f9-72b8ff585a90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":919695983},{"type":"v1","addr":"172.21.15.7:6811","nonce":919695983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":919695983},{"type":"v1","addr":"172.21.15.7:6813","nonce":919695983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":919695983},{"type":"v1","addr":"172.21.15.7:6817","nonce":919695983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":919695983},{"type":"v1","addr":"172.21.15.7:6815","nonce":919695983}]},"public_addr":"172.21.15.7:6811/919695983","cluster_addr":"172.21.15.7:6813/919695983","heartbeat_back_addr":"172.21.15.7:6817/919695983","heartbeat_front_addr":"172.21.15.7:6815/919695983","state":["exists","up"]},{"osd":2,"uuid":"b8baceb4-66a4-4833-b235-88fb6b9b5bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3268637445},{"type":"v1","addr":"172.21.15.7:6819","nonce":3268637445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":3268637445},{"type":"v1","addr":"172.21.15.7:6821","nonce":3268637445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3268637445},{"type":"v1","addr":"172.21.15.7:6825","nonce":3268637445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3268637445},{"type":"v1","addr":"172.21.15.7:6823","nonce":3268637445}]},"public_addr":"172.21.15.7:6819/3268637445","cluster_addr":"172.21.15.7:6821/3268637445","heartbeat_back_addr":"172.21.15.7:6825/3268637445","heartbeat_front_addr":"172.21.15.7:6823/3268637445","state":["exists","up"]},{"osd":3,"uuid":"45949dd3-a8f0-4310-a154-63faed8a3ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":1700854068},{"type":"v1","addr":"172.21.15.7:6827","nonce":1700854068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":1700854068},{"type":"v1","addr":"172.21.15.7:6829","nonce":1700854068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1700854068},{"type":"v1","addr":"172.21.15.7:6833","nonce":1700854068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":1700854068},{"type":"v1","addr":"172.21.15.7:6831","nonce":1700854068}]},"public_addr":"172.21.15.7:6827/1700854068","cluster_addr":"172.21.15.7:6829/1700854068","heartbeat_back_addr":"172.21.15.7:6833/1700854068","heartbeat_front_addr":"172.21.15.7:6831/1700854068","state":["exists","up"]},{"osd":4,"uuid":"1ef21401-4fcf-4da8-8136-e1e44a29d238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":626781335},{"type":"v1","addr":"172.21.15.130:6801","nonce":626781335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":626781335},{"type":"v1","addr":"172.21.15.130:6803","nonce":626781335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":626781335},{"type":"v1","addr":"172.21.15.130:6807","nonce":626781335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":626781335},{"type":"v1","addr":"172.21.15.130:6805","nonce":626781335}]},"public_addr":"172.21.15.130:6801/626781335","cluster_addr":"172.21.15.130:6803/626781335","heartbeat_back_addr":"172.21.15.130:6807/626781335","heartbeat_front_addr":"172.21.15.130:6805/626781335","state":["exists","up"]},{"osd":5,"uuid":"56d30fd0-94e8-4f04-8a7b-fa3e1078eb8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":4245072316},{"type":"v1","addr":"172.21.15.130:6809","nonce":4245072316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":4245072316},{"type":"v1","addr":"172.21.15.130:6811","nonce":4245072316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":4245072316},{"type":"v1","addr":"172.21.15.130:6815","nonce":4245072316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":4245072316},{"type":"v1","addr":"172.21.15.130:6813","nonce":4245072316}]},"public_addr":"172.21.15.130:6809/4245072316","cluster_addr":"172.21.15.130:6811/4245072316","heartbeat_back_addr":"172.21.15.130:6815/4245072316","heartbeat_front_addr":"172.21.15.130:6813/4245072316","state":["exists","up"]},{"osd":6,"uuid":"31a78fc2-4f3b-4eaf-bf58-b257d16be18d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":2703402227},{"type":"v1","addr":"172.21.15.130:6817","nonce":2703402227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":2703402227},{"type":"v1","addr":"172.21.15.130:6819","nonce":2703402227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":2703402227},{"type":"v1","addr":"172.21.15.130:6823","nonce":2703402227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":2703402227},{"type":"v1","addr":"172.21.15.130:6821","nonce":2703402227}]},"public_addr":"172.21.15.130:6817/2703402227","cluster_addr":"172.21.15.130:6819/2703402227","heartbeat_back_addr":"172.21.15.130:6823/2703402227","heartbeat_front_addr":"172.21.15.130:6821/2703402227","state":["exists","up"]},{"osd":7,"uuid":"cae59855-0c86-4a06-bc4e-fbee75a57976","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":3045894159},{"type":"v1","addr":"172.21.15.130:6825","nonce":3045894159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":3045894159},{"type":"v1","addr":"172.21.15.130:6827","nonce":3045894159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":3045894159},{"type":"v1","addr":"172.21.15.130:6831","nonce":3045894159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":3045894159},{"type":"v1","addr":"172.21.15.130:6829","nonce":3045894159}]},"public_addr":"172.21.15.130:6825/3045894159","cluster_addr":"172.21.15.130:6827/3045894159","heartbeat_back_addr":"172.21.15.130:6831/3045894159","heartbeat_front_addr":"172.21.15.130:6829/3045894159","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-06-18T01:57:59.162295+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-06-18T01:58:23.512469+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-06-18T01:58:47.185844+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-06-18T01:59:12.529139+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-06-18T01:59:35.610446+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-06-18T01:59:59.769056+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-06-18T02:00:24.666285+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-06-18T02:00:49.551354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/695930575":"2024-06-19T02:01:07.726704+0000","172.21.15.7:0/1860870067":"2024-06-19T02:01:07.726704+0000","172.21.15.7:0/1865804911":"2024-06-19T02:01:07.726704+0000","172.21.15.7:6801/3838966942":"2024-06-19T02:01:07.726704+0000","172.21.15.7:0/586006455":"2024-06-19T01:56:37.880404+0000","172.21.15.7:6801/4064257282":"2024-06-19T01:56:37.880404+0000","172.21.15.7:0/2859032966":"2024-06-19T01:56:37.880404+0000","172.21.15.7:6800/4064257282":"2024-06-19T01:56:37.880404+0000","172.21.15.7:0/2197821776":"2024-06-19T01:56:15.429295+0000","172.21.15.7:0/919215153":"2024-06-19T02:01:07.726704+0000","172.21.15.7:0/1098197333":"2024-06-19T01:56:15.429295+0000","172.21.15.7:0/3239039203":"2024-06-19T01:56:15.429295+0000","172.21.15.7:0/3183920300":"2024-06-19T01:56:37.880404+0000","172.21.15.7:6800/81675152":"2024-06-19T01:56:15.429295+0000","172.21.15.7:6800/3838966942":"2024-06-19T02:01:07.726704+0000","172.21.15.7:6801/81675152":"2024-06-19T01:56:15.429295+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-18T02:01:31.431 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:01:31 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.130 - - [18/Jun/2024:02:01:31] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:01:31.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:31 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:31.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:31 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:31.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:31 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:31.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:31 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/1048706094' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-18T02:01:31.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:31 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:31.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:31 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:31.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:31 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:01:31.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:31 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:01:31.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:31 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:01:31.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:31 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:31.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:31 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:31.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:31 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:31.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:31 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:31.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:31 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/1048706094' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-18T02:01:31.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:31 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:31.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:31 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:31.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:31 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:01:31.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:31 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:01:31.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:31 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:01:31.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:31 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:31.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:31 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:31.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:31 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:31.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:31 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:31.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:31 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/1048706094' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-18T02:01:31.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:31 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:31.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:31 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:31.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:31 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:01:31.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:31 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:01:31.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:31 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:01:31.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:31 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:32.614 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:32 smithi007 ceph-mon[25091]: pgmap v14: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:32.614 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:32 smithi007 ceph-mon[25091]: Deploying daemon node-exporter.a on smithi007 2024-06-18T02:01:32.614 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:32 smithi007 ceph-mon[29879]: pgmap v14: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:32.615 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:32 smithi007 ceph-mon[29879]: Deploying daemon node-exporter.a on smithi007 2024-06-18T02:01:32.638 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-06-18T02:01:32.639 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph osd dump --format=json 2024-06-18T02:01:32.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:32 smithi130 ceph-mon[26123]: pgmap v14: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:32.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:32 smithi130 ceph-mon[26123]: Deploying daemon node-exporter.a on smithi007 2024-06-18T02:01:32.881 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/mon.a/config 2024-06-18T02:01:34.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:34 smithi007 ceph-mon[25091]: pgmap v15: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:34.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:34 smithi007 ceph-mon[29879]: pgmap v15: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:34.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:34 smithi130 ceph-mon[26123]: pgmap v15: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:35.606 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-06-18T02:01:35.606 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":60,"fsid":"cd9a3408-2d15-11ef-bc9d-c7b262605968","created":"2024-06-18T01:55:40.695434+0000","modified":"2024-06-18T02:01:07.726762+0000","last_up_change":"2024-06-18T02:00:50.673310+0000","last_in_change":"2024-06-18T02:00:33.124275+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-18T01:58:50.432227+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"85424ce1-096f-4fa9-b0e5-d1fe7b493345","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":442622498},{"type":"v1","addr":"172.21.15.7:6803","nonce":442622498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":442622498},{"type":"v1","addr":"172.21.15.7:6805","nonce":442622498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":442622498},{"type":"v1","addr":"172.21.15.7:6809","nonce":442622498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":442622498},{"type":"v1","addr":"172.21.15.7:6807","nonce":442622498}]},"public_addr":"172.21.15.7:6803/442622498","cluster_addr":"172.21.15.7:6805/442622498","heartbeat_back_addr":"172.21.15.7:6809/442622498","heartbeat_front_addr":"172.21.15.7:6807/442622498","state":["exists","up"]},{"osd":1,"uuid":"bf8ce607-af6a-4a49-b6f9-72b8ff585a90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":919695983},{"type":"v1","addr":"172.21.15.7:6811","nonce":919695983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":919695983},{"type":"v1","addr":"172.21.15.7:6813","nonce":919695983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":919695983},{"type":"v1","addr":"172.21.15.7:6817","nonce":919695983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":919695983},{"type":"v1","addr":"172.21.15.7:6815","nonce":919695983}]},"public_addr":"172.21.15.7:6811/919695983","cluster_addr":"172.21.15.7:6813/919695983","heartbeat_back_addr":"172.21.15.7:6817/919695983","heartbeat_front_addr":"172.21.15.7:6815/919695983","state":["exists","up"]},{"osd":2,"uuid":"b8baceb4-66a4-4833-b235-88fb6b9b5bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3268637445},{"type":"v1","addr":"172.21.15.7:6819","nonce":3268637445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":3268637445},{"type":"v1","addr":"172.21.15.7:6821","nonce":3268637445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3268637445},{"type":"v1","addr":"172.21.15.7:6825","nonce":3268637445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3268637445},{"type":"v1","addr":"172.21.15.7:6823","nonce":3268637445}]},"public_addr":"172.21.15.7:6819/3268637445","cluster_addr":"172.21.15.7:6821/3268637445","heartbeat_back_addr":"172.21.15.7:6825/3268637445","heartbeat_front_addr":"172.21.15.7:6823/3268637445","state":["exists","up"]},{"osd":3,"uuid":"45949dd3-a8f0-4310-a154-63faed8a3ea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":1700854068},{"type":"v1","addr":"172.21.15.7:6827","nonce":1700854068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":1700854068},{"type":"v1","addr":"172.21.15.7:6829","nonce":1700854068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1700854068},{"type":"v1","addr":"172.21.15.7:6833","nonce":1700854068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":1700854068},{"type":"v1","addr":"172.21.15.7:6831","nonce":1700854068}]},"public_addr":"172.21.15.7:6827/1700854068","cluster_addr":"172.21.15.7:6829/1700854068","heartbeat_back_addr":"172.21.15.7:6833/1700854068","heartbeat_front_addr":"172.21.15.7:6831/1700854068","state":["exists","up"]},{"osd":4,"uuid":"1ef21401-4fcf-4da8-8136-e1e44a29d238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":626781335},{"type":"v1","addr":"172.21.15.130:6801","nonce":626781335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":626781335},{"type":"v1","addr":"172.21.15.130:6803","nonce":626781335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":626781335},{"type":"v1","addr":"172.21.15.130:6807","nonce":626781335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":626781335},{"type":"v1","addr":"172.21.15.130:6805","nonce":626781335}]},"public_addr":"172.21.15.130:6801/626781335","cluster_addr":"172.21.15.130:6803/626781335","heartbeat_back_addr":"172.21.15.130:6807/626781335","heartbeat_front_addr":"172.21.15.130:6805/626781335","state":["exists","up"]},{"osd":5,"uuid":"56d30fd0-94e8-4f04-8a7b-fa3e1078eb8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":4245072316},{"type":"v1","addr":"172.21.15.130:6809","nonce":4245072316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":4245072316},{"type":"v1","addr":"172.21.15.130:6811","nonce":4245072316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":4245072316},{"type":"v1","addr":"172.21.15.130:6815","nonce":4245072316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":4245072316},{"type":"v1","addr":"172.21.15.130:6813","nonce":4245072316}]},"public_addr":"172.21.15.130:6809/4245072316","cluster_addr":"172.21.15.130:6811/4245072316","heartbeat_back_addr":"172.21.15.130:6815/4245072316","heartbeat_front_addr":"172.21.15.130:6813/4245072316","state":["exists","up"]},{"osd":6,"uuid":"31a78fc2-4f3b-4eaf-bf58-b257d16be18d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":2703402227},{"type":"v1","addr":"172.21.15.130:6817","nonce":2703402227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":2703402227},{"type":"v1","addr":"172.21.15.130:6819","nonce":2703402227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":2703402227},{"type":"v1","addr":"172.21.15.130:6823","nonce":2703402227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":2703402227},{"type":"v1","addr":"172.21.15.130:6821","nonce":2703402227}]},"public_addr":"172.21.15.130:6817/2703402227","cluster_addr":"172.21.15.130:6819/2703402227","heartbeat_back_addr":"172.21.15.130:6823/2703402227","heartbeat_front_addr":"172.21.15.130:6821/2703402227","state":["exists","up"]},{"osd":7,"uuid":"cae59855-0c86-4a06-bc4e-fbee75a57976","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":3045894159},{"type":"v1","addr":"172.21.15.130:6825","nonce":3045894159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":3045894159},{"type":"v1","addr":"172.21.15.130:6827","nonce":3045894159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":3045894159},{"type":"v1","addr":"172.21.15.130:6831","nonce":3045894159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":3045894159},{"type":"v1","addr":"172.21.15.130:6829","nonce":3045894159}]},"public_addr":"172.21.15.130:6825/3045894159","cluster_addr":"172.21.15.130:6827/3045894159","heartbeat_back_addr":"172.21.15.130:6831/3045894159","heartbeat_front_addr":"172.21.15.130:6829/3045894159","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-06-18T01:57:59.162295+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-06-18T01:58:23.512469+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-06-18T01:58:47.185844+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-06-18T01:59:12.529139+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-06-18T01:59:35.610446+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-06-18T01:59:59.769056+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-06-18T02:00:24.666285+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-06-18T02:00:49.551354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/695930575":"2024-06-19T02:01:07.726704+0000","172.21.15.7:0/1860870067":"2024-06-19T02:01:07.726704+0000","172.21.15.7:0/1865804911":"2024-06-19T02:01:07.726704+0000","172.21.15.7:6801/3838966942":"2024-06-19T02:01:07.726704+0000","172.21.15.7:0/586006455":"2024-06-19T01:56:37.880404+0000","172.21.15.7:6801/4064257282":"2024-06-19T01:56:37.880404+0000","172.21.15.7:0/2859032966":"2024-06-19T01:56:37.880404+0000","172.21.15.7:6800/4064257282":"2024-06-19T01:56:37.880404+0000","172.21.15.7:0/2197821776":"2024-06-19T01:56:15.429295+0000","172.21.15.7:0/919215153":"2024-06-19T02:01:07.726704+0000","172.21.15.7:0/1098197333":"2024-06-19T01:56:15.429295+0000","172.21.15.7:0/3239039203":"2024-06-19T01:56:15.429295+0000","172.21.15.7:0/3183920300":"2024-06-19T01:56:37.880404+0000","172.21.15.7:6800/81675152":"2024-06-19T01:56:15.429295+0000","172.21.15.7:6800/3838966942":"2024-06-19T02:01:07.726704+0000","172.21.15.7:6801/81675152":"2024-06-19T01:56:15.429295+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-18T02:01:35.934 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:01:35 smithi007 podman[45888]: 2024-06-18 02:01:35.724225182 +0000 UTC m=+2.943922197 container create 68ab683466983f7df093c52ea097429680c325a4691345cdea246ff5e889e03b (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-06-18T02:01:35.934 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:01:35 smithi007 podman[45888]: 2024-06-18 02:01:35.93477429 +0000 UTC m=+3.154471305 container init 68ab683466983f7df093c52ea097429680c325a4691345cdea246ff5e889e03b (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-06-18T02:01:36.347 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:01:35 smithi007 podman[45888]: 2024-06-18 02:01:35.938079543 +0000 UTC m=+3.157776559 container start 68ab683466983f7df093c52ea097429680c325a4691345cdea246ff5e889e03b (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-06-18T02:01:36.348 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:01:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[46066]: ts=2024-06-18T02:01:35.942Z caller=node_exporter.go:182 level=info msg="Starting node_exporter" version="(version=1.3.1, branch=HEAD, revision=a2321e7b940ddcff26873612bccdf7cd4c42b6b6)" 2024-06-18T02:01:36.348 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:01:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[46066]: ts=2024-06-18T02:01:35.942Z caller=node_exporter.go:183 level=info msg="Build context" build_context="(go=go1.17.3, user=root@243aafa5525c, date=20211205-11:09:49)" 2024-06-18T02:01:36.348 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:01:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[46066]: ts=2024-06-18T02:01:35.942Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+)($|/) 2024-06-18T02:01:36.348 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:01:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[46066]: ts=2024-06-18T02:01:35.943Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-06-18T02:01:36.348 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:01:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[46066]: ts=2024-06-18T02:01:35.943Z caller=node_exporter.go:108 level=info msg="Enabled collectors" 2024-06-18T02:01:36.348 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:01:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[46066]: ts=2024-06-18T02:01:35.943Z caller=node_exporter.go:115 level=info collector=arp 2024-06-18T02:01:36.348 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:01:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[46066]: ts=2024-06-18T02:01:35.943Z caller=node_exporter.go:115 level=info collector=bcache 2024-06-18T02:01:36.348 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:01:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[46066]: ts=2024-06-18T02:01:35.943Z caller=node_exporter.go:115 level=info collector=bonding 2024-06-18T02:01:36.348 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:01:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[46066]: ts=2024-06-18T02:01:35.943Z caller=node_exporter.go:115 level=info collector=btrfs 2024-06-18T02:01:36.348 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:01:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[46066]: ts=2024-06-18T02:01:35.943Z caller=node_exporter.go:115 level=info collector=conntrack 2024-06-18T02:01:36.348 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:01:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[46066]: ts=2024-06-18T02:01:35.943Z caller=node_exporter.go:115 level=info collector=cpu 2024-06-18T02:01:36.348 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:01:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[46066]: ts=2024-06-18T02:01:35.943Z caller=node_exporter.go:115 level=info collector=cpufreq 2024-06-18T02:01:36.349 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:01:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[46066]: ts=2024-06-18T02:01:35.943Z caller=node_exporter.go:115 level=info collector=diskstats 2024-06-18T02:01:36.349 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:01:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[46066]: ts=2024-06-18T02:01:35.943Z caller=node_exporter.go:115 level=info collector=dmi 2024-06-18T02:01:36.349 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:01:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[46066]: ts=2024-06-18T02:01:35.943Z caller=node_exporter.go:115 level=info collector=edac 2024-06-18T02:01:36.349 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:01:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[46066]: ts=2024-06-18T02:01:35.943Z caller=node_exporter.go:115 level=info collector=entropy 2024-06-18T02:01:36.349 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:01:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[46066]: ts=2024-06-18T02:01:35.943Z caller=node_exporter.go:115 level=info collector=fibrechannel 2024-06-18T02:01:36.349 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:01:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[46066]: ts=2024-06-18T02:01:35.943Z caller=node_exporter.go:115 level=info collector=filefd 2024-06-18T02:01:36.349 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:01:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[46066]: ts=2024-06-18T02:01:35.943Z caller=node_exporter.go:115 level=info collector=filesystem 2024-06-18T02:01:36.349 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:01:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[46066]: ts=2024-06-18T02:01:35.943Z caller=node_exporter.go:115 level=info collector=hwmon 2024-06-18T02:01:36.350 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:01:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[46066]: ts=2024-06-18T02:01:35.943Z caller=node_exporter.go:115 level=info collector=infiniband 2024-06-18T02:01:36.350 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:01:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[46066]: ts=2024-06-18T02:01:35.943Z caller=node_exporter.go:115 level=info collector=ipvs 2024-06-18T02:01:36.350 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:01:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[46066]: ts=2024-06-18T02:01:35.943Z caller=node_exporter.go:115 level=info collector=loadavg 2024-06-18T02:01:36.350 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:01:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[46066]: ts=2024-06-18T02:01:35.943Z caller=node_exporter.go:115 level=info collector=mdadm 2024-06-18T02:01:36.350 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:01:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[46066]: ts=2024-06-18T02:01:35.943Z caller=node_exporter.go:115 level=info collector=meminfo 2024-06-18T02:01:36.350 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:01:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[46066]: ts=2024-06-18T02:01:35.943Z caller=node_exporter.go:115 level=info collector=netclass 2024-06-18T02:01:36.350 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:01:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[46066]: ts=2024-06-18T02:01:35.943Z caller=node_exporter.go:115 level=info collector=netdev 2024-06-18T02:01:36.350 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:01:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[46066]: ts=2024-06-18T02:01:35.943Z caller=node_exporter.go:115 level=info collector=netstat 2024-06-18T02:01:36.350 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:01:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[46066]: ts=2024-06-18T02:01:35.943Z caller=node_exporter.go:115 level=info collector=nfs 2024-06-18T02:01:36.350 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:01:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[46066]: ts=2024-06-18T02:01:35.943Z caller=node_exporter.go:115 level=info collector=nfsd 2024-06-18T02:01:36.350 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:01:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[46066]: ts=2024-06-18T02:01:35.943Z caller=node_exporter.go:115 level=info collector=nvme 2024-06-18T02:01:36.350 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:01:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[46066]: ts=2024-06-18T02:01:35.943Z caller=node_exporter.go:115 level=info collector=os 2024-06-18T02:01:36.351 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:01:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[46066]: ts=2024-06-18T02:01:35.943Z caller=node_exporter.go:115 level=info collector=powersupplyclass 2024-06-18T02:01:36.351 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:01:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[46066]: ts=2024-06-18T02:01:35.943Z caller=node_exporter.go:115 level=info collector=pressure 2024-06-18T02:01:36.351 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:01:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[46066]: ts=2024-06-18T02:01:35.943Z caller=node_exporter.go:115 level=info collector=rapl 2024-06-18T02:01:36.351 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:01:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[46066]: ts=2024-06-18T02:01:35.943Z caller=node_exporter.go:115 level=info collector=schedstat 2024-06-18T02:01:36.351 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:01:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[46066]: ts=2024-06-18T02:01:35.943Z caller=node_exporter.go:115 level=info collector=sockstat 2024-06-18T02:01:36.351 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:01:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[46066]: ts=2024-06-18T02:01:35.943Z caller=node_exporter.go:115 level=info collector=softnet 2024-06-18T02:01:36.351 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:01:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[46066]: ts=2024-06-18T02:01:35.943Z caller=node_exporter.go:115 level=info collector=stat 2024-06-18T02:01:36.351 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:01:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[46066]: ts=2024-06-18T02:01:35.943Z caller=node_exporter.go:115 level=info collector=tapestats 2024-06-18T02:01:36.351 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:01:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[46066]: ts=2024-06-18T02:01:35.943Z caller=node_exporter.go:115 level=info collector=textfile 2024-06-18T02:01:36.351 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:01:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[46066]: ts=2024-06-18T02:01:35.943Z caller=node_exporter.go:115 level=info collector=thermal_zone 2024-06-18T02:01:36.351 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:01:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[46066]: ts=2024-06-18T02:01:35.943Z caller=node_exporter.go:115 level=info collector=time 2024-06-18T02:01:36.351 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:01:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[46066]: ts=2024-06-18T02:01:35.943Z caller=node_exporter.go:115 level=info collector=udp_queues 2024-06-18T02:01:36.351 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:01:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[46066]: ts=2024-06-18T02:01:35.944Z caller=node_exporter.go:115 level=info collector=uname 2024-06-18T02:01:36.351 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:01:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[46066]: ts=2024-06-18T02:01:35.944Z caller=node_exporter.go:115 level=info collector=vmstat 2024-06-18T02:01:36.352 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:01:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[46066]: ts=2024-06-18T02:01:35.944Z caller=node_exporter.go:115 level=info collector=xfs 2024-06-18T02:01:36.352 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:01:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[46066]: ts=2024-06-18T02:01:35.944Z caller=node_exporter.go:115 level=info collector=zfs 2024-06-18T02:01:36.352 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:01:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[46066]: ts=2024-06-18T02:01:35.944Z caller=node_exporter.go:199 level=info msg="Listening on" address=:9100 2024-06-18T02:01:36.352 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:01:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[46066]: ts=2024-06-18T02:01:35.944Z caller=tls_config.go:195 level=info msg="TLS is disabled." http2=false 2024-06-18T02:01:36.352 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:01:36 smithi007 bash[45888]: 68ab683466983f7df093c52ea097429680c325a4691345cdea246ff5e889e03b 2024-06-18T02:01:36.352 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:01:36 smithi007 systemd[1]: Started Ceph node-exporter.a for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:01:36.389 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:36 smithi130 ceph-mon[26123]: pgmap v16: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:36.389 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:36 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/3968843655' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-18T02:01:36.389 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:36 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:36.656 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:36 smithi007 ceph-mon[25091]: pgmap v16: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:36.657 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:36 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/3968843655' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-18T02:01:36.657 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:36 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:36.657 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:36 smithi007 ceph-mon[29879]: pgmap v16: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:36.657 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:36 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/3968843655' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-18T02:01:36.657 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:36 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:36.685 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-06-18T02:01:36.686 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-06-18T02:01:36.686 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-06-18T02:01:36.687 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-06-18T02:01:36.687 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-06-18T02:01:36.688 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-06-18T02:01:36.688 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-06-18T02:01:36.688 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-06-18T02:01:36.961 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:36 smithi130 systemd[1]: Starting Ceph node-exporter.b for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:01:37.172 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/mon.a/config 2024-06-18T02:01:37.187 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/mon.a/config 2024-06-18T02:01:37.192 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/mon.a/config 2024-06-18T02:01:37.201 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/mon.a/config 2024-06-18T02:01:37.205 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/mon.a/config 2024-06-18T02:01:37.223 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/mon.a/config 2024-06-18T02:01:37.615 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:37 smithi007 ceph-mon[25091]: Deploying daemon node-exporter.b on smithi130 2024-06-18T02:01:37.615 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:37 smithi007 ceph-mon[29879]: Deploying daemon node-exporter.b on smithi130 2024-06-18T02:01:37.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:37 smithi130 ceph-mon[26123]: Deploying daemon node-exporter.b on smithi130 2024-06-18T02:01:37.794 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:36 smithi130 bash[43225]: Trying to pull quay.io/prometheus/node-exporter:v1.3.1... 2024-06-18T02:01:37.794 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:37 smithi130 bash[43225]: Getting image source signatures 2024-06-18T02:01:37.794 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:37 smithi130 bash[43225]: Copying blob sha256:b5db1e299295edf3005515ab7879c1df64a33c185d3a7a23aa4dcaa17d26f7b3 2024-06-18T02:01:37.794 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:37 smithi130 bash[43225]: Copying blob sha256:aa2a8d90b84cb2a9c422e7005cd166a008ccf22ef5d7d4f07128478585ce35ea 2024-06-18T02:01:37.794 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:37 smithi130 bash[43225]: Copying blob sha256:b45d31ee2d7f9f452678a85b0c837c29e12089f31ee8dbac6c8c24dfa4054a30 2024-06-18T02:01:38.405 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:38 smithi007 ceph-mon[25091]: pgmap v17: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:38.405 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:38 smithi007 ceph-mon[29879]: pgmap v17: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:38.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:38 smithi130 ceph-mon[26123]: pgmap v17: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:39.189 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:38 smithi130 bash[43225]: Copying config sha256:1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26 2024-06-18T02:01:39.189 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:38 smithi130 bash[43225]: Writing manifest to image destination 2024-06-18T02:01:39.454 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:39 smithi130 podman[43225]: 2024-06-18 02:01:39.137121914 +0000 UTC m=+2.270243539 image pull 1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26 quay.io/prometheus/node-exporter:v1.3.1 2024-06-18T02:01:39.454 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:39 smithi130 podman[43225]: 2024-06-18 02:01:39.227332922 +0000 UTC m=+2.360454530 container create 02601fb28ea2a255fc8df25ee2591541f44c91199fa5ce93e81b5c6ad5490aff (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-06-18T02:01:39.794 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:39 smithi130 podman[43225]: 2024-06-18 02:01:39.455175865 +0000 UTC m=+2.588297483 container init 02601fb28ea2a255fc8df25ee2591541f44c91199fa5ce93e81b5c6ad5490aff (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-06-18T02:01:39.794 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:39 smithi130 podman[43225]: 2024-06-18 02:01:39.458790484 +0000 UTC m=+2.591912094 container start 02601fb28ea2a255fc8df25ee2591541f44c91199fa5ce93e81b5c6ad5490aff (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-06-18T02:01:39.794 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[43277]: ts=2024-06-18T02:01:39.463Z caller=node_exporter.go:182 level=info msg="Starting node_exporter" version="(version=1.3.1, branch=HEAD, revision=a2321e7b940ddcff26873612bccdf7cd4c42b6b6)" 2024-06-18T02:01:39.794 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[43277]: ts=2024-06-18T02:01:39.463Z caller=node_exporter.go:183 level=info msg="Build context" build_context="(go=go1.17.3, user=root@243aafa5525c, date=20211205-11:09:49)" 2024-06-18T02:01:39.794 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[43277]: ts=2024-06-18T02:01:39.464Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+)($|/) 2024-06-18T02:01:39.794 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[43277]: ts=2024-06-18T02:01:39.464Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-06-18T02:01:39.794 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[43277]: ts=2024-06-18T02:01:39.464Z caller=node_exporter.go:108 level=info msg="Enabled collectors" 2024-06-18T02:01:39.794 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[43277]: ts=2024-06-18T02:01:39.464Z caller=node_exporter.go:115 level=info collector=arp 2024-06-18T02:01:39.795 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[43277]: ts=2024-06-18T02:01:39.464Z caller=node_exporter.go:115 level=info collector=bcache 2024-06-18T02:01:39.795 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[43277]: ts=2024-06-18T02:01:39.464Z caller=node_exporter.go:115 level=info collector=bonding 2024-06-18T02:01:39.795 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[43277]: ts=2024-06-18T02:01:39.464Z caller=node_exporter.go:115 level=info collector=btrfs 2024-06-18T02:01:39.795 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[43277]: ts=2024-06-18T02:01:39.464Z caller=node_exporter.go:115 level=info collector=conntrack 2024-06-18T02:01:39.795 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[43277]: ts=2024-06-18T02:01:39.464Z caller=node_exporter.go:115 level=info collector=cpu 2024-06-18T02:01:39.795 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[43277]: ts=2024-06-18T02:01:39.464Z caller=node_exporter.go:115 level=info collector=cpufreq 2024-06-18T02:01:39.795 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[43277]: ts=2024-06-18T02:01:39.464Z caller=node_exporter.go:115 level=info collector=diskstats 2024-06-18T02:01:39.795 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[43277]: ts=2024-06-18T02:01:39.464Z caller=node_exporter.go:115 level=info collector=dmi 2024-06-18T02:01:39.795 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[43277]: ts=2024-06-18T02:01:39.464Z caller=node_exporter.go:115 level=info collector=edac 2024-06-18T02:01:39.796 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[43277]: ts=2024-06-18T02:01:39.464Z caller=node_exporter.go:115 level=info collector=entropy 2024-06-18T02:01:39.796 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[43277]: ts=2024-06-18T02:01:39.464Z caller=node_exporter.go:115 level=info collector=fibrechannel 2024-06-18T02:01:39.796 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[43277]: ts=2024-06-18T02:01:39.464Z caller=node_exporter.go:115 level=info collector=filefd 2024-06-18T02:01:39.796 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[43277]: ts=2024-06-18T02:01:39.464Z caller=node_exporter.go:115 level=info collector=filesystem 2024-06-18T02:01:39.796 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[43277]: ts=2024-06-18T02:01:39.464Z caller=node_exporter.go:115 level=info collector=hwmon 2024-06-18T02:01:39.796 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[43277]: ts=2024-06-18T02:01:39.464Z caller=node_exporter.go:115 level=info collector=infiniband 2024-06-18T02:01:39.796 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[43277]: ts=2024-06-18T02:01:39.464Z caller=node_exporter.go:115 level=info collector=ipvs 2024-06-18T02:01:39.796 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[43277]: ts=2024-06-18T02:01:39.464Z caller=node_exporter.go:115 level=info collector=loadavg 2024-06-18T02:01:39.796 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[43277]: ts=2024-06-18T02:01:39.464Z caller=node_exporter.go:115 level=info collector=mdadm 2024-06-18T02:01:39.796 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[43277]: ts=2024-06-18T02:01:39.464Z caller=node_exporter.go:115 level=info collector=meminfo 2024-06-18T02:01:39.796 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[43277]: ts=2024-06-18T02:01:39.464Z caller=node_exporter.go:115 level=info collector=netclass 2024-06-18T02:01:39.796 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[43277]: ts=2024-06-18T02:01:39.464Z caller=node_exporter.go:115 level=info collector=netdev 2024-06-18T02:01:39.797 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[43277]: ts=2024-06-18T02:01:39.464Z caller=node_exporter.go:115 level=info collector=netstat 2024-06-18T02:01:39.797 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[43277]: ts=2024-06-18T02:01:39.464Z caller=node_exporter.go:115 level=info collector=nfs 2024-06-18T02:01:39.797 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[43277]: ts=2024-06-18T02:01:39.465Z caller=node_exporter.go:115 level=info collector=nfsd 2024-06-18T02:01:39.797 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[43277]: ts=2024-06-18T02:01:39.465Z caller=node_exporter.go:115 level=info collector=nvme 2024-06-18T02:01:39.797 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[43277]: ts=2024-06-18T02:01:39.465Z caller=node_exporter.go:115 level=info collector=os 2024-06-18T02:01:39.797 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[43277]: ts=2024-06-18T02:01:39.465Z caller=node_exporter.go:115 level=info collector=powersupplyclass 2024-06-18T02:01:39.797 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[43277]: ts=2024-06-18T02:01:39.465Z caller=node_exporter.go:115 level=info collector=pressure 2024-06-18T02:01:39.797 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[43277]: ts=2024-06-18T02:01:39.465Z caller=node_exporter.go:115 level=info collector=rapl 2024-06-18T02:01:39.797 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[43277]: ts=2024-06-18T02:01:39.465Z caller=node_exporter.go:115 level=info collector=schedstat 2024-06-18T02:01:39.797 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[43277]: ts=2024-06-18T02:01:39.465Z caller=node_exporter.go:115 level=info collector=sockstat 2024-06-18T02:01:39.797 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[43277]: ts=2024-06-18T02:01:39.465Z caller=node_exporter.go:115 level=info collector=softnet 2024-06-18T02:01:39.797 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[43277]: ts=2024-06-18T02:01:39.465Z caller=node_exporter.go:115 level=info collector=stat 2024-06-18T02:01:39.797 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[43277]: ts=2024-06-18T02:01:39.465Z caller=node_exporter.go:115 level=info collector=tapestats 2024-06-18T02:01:39.798 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[43277]: ts=2024-06-18T02:01:39.465Z caller=node_exporter.go:115 level=info collector=textfile 2024-06-18T02:01:39.798 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[43277]: ts=2024-06-18T02:01:39.465Z caller=node_exporter.go:115 level=info collector=thermal_zone 2024-06-18T02:01:39.798 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[43277]: ts=2024-06-18T02:01:39.465Z caller=node_exporter.go:115 level=info collector=time 2024-06-18T02:01:39.798 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[43277]: ts=2024-06-18T02:01:39.465Z caller=node_exporter.go:115 level=info collector=udp_queues 2024-06-18T02:01:39.798 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[43277]: ts=2024-06-18T02:01:39.465Z caller=node_exporter.go:115 level=info collector=uname 2024-06-18T02:01:39.798 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[43277]: ts=2024-06-18T02:01:39.465Z caller=node_exporter.go:115 level=info collector=vmstat 2024-06-18T02:01:39.798 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[43277]: ts=2024-06-18T02:01:39.465Z caller=node_exporter.go:115 level=info collector=xfs 2024-06-18T02:01:39.798 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[43277]: ts=2024-06-18T02:01:39.465Z caller=node_exporter.go:115 level=info collector=zfs 2024-06-18T02:01:39.798 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[43277]: ts=2024-06-18T02:01:39.465Z caller=node_exporter.go:199 level=info msg="Listening on" address=:9100 2024-06-18T02:01:39.798 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[43277]: ts=2024-06-18T02:01:39.465Z caller=tls_config.go:195 level=info msg="TLS is disabled." http2=false 2024-06-18T02:01:39.798 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:39 smithi130 bash[43225]: 02601fb28ea2a255fc8df25ee2591541f44c91199fa5ce93e81b5c6ad5490aff 2024-06-18T02:01:39.798 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:01:39 smithi130 systemd[1]: Started Ceph node-exporter.b for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:01:40.644 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:40 smithi007 ceph-mon[25091]: pgmap v18: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:40.644 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:40 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:40.645 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:40 smithi007 ceph-mon[29879]: pgmap v18: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:40.645 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:40 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:40.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:40 smithi130 ceph-mon[26123]: pgmap v18: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:40.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:40 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:41.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:41 smithi130 ceph-mon[26123]: Deploying daemon alertmanager.a on smithi007 2024-06-18T02:01:41.551 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:41 smithi007 ceph-mon[25091]: Deploying daemon alertmanager.a on smithi007 2024-06-18T02:01:41.552 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:41 smithi007 ceph-mon[29879]: Deploying daemon alertmanager.a on smithi007 2024-06-18T02:01:41.767 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/mon.a/config 2024-06-18T02:01:42.509 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:42 smithi007 ceph-mon[25091]: pgmap v19: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:42.510 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:42 smithi007 ceph-mon[29879]: pgmap v19: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:42.779 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:42 smithi130 ceph-mon[26123]: pgmap v19: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:44.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:44 smithi007 ceph-mon[25091]: pgmap v20: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:44.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:44 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:44.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:44 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:44.432 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:01:44 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.130 - - [18/Jun/2024:02:01:44] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:01:44.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:44 smithi007 ceph-mon[29879]: pgmap v20: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:44.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:44 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:44.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:44 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:44.659 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:44 smithi130 ceph-mon[26123]: pgmap v20: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:44.659 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:44 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:44.659 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:44 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:46.181 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:01:45 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.130 - - [18/Jun/2024:02:01:45] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:01:46.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:46 smithi007 ceph-mon[25091]: pgmap v21: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:46.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:46 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:46.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:46 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:46.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:46 smithi007 ceph-mon[29879]: pgmap v21: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:46.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:46 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:46.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:46 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:46.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:46 smithi130 ceph-mon[26123]: pgmap v21: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:46.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:46 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:46.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:46 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:48.626 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:48 smithi007 ceph-mon[25091]: pgmap v22: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:48.627 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:48 smithi007 ceph-mon[29879]: pgmap v22: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:48.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:48 smithi130 ceph-mon[26123]: pgmap v22: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:49.711 INFO:teuthology.orchestra.run.smithi007.stdout:236223201291 2024-06-18T02:01:49.711 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-06-18T02:01:50.006 INFO:teuthology.orchestra.run.smithi007.stdout:167503724566 2024-06-18T02:01:50.006 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-06-18T02:01:50.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:50 smithi007 ceph-mon[25091]: pgmap v23: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:50.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:50 smithi007 ceph-mon[29879]: pgmap v23: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:50.682 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:01:50 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.7 - - [18/Jun/2024:02:01:50] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:01:50.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:50 smithi130 ceph-mon[26123]: pgmap v23: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:51.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:51 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:51.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:51 smithi007 ceph-mon[25091]: pgmap v24: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:51.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:51 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:51.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:51 smithi007 ceph-mon[29879]: pgmap v24: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:51.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:51 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:01:51.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:51 smithi130 ceph-mon[26123]: pgmap v24: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:51.811 INFO:teuthology.orchestra.run.smithi007.stdout:34359738415 2024-06-18T02:01:51.811 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-06-18T02:01:52.453 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/mon.a/config 2024-06-18T02:01:52.972 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/mon.a/config 2024-06-18T02:01:52.973 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/mon.a/config 2024-06-18T02:01:53.883 INFO:teuthology.orchestra.run.smithi007.stdout:77309411365 2024-06-18T02:01:53.883 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-06-18T02:01:53.931 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:53 smithi007 ceph-mon[29879]: pgmap v25: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:53.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:53 smithi007 ceph-mon[25091]: pgmap v25: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:54.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:53 smithi130 ceph-mon[26123]: pgmap v25: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:54.743 INFO:teuthology.orchestra.run.smithi007.stdout:201863462930 2024-06-18T02:01:54.743 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-06-18T02:01:55.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:55 smithi007 ceph-mon[25091]: pgmap v26: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:55.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:55 smithi007 ceph-mon[29879]: pgmap v26: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:56.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:55 smithi130 ceph-mon[26123]: pgmap v26: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:58.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:57 smithi130 ceph-mon[26123]: pgmap v27: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:58.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:57 smithi007 ceph-mon[25091]: pgmap v27: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:58.089 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:57 smithi007 ceph-mon[29879]: pgmap v27: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:59.989 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:01:59 smithi007 ceph-mon[25091]: pgmap v28: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:01:59.989 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:01:59 smithi007 ceph-mon[29879]: pgmap v28: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:00.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:01:59 smithi130 ceph-mon[26123]: pgmap v28: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:00.764 INFO:teuthology.orchestra.run.smithi007.stdout:236223201295 2024-06-18T02:02:00.991 INFO:teuthology.orchestra.run.smithi007.stdout:111669149730 2024-06-18T02:02:00.992 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-06-18T02:02:01.588 INFO:tasks.cephadm.ceph_manager.ceph:need seq 236223201291 got 236223201295 for osd.7 2024-06-18T02:02:01.588 DEBUG:teuthology.parallel:result is None 2024-06-18T02:02:01.619 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/mon.a/config 2024-06-18T02:02:01.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:01 smithi130 ceph-mon[26123]: pgmap v29: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:01.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:01 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/1397777378' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-06-18T02:02:01.931 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:01 smithi007 ceph-mon[29879]: pgmap v29: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:01.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:01 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/1397777378' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-06-18T02:02:01.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:01 smithi007 ceph-mon[25091]: pgmap v29: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:01.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:01 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/1397777378' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-06-18T02:02:02.047 INFO:teuthology.orchestra.run.smithi007.stdout:55834574891 2024-06-18T02:02:02.047 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-06-18T02:02:02.664 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/mon.a/config 2024-06-18T02:02:02.665 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/mon.a/config 2024-06-18T02:02:02.767 INFO:teuthology.orchestra.run.smithi007.stdout:167503724569 2024-06-18T02:02:03.227 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:02:02 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.130 - - [18/Jun/2024:02:02:02] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:02:03.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:03 smithi130 ceph-mon[26123]: pgmap v30: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:03.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:03 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/2889867833' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-06-18T02:02:03.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:03 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:03.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:03 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:03.859 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:03 smithi007 ceph-mon[25091]: pgmap v30: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:03.860 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:03 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/2889867833' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-06-18T02:02:03.860 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:03 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:03.860 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:03 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:03.860 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:03 smithi007 ceph-mon[29879]: pgmap v30: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:03.860 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:03 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/2889867833' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-06-18T02:02:03.860 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:03 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:03.860 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:03 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:05.474 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724566 got 167503724569 for osd.5 2024-06-18T02:02:05.475 DEBUG:teuthology.parallel:result is None 2024-06-18T02:02:05.957 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:05 smithi007 ceph-mon[25091]: pgmap v31: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:05.957 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:05 smithi007 ceph-mon[29879]: pgmap v31: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:05.965 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/mon.a/config 2024-06-18T02:02:06.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:05 smithi130 ceph-mon[26123]: pgmap v31: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:07.306 INFO:teuthology.orchestra.run.smithi007.stdout:133143986207 2024-06-18T02:02:07.306 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-06-18T02:02:07.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:07 smithi007 ceph-mon[25091]: pgmap v32: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:07.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:07 smithi007 ceph-mon[29879]: pgmap v32: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:08.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:07 smithi130 ceph-mon[26123]: pgmap v32: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:09.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:08 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/1118433646' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-06-18T02:02:09.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:08 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-06-18T02:02:09.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:08 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-06-18T02:02:09.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:08 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/1118433646' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-06-18T02:02:09.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:08 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-06-18T02:02:09.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:08 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-06-18T02:02:09.087 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:08 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/1118433646' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-06-18T02:02:09.088 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:08 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-06-18T02:02:09.088 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:08 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-06-18T02:02:09.557 INFO:teuthology.orchestra.run.smithi007.stdout:201863462933 2024-06-18T02:02:09.625 INFO:teuthology.orchestra.run.smithi007.stdout:34359738419 2024-06-18T02:02:09.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:09 smithi007 ceph-mon[25091]: pgmap v33: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:09.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:09 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/2324992810' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-06-18T02:02:09.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:09 smithi007 ceph-mon[29879]: pgmap v33: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:09.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:09 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/2324992810' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-06-18T02:02:09.932 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:02:09 smithi007 podman[48595]: 2024-06-18 02:02:09.73538985 +0000 UTC m=+0.250546640 image pull ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4 quay.io/prometheus/alertmanager:v0.23.0 2024-06-18T02:02:10.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:09 smithi130 ceph-mon[26123]: pgmap v33: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:10.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:09 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/2324992810' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-06-18T02:02:10.128 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462930 got 201863462933 for osd.6 2024-06-18T02:02:10.128 DEBUG:teuthology.parallel:result is None 2024-06-18T02:02:10.738 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:02:10 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.7 - - [18/Jun/2024:02:02:10] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:02:10.739 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:02:10 smithi007 podman[48595]: 2024-06-18 02:02:10.457149693 +0000 UTC m=+0.972306471 volume create 914db7f1820e17963e67d97b28328bd802654a1c669683ff13cafdadca98df33 2024-06-18T02:02:10.739 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:02:10 smithi007 podman[48595]: 2024-06-18 02:02:10.557970288 +0000 UTC m=+1.073127065 container create d2ea381be400502e4e392808380b30c19b84638a1fda17eb4fa4a182b35b051d (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-06-18T02:02:11.182 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:02:10 smithi007 podman[48595]: 2024-06-18 02:02:10.860908659 +0000 UTC m=+1.376065452 container init d2ea381be400502e4e392808380b30c19b84638a1fda17eb4fa4a182b35b051d (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-06-18T02:02:11.182 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:02:10 smithi007 podman[48595]: 2024-06-18 02:02:10.863668501 +0000 UTC m=+1.378825290 container start d2ea381be400502e4e392808380b30c19b84638a1fda17eb4fa4a182b35b051d (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-06-18T02:02:11.182 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:02:10 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[48650]: level=info ts=2024-06-18T02:02:10.874Z caller=main.go:225 msg="Starting Alertmanager" version="(version=0.23.0, branch=HEAD, revision=61046b17771a57cfd4c4a51be370ab930a4d7d54)" 2024-06-18T02:02:11.182 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:02:10 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[48650]: level=info ts=2024-06-18T02:02:10.874Z caller=main.go:226 build_context="(go=go1.16.7, user=root@e21a959be8d2, date=20210825-10:48:55)" 2024-06-18T02:02:11.182 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:02:10 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[48650]: level=info ts=2024-06-18T02:02:10.875Z caller=cluster.go:184 component=cluster msg="setting advertise address explicitly" addr=172.21.15.7 port=9094 2024-06-18T02:02:11.182 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:02:10 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[48650]: level=info ts=2024-06-18T02:02:10.877Z caller=cluster.go:671 component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-06-18T02:02:11.182 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:02:10 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[48650]: level=info ts=2024-06-18T02:02:10.902Z caller=coordinator.go:113 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-06-18T02:02:11.182 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:02:10 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[48650]: level=info ts=2024-06-18T02:02:10.903Z caller=coordinator.go:126 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-06-18T02:02:11.182 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:02:10 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[48650]: level=info ts=2024-06-18T02:02:10.905Z caller=main.go:518 msg=Listening address=:9093 2024-06-18T02:02:11.183 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:02:10 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[48650]: level=info ts=2024-06-18T02:02:10.905Z caller=tls_config.go:191 msg="TLS is disabled." http2=false 2024-06-18T02:02:11.183 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:02:10 smithi007 bash[48595]: d2ea381be400502e4e392808380b30c19b84638a1fda17eb4fa4a182b35b051d 2024-06-18T02:02:11.183 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:02:10 smithi007 systemd[1]: Started Ceph alertmanager.a for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:02:11.260 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/mon.a/config 2024-06-18T02:02:11.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:11 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:11.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:11 smithi007 ceph-mon[25091]: pgmap v34: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:11.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:11 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:11.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:11 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:11.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:11 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:11.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:11 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-06-18T02:02:11.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:11 smithi007 ceph-mon[25091]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-06-18T02:02:11.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:11 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:11.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:11 smithi007 ceph-mon[25091]: Deploying daemon grafana.a on smithi130 2024-06-18T02:02:11.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:11 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:11.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:11 smithi007 ceph-mon[29879]: pgmap v34: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:11.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:11 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:11.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:11 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:11.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:11 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:11.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:11 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-06-18T02:02:11.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:11 smithi007 ceph-mon[29879]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-06-18T02:02:11.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:11 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:11.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:11 smithi007 ceph-mon[29879]: Deploying daemon grafana.a on smithi130 2024-06-18T02:02:11.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:11 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:11.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:11 smithi130 ceph-mon[26123]: pgmap v34: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:11.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:11 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:11.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:11 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:11.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:11 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:11.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:11 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-06-18T02:02:11.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:11 smithi130 ceph-mon[26123]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-06-18T02:02:11.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:11 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:11.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:11 smithi130 ceph-mon[26123]: Deploying daemon grafana.a on smithi130 2024-06-18T02:02:12.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:12 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/2087120137' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-06-18T02:02:12.877 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:12 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/2087120137' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-06-18T02:02:13.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:12 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/2087120137' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-06-18T02:02:13.163 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:02:12 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[48650]: level=info ts=2024-06-18T02:02:12.878Z caller=cluster.go:696 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000946645s 2024-06-18T02:02:13.187 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738415 got 34359738419 for osd.0 2024-06-18T02:02:13.187 DEBUG:teuthology.parallel:result is None 2024-06-18T02:02:13.482 INFO:teuthology.orchestra.run.smithi007.stdout:77309411369 2024-06-18T02:02:13.915 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:13 smithi007 ceph-mon[29879]: pgmap v35: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:13.915 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:13 smithi007 ceph-mon[25091]: pgmap v35: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:14.040 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411365 got 77309411369 for osd.2 2024-06-18T02:02:14.040 DEBUG:teuthology.parallel:result is None 2024-06-18T02:02:14.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:13 smithi130 ceph-mon[26123]: pgmap v35: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:14.248 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/mon.a/config 2024-06-18T02:02:14.434 INFO:teuthology.orchestra.run.smithi007.stdout:111669149733 2024-06-18T02:02:14.950 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:14 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:14.950 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:14 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/2754516798' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-06-18T02:02:14.950 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:14 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:14.950 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:14 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/2754516798' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-06-18T02:02:15.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:14 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:15.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:14 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/2754516798' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-06-18T02:02:15.729 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149730 got 111669149733 for osd.3 2024-06-18T02:02:15.729 DEBUG:teuthology.parallel:result is None 2024-06-18T02:02:15.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:15 smithi007 ceph-mon[25091]: pgmap v36: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:15.954 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:15 smithi007 ceph-mon[29879]: pgmap v36: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:16.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:15 smithi130 ceph-mon[26123]: pgmap v36: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:16.604 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:02:16 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.7 - - [18/Jun/2024:02:02:16] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:02:17.602 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:17 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:17.602 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:17 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:17.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:17 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:18.182 INFO:teuthology.orchestra.run.smithi007.stdout:133143986209 2024-06-18T02:02:18.431 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:18 smithi007 ceph-mon[29879]: pgmap v37: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:18.431 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:18 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/1532096619' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-06-18T02:02:18.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:18 smithi007 ceph-mon[25091]: pgmap v37: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:18.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:18 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/1532096619' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-06-18T02:02:18.694 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:18 smithi130 ceph-mon[26123]: pgmap v37: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:18.694 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:18 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/1532096619' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-06-18T02:02:18.752 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986207 got 133143986209 for osd.4 2024-06-18T02:02:18.752 DEBUG:teuthology.parallel:result is None 2024-06-18T02:02:19.849 INFO:teuthology.orchestra.run.smithi007.stdout:55834574895 2024-06-18T02:02:20.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:20 smithi130 ceph-mon[26123]: pgmap v38: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:20.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:20 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/3219401661' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-06-18T02:02:20.665 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:20 smithi007 ceph-mon[25091]: pgmap v38: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:20.665 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:20 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/3219401661' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-06-18T02:02:20.665 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:20 smithi007 ceph-mon[29879]: pgmap v38: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:20.665 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:20 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/3219401661' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-06-18T02:02:20.692 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574891 got 55834574895 for osd.1 2024-06-18T02:02:20.692 DEBUG:teuthology.parallel:result is None 2024-06-18T02:02:20.692 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-06-18T02:02:20.692 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph pg dump --format=json 2024-06-18T02:02:20.931 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:02:20 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[48650]: level=info ts=2024-06-18T02:02:20.880Z caller=cluster.go:688 component=cluster msg="gossip settled; proceeding" elapsed=10.003584508s 2024-06-18T02:02:21.082 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/mon.a/config 2024-06-18T02:02:22.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:22 smithi130 ceph-mon[26123]: pgmap v39: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:22.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:22 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:22.613 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:22 smithi007 ceph-mon[25091]: pgmap v39: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:22.613 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:22 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:22.613 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:02:22 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.7 - - [18/Jun/2024:02:02:22] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:02:22.614 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:22 smithi007 ceph-mon[29879]: pgmap v39: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:22.614 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:22 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:23.174 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:02:23 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.130 - - [18/Jun/2024:02:02:23] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:02:23.407 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-06-18T02:02:23.408 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-06-18T02:02:24.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:24 smithi007 ceph-mon[25091]: pgmap v40: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:24.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:24 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:24.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:24 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:24.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:24 smithi007 ceph-mon[25091]: from='client.14598 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-18T02:02:24.127 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:24 smithi007 ceph-mon[29879]: pgmap v40: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:24.127 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:24 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:24.127 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:24 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:24.127 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:24 smithi007 ceph-mon[29879]: from='client.14598 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-18T02:02:24.431 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:02:24 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.7 - - [18/Jun/2024:02:02:24] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:02:24.494 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2024-06-18T02:02:22.634730+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1586784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":749961216,"kb_used":48848,"kb_used_data":6160,"kb_used_omap":0,"kb_used_meta":42624,"kb_avail":749912368,"statfs":{"total":767960285184,"available":767910264832,"internally_reserved":0,"allocated":6307840,"data_stored":3511476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":43646976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002389"},"pg_stats":[{"pgid":"1.0","version":"60'128","reported_seq":267,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-06-18T02:01:08.716465+0000","last_change":"2024-06-18T02:00:55.428571+0000","last_active":"2024-06-18T02:01:08.716465+0000","last_peered":"2024-06-18T02:01:08.716465+0000","last_clean":"2024-06-18T02:01:08.716465+0000","last_became_active":"2024-06-18T02:00:55.428139+0000","last_became_peered":"2024-06-18T02:00:55.428139+0000","last_unstale":"2024-06-18T02:01:08.716465+0000","last_undegraded":"2024-06-18T02:01:08.716465+0000","last_fullsized":"2024-06-18T02:01:08.716465+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-18T01:58:50.912270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-18T01:58:50.912270+0000","last_clean_scrub_stamp":"2024-06-18T01:58:50.912270+0000","objects_scrubbed":0,"log_size":128,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-19T10:51:57.975538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1586784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1586784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1597440,"data_stored":1586784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201299,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6096,"kb_used_data":1096,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":93739056,"statfs":{"total":95995035648,"available":95988793344,"internally_reserved":0,"allocated":1122304,"data_stored":769588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jun 18 02:01:53 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.501}]},{"osd":1,"last update":"Tue Jun 18 02:01:53 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.45800000000000002}]},{"osd":2,"last update":"Tue Jun 18 02:01:53 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.47299999999999998}]},{"osd":3,"last update":"Tue Jun 18 02:01:53 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.433},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.49199999999999999}]},{"osd":4,"last update":"Tue Jun 18 02:01:53 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.35699999999999998}]},{"osd":5,"last update":"Tue Jun 18 02:01:53 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.441},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.42299999999999999}]},{"osd":6,"last update":"Tue Jun 18 02:01:53 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.46600000000000003}]}]},{"osd":6,"up_from":47,"seq":201863462936,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6160,"kb_used_data":1096,"kb_used_omap":0,"kb_used_meta":5056,"kb_avail":93738992,"statfs":{"total":95995035648,"available":95988727808,"internally_reserved":0,"allocated":1122304,"data_stored":769588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5177344},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jun 18 02:01:26 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":2.9889999999999999,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.373}]},{"osd":1,"last update":"Tue Jun 18 02:01:26 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.504},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":3.0110000000000001,"5min":3.0110000000000001,"15min":3.0110000000000001},"last":0.41899999999999998}]},{"osd":2,"last update":"Tue Jun 18 02:01:26 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":3.0369999999999999,"5min":3.0369999999999999,"15min":3.0369999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.44400000000000001}]},{"osd":3,"last update":"Tue Jun 18 02:01:26 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":3.0249999999999999,"5min":3.0249999999999999,"15min":3.0249999999999999},"last":0.48299999999999998}]},{"osd":4,"last update":"Tue Jun 18 02:01:26 2024","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"last":0.35699999999999998}]},{"osd":5,"last update":"Tue Jun 18 02:01:26 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.45900000000000002}]},{"osd":7,"last update":"Tue Jun 18 02:01:51 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.47599999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":6344,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":5760,"kb_avail":93738808,"statfs":{"total":95995035648,"available":95988539392,"internally_reserved":0,"allocated":589824,"data_stored":240660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5898240},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jun 18 02:01:28 2024","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.36699999999999999,"15min":0.34899999999999998},"min":{"1min":0.254,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.376,"15min":0.36099999999999999},"min":{"1min":0.23699999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.45100000000000001}]},{"osd":2,"last update":"Tue Jun 18 02:01:57 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.41399999999999998,"15min":0.40000000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.40999999999999998,"15min":0.40300000000000002},"min":{"1min":0.255,"5min":0.248,"15min":0.248},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.38900000000000001}]},{"osd":3,"last update":"Tue Jun 18 02:01:18 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.48299999999999998,"15min":0.48099999999999998},"min":{"1min":0.28899999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.36699999999999999}]},{"osd":4,"last update":"Tue Jun 18 02:01:39 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.58099999999999996,"15min":0.58399999999999996},"min":{"1min":0.442,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.623,"15min":0.624},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.81899999999999995,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.48699999999999999}]},{"osd":5,"last update":"Tue Jun 18 02:02:03 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.435,"5min":0.433,"15min":0.433},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.58599999999999997,"15min":0.58199999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.64700000000000002}]},{"osd":6,"last update":"Tue Jun 18 02:01:28 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.52800000000000002}]},{"osd":7,"last update":"Tue Jun 18 02:01:51 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.442}]}]},{"osd":0,"up_from":8,"seq":34359738422,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6928,"kb_used_data":1096,"kb_used_omap":0,"kb_used_meta":5824,"kb_avail":93738224,"statfs":{"total":95995035648,"available":95987941376,"internally_reserved":0,"allocated":1122304,"data_stored":769588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5963776},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Jun 18 02:01:28 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.34999999999999998,"15min":0.33900000000000002},"min":{"1min":0.24399999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.38200000000000001,"15min":0.36899999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.35199999999999998}]},{"osd":2,"last update":"Tue Jun 18 02:01:57 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.40100000000000002,"15min":0.39600000000000002},"min":{"1min":0.27800000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.44700000000000001,"15min":0.44600000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.378}]},{"osd":3,"last update":"Tue Jun 18 02:02:18 2024","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.442,"15min":0.45000000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.55800000000000005,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.374,"5min":0.437,"15min":0.45000000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.51500000000000001,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.32100000000000001}]},{"osd":4,"last update":"Tue Jun 18 02:01:40 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.58299999999999996,"15min":0.59299999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.89700000000000002,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.61699999999999999,"15min":0.625},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.73299999999999998,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.50800000000000001}]},{"osd":5,"last update":"Tue Jun 18 02:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58199999999999996,"15min":0.57999999999999996},"min":{"1min":0.436,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.82099999999999995,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60199999999999998,"15min":0.59999999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.48299999999999998}]},{"osd":6,"last update":"Tue Jun 18 02:01:26 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.48999999999999999}]},{"osd":7,"last update":"Tue Jun 18 02:01:51 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.57799999999999996}]}]},{"osd":2,"up_from":18,"seq":77309411371,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":6216,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93738936,"statfs":{"total":95995035648,"available":95988670464,"internally_reserved":0,"allocated":589824,"data_stored":240660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jun 18 02:01:54 2024","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.38900000000000001,"15min":0.39400000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.41099999999999998,"15min":0.41199999999999998},"min":{"1min":0.253,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.70999999999999996}]},{"osd":1,"last update":"Tue Jun 18 02:01:54 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.27800000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.42099999999999999,"15min":0.41899999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.67900000000000005}]},{"osd":3,"last update":"Tue Jun 18 02:01:17 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.45600000000000002,"15min":0.45400000000000001},"min":{"1min":0.32100000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.47399999999999998,"15min":0.47599999999999998},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.69499999999999995}]},{"osd":4,"last update":"Tue Jun 18 02:01:46 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.57699999999999996,"15min":0.56799999999999995},"min":{"1min":0.434,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.59299999999999997,"15min":0.58599999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.82799999999999996}]},{"osd":5,"last update":"Tue Jun 18 02:02:03 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63300000000000001,"15min":0.63200000000000001},"min":{"1min":0.53600000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.79000000000000004,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.61899999999999999,"15min":0.61599999999999999},"min":{"1min":0.46400000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.748,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.748}]},{"osd":6,"last update":"Tue Jun 18 02:01:28 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.80300000000000005}]},{"osd":7,"last update":"Tue Jun 18 02:01:54 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.78800000000000003}]}]},{"osd":3,"up_from":26,"seq":111669149735,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5704,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":5120,"kb_avail":93739448,"statfs":{"total":95995035648,"available":95989194752,"internally_reserved":0,"allocated":589824,"data_stored":240660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5242880},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jun 18 02:02:18 2024","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.377,"15min":0.36599999999999999},"min":{"1min":0.27200000000000002,"5min":0.222,"15min":0.222},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.41399999999999998,"15min":0.41599999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.68999999999999995,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.45400000000000001}]},{"osd":1,"last update":"Tue Jun 18 02:02:18 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.439,"15min":0.441},"min":{"1min":0.30099999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.66100000000000003,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.42399999999999999,"15min":0.42199999999999999},"min":{"1min":0.27400000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.63500000000000001,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.434}]},{"osd":2,"last update":"Tue Jun 18 02:02:18 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.46700000000000003,"15min":0.46100000000000002},"min":{"1min":0.34200000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.68400000000000005,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.437,"15min":0.439},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.67100000000000004,"5min":0.752,"15min":0.752},"last":0.48599999999999999}]},{"osd":4,"last update":"Tue Jun 18 02:01:38 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.59199999999999997,"15min":0.58399999999999996},"min":{"1min":0.44500000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.59799999999999998,"15min":0.59099999999999997},"min":{"1min":0.45000000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.53200000000000003}]},{"osd":5,"last update":"Tue Jun 18 02:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.58299999999999996,"15min":0.57599999999999996},"min":{"1min":0.42999999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.63800000000000001,"15min":0.64000000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.92300000000000004,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.51200000000000001}]},{"osd":6,"last update":"Tue Jun 18 02:01:26 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.505}]},{"osd":7,"last update":"Tue Jun 18 02:01:52 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.57599999999999996}]}]},{"osd":4,"up_from":31,"seq":133143986210,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5768,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":5184,"kb_avail":93739384,"statfs":{"total":95995035648,"available":95989129216,"internally_reserved":0,"allocated":589824,"data_stored":240660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5308416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jun 18 02:01:38 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.41399999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.69399999999999995,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.53800000000000003,"15min":0.53300000000000003},"min":{"1min":0.34300000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.74399999999999999,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.66500000000000004}]},{"osd":1,"last update":"Tue Jun 18 02:01:38 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.53100000000000003,"15min":0.52500000000000002},"min":{"1min":0.434,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.69699999999999995,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.52200000000000002,"15min":0.51600000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.72799999999999998,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.57799999999999996}]},{"osd":2,"last update":"Tue Jun 18 02:01:38 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.55400000000000005,"15min":0.54600000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.77500000000000002,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.52300000000000002,"15min":0.51600000000000001},"min":{"1min":0.41499999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.74199999999999999,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.56799999999999995}]},{"osd":3,"last update":"Tue Jun 18 02:01:38 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.53800000000000003,"15min":0.53100000000000003},"min":{"1min":0.39500000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81000000000000005,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55000000000000004,"15min":0.54800000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.71099999999999997,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.61799999999999999}]},{"osd":5,"last update":"Tue Jun 18 02:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.39800000000000002,"15min":0.38600000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.40400000000000003,"15min":0.39200000000000002},"min":{"1min":0.30299999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.42299999999999999}]},{"osd":6,"last update":"Tue Jun 18 02:01:26 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.495}]},{"osd":7,"last update":"Tue Jun 18 02:01:51 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.438}]}]},{"osd":5,"up_from":39,"seq":167503724573,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5632,"kb_used_data":568,"kb_used_omap":0,"kb_used_meta":5056,"kb_avail":93739520,"statfs":{"total":95995035648,"available":95989268480,"internally_reserved":0,"allocated":581632,"data_stored":240072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5177344},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jun 18 02:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.57599999999999996,"15min":0.58199999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.79800000000000004,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.38400000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.79200000000000004,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.42199999999999999}]},{"osd":1,"last update":"Tue Jun 18 02:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.55800000000000005,"15min":0.56000000000000005},"min":{"1min":0.41899999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.433},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.58699999999999997,"15min":0.59899999999999998},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.76200000000000001,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.46800000000000003}]},{"osd":2,"last update":"Tue Jun 18 02:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56499999999999995,"15min":0.56799999999999995},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.57699999999999996,"15min":0.58499999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.76700000000000002,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.45900000000000002}]},{"osd":3,"last update":"Tue Jun 18 02:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55500000000000005,"15min":0.55700000000000005},"min":{"1min":0.41599999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.58399999999999996,"15min":0.58799999999999997},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.47599999999999998}]},{"osd":4,"last update":"Tue Jun 18 02:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.55500000000000005,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.31},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.42599999999999999,"15min":0.42699999999999999},"min":{"1min":0.30399999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.56499999999999995,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.33700000000000002}]},{"osd":6,"last update":"Tue Jun 18 02:01:26 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.32500000000000001}]},{"osd":7,"last update":"Tue Jun 18 02:01:52 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.34899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-18T02:02:24.496 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph pg dump --format=json 2024-06-18T02:02:24.503 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:24 smithi130 ceph-mon[26123]: pgmap v40: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:24.503 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:24 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:24.503 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:24 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:24.503 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:24 smithi130 ceph-mon[26123]: from='client.14598 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-18T02:02:24.735 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/mon.a/config 2024-06-18T02:02:25.128 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:24 smithi130 systemd[1]: Starting Ceph grafana.a for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:02:25.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:25 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:25.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:25 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:25.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:25.457 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 podman[44475]: 2024-06-18 02:02:25.164207189 +0000 UTC m=+0.108008239 container create b39a3781d434ca132a78e13692408fa56c2196f07cb4005bbb14901d022b7929 (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a, vcs-type=git, description=Ceph Grafana Container, io.openshift.tags=base rhel8, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., summary=Grafana Container configured for Ceph mgr/dashboard integration, io.k8s.display-name=Red Hat Universal Base Image 8, name=ubi8, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, release=236.1648460182, version=8.5, build-date=2022-03-28T10:36:18.413762, architecture=x86_64, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.openshift.expose-services=, distribution-scope=public, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, maintainer=Paul Cuzner , com.redhat.component=ubi8-container, vendor=Red Hat, Inc., io.buildah.version=1.24.2) 2024-06-18T02:02:25.457 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 podman[44475]: 2024-06-18 02:02:25.073080146 +0000 UTC m=+0.016881206 image pull dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01 quay.io/ceph/ceph-grafana:8.3.5 2024-06-18T02:02:25.708 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 podman[44475]: 2024-06-18 02:02:25.458137299 +0000 UTC m=+0.401938362 container init b39a3781d434ca132a78e13692408fa56c2196f07cb4005bbb14901d022b7929 (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a, maintainer=Paul Cuzner , version=8.5, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.component=ubi8-container, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, summary=Grafana Container configured for Ceph mgr/dashboard integration, name=ubi8, io.openshift.tags=base rhel8, vcs-type=git, build-date=2022-03-28T10:36:18.413762, architecture=x86_64, release=236.1648460182, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, io.openshift.expose-services=, distribution-scope=public, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.k8s.display-name=Red Hat Universal Base Image 8, vendor=Red Hat, Inc., description=Ceph Grafana Container, io.buildah.version=1.24.2) 2024-06-18T02:02:25.708 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 podman[44475]: 2024-06-18 02:02:25.461366237 +0000 UTC m=+0.405167295 container start b39a3781d434ca132a78e13692408fa56c2196f07cb4005bbb14901d022b7929 (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a, io.openshift.expose-services=, distribution-scope=public, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, vendor=Red Hat, Inc., com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, version=8.5, summary=Grafana Container configured for Ceph mgr/dashboard integration, com.redhat.component=ubi8-container, vcs-type=git, io.openshift.tags=base rhel8, maintainer=Paul Cuzner , build-date=2022-03-28T10:36:18.413762, architecture=x86_64, io.k8s.display-name=Red Hat Universal Base Image 8, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, description=Ceph Grafana Container, io.buildah.version=1.24.2, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., name=ubi8, release=236.1648460182) 2024-06-18T02:02:25.708 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="The state of unified alerting is still not defined. The decision will be made during as we run the database migrations" logger=settings 2024-06-18T02:02:25.708 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=warn msg="falling back to legacy setting of 'min_interval_seconds'; please use the configuration option in the `unified_alerting` section if Grafana 8 alerts are enabled." logger=settings 2024-06-18T02:02:25.708 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Config loaded from" logger=settings file=/usr/share/grafana/conf/defaults.ini 2024-06-18T02:02:25.708 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Config loaded from" logger=settings file=/etc/grafana/grafana.ini 2024-06-18T02:02:25.708 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_DATA=/var/lib/grafana" 2024-06-18T02:02:25.709 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_LOGS=/var/log/grafana" 2024-06-18T02:02:25.709 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2024-06-18T02:02:25.709 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2024-06-18T02:02:25.709 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Path Home" logger=settings path=/usr/share/grafana 2024-06-18T02:02:25.709 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Path Data" logger=settings path=/var/lib/grafana 2024-06-18T02:02:25.709 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Path Logs" logger=settings path=/var/log/grafana 2024-06-18T02:02:25.710 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Path Plugins" logger=settings path=/var/lib/grafana/plugins 2024-06-18T02:02:25.710 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Path Provisioning" logger=settings path=/etc/grafana/provisioning 2024-06-18T02:02:25.710 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="App mode production" logger=settings 2024-06-18T02:02:25.710 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Connecting to DB" logger=sqlstore dbtype=sqlite3 2024-06-18T02:02:25.710 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=warn msg="SQLite database file has broader permissions than it should" logger=sqlstore path=/var/lib/grafana/grafana.db mode=-rw-r--r-- expected=-rw-r----- 2024-06-18T02:02:25.710 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Starting DB migrations" logger=migrator 2024-06-18T02:02:25.710 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create migration_log table" 2024-06-18T02:02:25.710 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create user table" 2024-06-18T02:02:25.710 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.login" 2024-06-18T02:02:25.710 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.email" 2024-06-18T02:02:25.710 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_login - v1" 2024-06-18T02:02:25.711 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_email - v1" 2024-06-18T02:02:25.711 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table user to user_v1 - v1" 2024-06-18T02:02:25.711 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create user table v2" 2024-06-18T02:02:25.711 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_login - v2" 2024-06-18T02:02:25.711 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_email - v2" 2024-06-18T02:02:25.711 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2024-06-18T02:02:25.711 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table user_v1" 2024-06-18T02:02:25.711 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add column help_flags1 to user table" 2024-06-18T02:02:25.711 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Update user table charset" 2024-06-18T02:02:25.711 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add last_seen_at column to user" 2024-06-18T02:02:25.711 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add missing user data" 2024-06-18T02:02:25.711 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add is_disabled column to user" 2024-06-18T02:02:25.711 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add index user.login/user.email" 2024-06-18T02:02:25.711 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add is_service_account column to user" 2024-06-18T02:02:25.712 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create temp user table v1-7" 2024-06-18T02:02:25.712 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_email - v1-7" 2024-06-18T02:02:25.712 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_org_id - v1-7" 2024-06-18T02:02:25.712 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_code - v1-7" 2024-06-18T02:02:25.712 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_status - v1-7" 2024-06-18T02:02:25.712 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Update temp_user table charset" 2024-06-18T02:02:25.712 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_temp_user_email - v1" 2024-06-18T02:02:25.712 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_temp_user_org_id - v1" 2024-06-18T02:02:25.712 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_temp_user_code - v1" 2024-06-18T02:02:25.712 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_temp_user_status - v1" 2024-06-18T02:02:25.712 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table temp_user to temp_user_tmp_qwerty - v1" 2024-06-18T02:02:25.712 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create temp_user v2" 2024-06-18T02:02:25.712 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_email - v2" 2024-06-18T02:02:25.712 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_org_id - v2" 2024-06-18T02:02:25.713 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_code - v2" 2024-06-18T02:02:25.713 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_status - v2" 2024-06-18T02:02:25.713 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="copy temp_user v1 to v2" 2024-06-18T02:02:25.713 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="drop temp_user_tmp_qwerty" 2024-06-18T02:02:25.713 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Set created for temp users that will otherwise prematurely expire" 2024-06-18T02:02:25.713 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create star table" 2024-06-18T02:02:25.713 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index star.user_id_dashboard_id" 2024-06-18T02:02:25.713 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create org table v1" 2024-06-18T02:02:25.713 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_name - v1" 2024-06-18T02:02:25.713 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create org_user table v1" 2024-06-18T02:02:25.713 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_org_user_org_id - v1" 2024-06-18T02:02:25.713 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_user_org_id_user_id - v1" 2024-06-18T02:02:25.713 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_org_user_user_id - v1" 2024-06-18T02:02:25.713 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Update org table charset" 2024-06-18T02:02:25.713 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Update org_user table charset" 2024-06-18T02:02:25.713 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate all Read Only Viewers to Viewers" 2024-06-18T02:02:25.714 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard table" 2024-06-18T02:02:25.714 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 bash[44475]: b39a3781d434ca132a78e13692408fa56c2196f07cb4005bbb14901d022b7929 2024-06-18T02:02:25.715 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard.account_id" 2024-06-18T02:02:25.715 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 systemd[1]: Started Ceph grafana.a for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:02:25.715 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_account_id_slug" 2024-06-18T02:02:25.715 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_tag table" 2024-06-18T02:02:25.715 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_tag.dasboard_id_term" 2024-06-18T02:02:25.715 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_dashboard_tag_dashboard_id_term - v1" 2024-06-18T02:02:25.715 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard to dashboard_v1 - v1" 2024-06-18T02:02:25.715 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard v2" 2024-06-18T02:02:25.715 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_org_id - v2" 2024-06-18T02:02:25.715 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_org_id_slug - v2" 2024-06-18T02:02:25.715 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard v1 to v2" 2024-06-18T02:02:25.715 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_v1" 2024-06-18T02:02:25.715 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard.data to mediumtext v1" 2024-06-18T02:02:25.716 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add column updated_by in dashboard - v2" 2024-06-18T02:02:25.716 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add column created_by in dashboard - v2" 2024-06-18T02:02:25.716 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add column gnetId in dashboard" 2024-06-18T02:02:25.716 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for gnetId in dashboard" 2024-06-18T02:02:25.716 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_id in dashboard" 2024-06-18T02:02:25.716 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for plugin_id in dashboard" 2024-06-18T02:02:25.716 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for dashboard_id in dashboard_tag" 2024-06-18T02:02:25.716 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard table charset" 2024-06-18T02:02:25.716 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_tag table charset" 2024-06-18T02:02:25.716 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add column folder_id in dashboard" 2024-06-18T02:02:25.716 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add column isFolder in dashboard" 2024-06-18T02:02:25.717 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add column has_acl in dashboard" 2024-06-18T02:02:25.717 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in dashboard" 2024-06-18T02:02:25.717 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in dashboard" 2024-06-18T02:02:25.717 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index dashboard_org_id_uid" 2024-06-18T02:02:25.717 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_slug" 2024-06-18T02:02:25.717 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard title length" 2024-06-18T02:02:25.717 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index for dashboard_org_id_title_folder_id" 2024-06-18T02:02:25.717 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning" 2024-06-18T02:02:25.717 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" 2024-06-18T02:02:25.717 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning v2" 2024-06-18T02:02:25.717 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id - v2" 2024-06-18T02:02:25.717 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" 2024-06-18T02:02:25.717 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard_provisioning v1 to v2" 2024-06-18T02:02:25.717 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="drop dashboard_provisioning_tmp_qwerty" 2024-06-18T02:02:25.717 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add check_sum column" 2024-06-18T02:02:25.718 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for dashboard_title" 2024-06-18T02:02:25.718 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="delete tags for deleted dashboards" 2024-06-18T02:02:25.718 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="delete stars for deleted dashboards" 2024-06-18T02:02:25.718 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for dashboard_is_folder" 2024-06-18T02:02:25.718 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table" 2024-06-18T02:02:25.718 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index data_source.account_id" 2024-06-18T02:02:25.718 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index data_source.account_id_name" 2024-06-18T02:02:25.718 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_data_source_account_id - v1" 2024-06-18T02:02:25.718 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_data_source_account_id_name - v1" 2024-06-18T02:02:25.718 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table data_source to data_source_v1 - v1" 2024-06-18T02:02:25.718 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table v2" 2024-06-18T02:02:25.718 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_data_source_org_id - v2" 2024-06-18T02:02:25.719 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_data_source_org_id_name - v2" 2024-06-18T02:02:25.719 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2024-06-18T02:02:25.719 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table data_source_v1 #2" 2024-06-18T02:02:25.719 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add column with_credentials" 2024-06-18T02:02:25.719 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add secure json data column" 2024-06-18T02:02:25.719 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Update data_source table charset" 2024-06-18T02:02:25.719 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Update initial version to 1" 2024-06-18T02:02:25.719 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add read_only data column" 2024-06-18T02:02:25.719 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate logging ds to loki ds" 2024-06-18T02:02:25.719 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Update json_data with nulls" 2024-06-18T02:02:25.719 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add uid column" 2024-06-18T02:02:25.719 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid value" 2024-06-18T02:02:25.719 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index datasource_org_id_uid" 2024-06-18T02:02:25.719 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index datasource_org_id_is_default" 2024-06-18T02:02:25.719 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table" 2024-06-18T02:02:25.719 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id" 2024-06-18T02:02:25.720 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.key" 2024-06-18T02:02:25.720 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id_name" 2024-06-18T02:02:25.720 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_api_key_account_id - v1" 2024-06-18T02:02:25.720 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_key - v1" 2024-06-18T02:02:25.720 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_account_id_name - v1" 2024-06-18T02:02:25.720 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table api_key to api_key_v1 - v1" 2024-06-18T02:02:25.720 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table v2" 2024-06-18T02:02:25.720 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_api_key_org_id - v2" 2024-06-18T02:02:25.720 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_key - v2" 2024-06-18T02:02:25.720 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_org_id_name - v2" 2024-06-18T02:02:25.720 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="copy api_key v1 to v2" 2024-06-18T02:02:25.720 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table api_key_v1" 2024-06-18T02:02:25.720 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Update api_key table charset" 2024-06-18T02:02:25.720 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add expires to api_key table" 2024-06-18T02:02:25.721 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add service account foreign key" 2024-06-18T02:02:25.721 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v4" 2024-06-18T02:02:25.721 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_snapshot_v4 #1" 2024-06-18T02:02:25.721 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v5 #2" 2024-06-18T02:02:25.721 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_key - v5" 2024-06-18T02:02:25.721 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_delete_key - v5" 2024-06-18T02:02:25.721 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_snapshot_user_id - v5" 2024-06-18T02:02:25.721 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_snapshot to mediumtext v2" 2024-06-18T02:02:25.721 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_snapshot table charset" 2024-06-18T02:02:25.721 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external_delete_url to dashboard_snapshots table" 2024-06-18T02:02:25.721 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add encrypted dashboard json column" 2024-06-18T02:02:25.721 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Change dashboard_encrypted column to MEDIUMBLOB" 2024-06-18T02:02:25.721 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create quota table v1" 2024-06-18T02:02:25.721 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_quota_org_id_user_id_target - v1" 2024-06-18T02:02:25.721 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Update quota table charset" 2024-06-18T02:02:25.959 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create plugin_setting table" 2024-06-18T02:02:25.959 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_plugin_setting_org_id_plugin_id - v1" 2024-06-18T02:02:25.959 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_version to plugin_settings" 2024-06-18T02:02:25.959 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Update plugin_setting table charset" 2024-06-18T02:02:25.959 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create session table" 2024-06-18T02:02:25.959 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist table" 2024-06-18T02:02:25.959 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist_item table" 2024-06-18T02:02:25.959 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist table v2" 2024-06-18T02:02:25.959 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist item table v2" 2024-06-18T02:02:25.960 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist table charset" 2024-06-18T02:02:25.960 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist_item table charset" 2024-06-18T02:02:25.960 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v2" 2024-06-18T02:02:25.960 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v3" 2024-06-18T02:02:25.960 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create preferences table v3" 2024-06-18T02:02:25.960 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Update preferences table charset" 2024-06-18T02:02:25.960 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add column team_id in preferences" 2024-06-18T02:02:25.960 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Update team_id column values in preferences" 2024-06-18T02:02:25.960 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add column week_start in preferences" 2024-06-18T02:02:25.960 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create alert table v1" 2024-06-18T02:02:25.960 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert org_id & id " 2024-06-18T02:02:25.961 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert state" 2024-06-18T02:02:25.961 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert dashboard_id" 2024-06-18T02:02:25.962 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Create alert_rule_tag table v1" 2024-06-18T02:02:25.962 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_rule_tag.alert_id_tag_id" 2024-06-18T02:02:25.962 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_alert_rule_tag_alert_id_tag_id - v1" 2024-06-18T02:02:25.962 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table alert_rule_tag to alert_rule_tag_v1 - v1" 2024-06-18T02:02:25.962 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Create alert_rule_tag table v2" 2024-06-18T02:02:25.962 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_alert_rule_tag_alert_id_tag_id - Add unique index alert_rule_tag.alert_id_tag_id V2" 2024-06-18T02:02:25.962 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="copy alert_rule_tag v1 to v2" 2024-06-18T02:02:25.962 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="drop table alert_rule_tag_v1" 2024-06-18T02:02:25.963 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification table v1" 2024-06-18T02:02:25.963 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add column is_default" 2024-06-18T02:02:25.963 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add column frequency" 2024-06-18T02:02:25.963 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add column send_reminder" 2024-06-18T02:02:25.963 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add column disable_resolve_message" 2024-06-18T02:02:25.963 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification org_id & name" 2024-06-18T02:02:25.963 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert table charset" 2024-06-18T02:02:25.963 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert_notification table charset" 2024-06-18T02:02:25.963 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create notification_journal table v1" 2024-06-18T02:02:25.963 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index notification_journal org_id & alert_id & notifier_id" 2024-06-18T02:02:25.963 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="drop alert_notification_journal" 2024-06-18T02:02:25.963 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification_state table v1" 2024-06-18T02:02:25.963 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification_state org_id & alert_id & notifier_id" 2024-06-18T02:02:25.964 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add for to alert table" 2024-06-18T02:02:25.964 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in alert_notification" 2024-06-18T02:02:25.964 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in alert_notification" 2024-06-18T02:02:25.964 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_notification_org_id_uid" 2024-06-18T02:02:25.964 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_name" 2024-06-18T02:02:25.964 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add column secure_settings in alert_notification" 2024-06-18T02:02:25.964 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="alter alert.settings to mediumtext" 2024-06-18T02:02:25.964 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add non-unique index alert_notification_state_alert_id" 2024-06-18T02:02:25.964 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add non-unique index alert_rule_tag_alert_id" 2024-06-18T02:02:25.964 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old annotation table v4" 2024-06-18T02:02:25.966 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create annotation table v5" 2024-06-18T02:02:25.966 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 0 v3" 2024-06-18T02:02:25.966 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 1 v3" 2024-06-18T02:02:25.966 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 2 v3" 2024-06-18T02:02:25.966 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 3 v3" 2024-06-18T02:02:25.966 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 4 v3" 2024-06-18T02:02:25.966 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Update annotation table charset" 2024-06-18T02:02:25.966 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add column region_id to annotation table" 2024-06-18T02:02:25.966 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Drop category_id index" 2024-06-18T02:02:25.966 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add column tags to annotation table" 2024-06-18T02:02:25.966 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Create annotation_tag table v2" 2024-06-18T02:02:25.966 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index annotation_tag.annotation_id_tag_id" 2024-06-18T02:02:25.967 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_annotation_tag_annotation_id_tag_id - v2" 2024-06-18T02:02:25.967 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table annotation_tag to annotation_tag_v2 - v2" 2024-06-18T02:02:25.967 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Create annotation_tag table v3" 2024-06-18T02:02:25.967 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_annotation_tag_annotation_id_tag_id - Add unique index annotation_tag.annotation_id_tag_id V3" 2024-06-18T02:02:25.967 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="copy annotation_tag v2 to v3" 2024-06-18T02:02:25.967 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="drop table annotation_tag_v2" 2024-06-18T02:02:25.967 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert annotations and set TEXT to empty" 2024-06-18T02:02:25.967 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add created time to annotation table" 2024-06-18T02:02:25.967 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add updated time to annotation table" 2024-06-18T02:02:25.967 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for created in annotation table" 2024-06-18T02:02:25.967 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for updated in annotation table" 2024-06-18T02:02:25.967 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Convert existing annotations from seconds to milliseconds" 2024-06-18T02:02:25.968 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add epoch_end column" 2024-06-18T02:02:25.968 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for epoch_end" 2024-06-18T02:02:25.968 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Make epoch_end the same as epoch" 2024-06-18T02:02:25.968 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Move region to single row" 2024-06-18T02:02:25.968 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch from annotation table" 2024-06-18T02:02:25.968 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" 2024-06-18T02:02:25.968 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" 2024-06-18T02:02:25.968 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_epoch_end_epoch on annotation table" 2024-06-18T02:02:25.968 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch_epoch_end from annotation table" 2024-06-18T02:02:25.968 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for alert_id on annotation table" 2024-06-18T02:02:25.968 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create test_data table" 2024-06-18T02:02:25.968 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_version table v1" 2024-06-18T02:02:25.968 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_version.dashboard_id" 2024-06-18T02:02:25.969 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_version.dashboard_id and dashboard_version.version" 2024-06-18T02:02:25.969 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Set dashboard version to 1 where 0" 2024-06-18T02:02:25.969 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="save existing dashboard data in dashboard_version table v1" 2024-06-18T02:02:25.969 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_version.data to mediumtext v1" 2024-06-18T02:02:25.969 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create team table" 2024-06-18T02:02:25.969 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index team.org_id" 2024-06-18T02:02:25.969 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_org_id_name" 2024-06-18T02:02:25.969 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create team member table" 2024-06-18T02:02:25.969 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_member.org_id" 2024-06-18T02:02:25.970 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_member_org_id_team_id_user_id" 2024-06-18T02:02:25.970 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_member.team_id" 2024-06-18T02:02:25.970 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add column email to team table" 2024-06-18T02:02:25.970 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external to team_member table" 2024-06-18T02:02:25.970 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add column permission to team_member table" 2024-06-18T02:02:25.970 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard acl table" 2024-06-18T02:02:25.970 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_dashboard_id" 2024-06-18T02:02:25.970 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_user_id" 2024-06-18T02:02:25.970 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_team_id" 2024-06-18T02:02:25.970 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_user_id" 2024-06-18T02:02:25.970 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_team_id" 2024-06-18T02:02:25.970 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_org_id_role" 2024-06-18T02:02:25.970 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_permission" 2024-06-18T02:02:25.971 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="save default acl rules in dashboard_acl table" 2024-06-18T02:02:25.971 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="delete acl rules for deleted dashboards and folders" 2024-06-18T02:02:25.971 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create tag table" 2024-06-18T02:02:25.971 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index tag.key_value" 2024-06-18T02:02:25.971 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create login attempt table" 2024-06-18T02:02:25.971 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index login_attempt.username" 2024-06-18T02:02:25.971 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_login_attempt_username - v1" 2024-06-18T02:02:25.971 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" 2024-06-18T02:02:25.971 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create login_attempt v2" 2024-06-18T02:02:25.971 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_login_attempt_username - v2" 2024-06-18T02:02:25.971 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="copy login_attempt v1 to v2" 2024-06-18T02:02:25.971 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="drop login_attempt_tmp_qwerty" 2024-06-18T02:02:25.971 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth table" 2024-06-18T02:02:25.972 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_user_auth_auth_module_auth_id - v1" 2024-06-18T02:02:25.972 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="alter user_auth.auth_id to length 190" 2024-06-18T02:02:25.972 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth access token to user_auth" 2024-06-18T02:02:25.972 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth refresh token to user_auth" 2024-06-18T02:02:25.972 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth token type to user_auth" 2024-06-18T02:02:25.972 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth expiry to user_auth" 2024-06-18T02:02:25.972 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add index to user_id column in user_auth" 2024-06-18T02:02:25.972 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create server_lock table" 2024-06-18T02:02:25.972 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index server_lock.operation_uid" 2024-06-18T02:02:25.972 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth token table" 2024-06-18T02:02:25.972 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.auth_token" 2024-06-18T02:02:25.972 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.prev_auth_token" 2024-06-18T02:02:25.972 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index user_auth_token.user_id" 2024-06-18T02:02:25.973 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add revoked_at to the user auth token" 2024-06-18T02:02:25.973 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create cache_data table" 2024-06-18T02:02:25.973 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index cache_data.cache_key" 2024-06-18T02:02:25.974 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create short_url table v1" 2024-06-18T02:02:25.974 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index short_url.org_id-uid" 2024-06-18T02:02:25.974 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="delete alert_definition table" 2024-06-18T02:02:25.974 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="recreate alert_definition table" 2024-06-18T02:02:25.974 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_definition on org_id and title columns" 2024-06-18T02:02:25.974 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_definition on org_id and uid columns" 2024-06-18T02:02:25.974 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="alter alert_definition table data column to mediumtext in mysql" 2024-06-18T02:02:25.974 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="drop index in alert_definition on org_id and title columns" 2024-06-18T02:02:25.974 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="drop index in alert_definition on org_id and uid columns" 2024-06-18T02:02:25.974 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index in alert_definition on org_id and title columns" 2024-06-18T02:02:25.974 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index in alert_definition on org_id and uid columns" 2024-06-18T02:02:25.974 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add column paused in alert_definition" 2024-06-18T02:02:25.975 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="drop alert_definition table" 2024-06-18T02:02:25.975 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="delete alert_definition_version table" 2024-06-18T02:02:25.975 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="recreate alert_definition_version table" 2024-06-18T02:02:25.975 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_definition_version table on alert_definition_id and version columns" 2024-06-18T02:02:25.975 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_definition_version table on alert_definition_uid and version columns" 2024-06-18T02:02:25.975 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="alter alert_definition_version table data column to mediumtext in mysql" 2024-06-18T02:02:25.975 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="drop alert_definition_version table" 2024-06-18T02:02:25.975 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_instance table" 2024-06-18T02:02:25.976 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_instance table on def_org_id, def_uid and current_state columns" 2024-06-18T02:02:25.976 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_instance table on def_org_id, current_state columns" 2024-06-18T02:02:25.976 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add column current_state_end to alert_instance" 2024-06-18T02:02:25.976 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="remove index def_org_id, def_uid, current_state on alert_instance" 2024-06-18T02:02:25.976 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="remove index def_org_id, current_state on alert_instance" 2024-06-18T02:02:25.976 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="rename def_org_id to rule_org_id in alert_instance" 2024-06-18T02:02:25.976 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="rename def_uid to rule_uid in alert_instance" 2024-06-18T02:02:25.976 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index rule_org_id, rule_uid, current_state on alert_instance" 2024-06-18T02:02:25.976 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index rule_org_id, current_state on alert_instance" 2024-06-18T02:02:25.977 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_rule table" 2024-06-18T02:02:25.977 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule on org_id and title columns" 2024-06-18T02:02:25.977 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule on org_id and uid columns" 2024-06-18T02:02:25.977 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule on org_id, namespace_uid, group_uid columns" 2024-06-18T02:02:25.977 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="alter alert_rule table data column to mediumtext in mysql" 2024-06-18T02:02:25.977 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add column for to alert_rule" 2024-06-18T02:02:25.977 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add column annotations to alert_rule" 2024-06-18T02:02:25.977 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add column labels to alert_rule" 2024-06-18T02:02:25.977 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="remove unique index from alert_rule on org_id, title columns" 2024-06-18T02:02:25.977 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule on org_id, namespase_uid and title columns" 2024-06-18T02:02:25.977 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add dashboard_uid column to alert_rule" 2024-06-18T02:02:25.977 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add panel_id column to alert_rule" 2024-06-18T02:02:25.977 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule on org_id, dashboard_uid and panel_id columns" 2024-06-18T02:02:25.978 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_rule_version table" 2024-06-18T02:02:25.978 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule_version table on rule_org_id, rule_uid and version columns" 2024-06-18T02:02:25.978 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule_version table on rule_org_id, rule_namespace_uid and rule_group columns" 2024-06-18T02:02:25.978 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="alter alert_rule_version table data column to mediumtext in mysql" 2024-06-18T02:02:25.978 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add column for to alert_rule_version" 2024-06-18T02:02:25.978 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add column annotations to alert_rule_version" 2024-06-18T02:02:25.978 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add column labels to alert_rule_version" 2024-06-18T02:02:25.978 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id=create_alert_configuration_table 2024-06-18T02:02:25.978 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add column default in alert_configuration" 2024-06-18T02:02:25.978 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="alert alert_configuration alertmanager_configuration column from TEXT to MEDIUMTEXT if mysql" 2024-06-18T02:02:25.978 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add column org_id in alert_configuration" 2024-06-18T02:02:25.978 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_configuration table on org_id column" 2024-06-18T02:02:25.979 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id=create_ngalert_configuration_table 2024-06-18T02:02:25.979 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index in ngalert_configuration on org_id column" 2024-06-18T02:02:25.979 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="clear migration entry \"remove unified alerting data\"" 2024-06-18T02:02:25.979 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="move dashboard alerts to unified alerting" 2024-06-18T02:02:25.979 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create library_element table v1" 2024-06-18T02:02:25.979 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index library_element org_id-folder_id-name-kind" 2024-06-18T02:02:25.979 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create library_element_connection table v1" 2024-06-18T02:02:25.979 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index library_element_connection element_id-kind-connection_id" 2024-06-18T02:02:25.979 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index library_element org_id_uid" 2024-06-18T02:02:25.980 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="clone move dashboard alerts to unified alerting" 2024-06-18T02:02:25.980 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create data_keys table" 2024-06-18T02:02:25.980 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create kv_store table v1" 2024-06-18T02:02:25.980 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index kv_store.org_id-namespace-key" 2024-06-18T02:02:25.980 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="update dashboard_uid and panel_id from existing annotations" 2024-06-18T02:02:25.980 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create permission table" 2024-06-18T02:02:25.980 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index permission.role_id" 2024-06-18T02:02:25.980 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index role_id_action_scope" 2024-06-18T02:02:25.980 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create role table" 2024-06-18T02:02:25.980 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add column display_name" 2024-06-18T02:02:25.980 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add column group_name" 2024-06-18T02:02:25.980 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index role.org_id" 2024-06-18T02:02:25.981 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index role_org_id_name" 2024-06-18T02:02:25.981 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index role_org_id_uid" 2024-06-18T02:02:25.981 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create team role table" 2024-06-18T02:02:25.981 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_role.org_id" 2024-06-18T02:02:25.981 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_role_org_id_team_id_role_id" 2024-06-18T02:02:25.981 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_role.team_id" 2024-06-18T02:02:25.981 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create user role table" 2024-06-18T02:02:25.981 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index user_role.org_id" 2024-06-18T02:02:25.981 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_role_org_id_user_id_role_id" 2024-06-18T02:02:25.981 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index user_role.user_id" 2024-06-18T02:02:25.981 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create builtin role table" 2024-06-18T02:02:25.981 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index builtin_role.role_id" 2024-06-18T02:02:25.981 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index builtin_role.name" 2024-06-18T02:02:25.981 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add column org_id to builtin_role table" 2024-06-18T02:02:25.982 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index builtin_role.org_id" 2024-06-18T02:02:25.982 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index builtin_role_org_id_role_id_role" 2024-06-18T02:02:26.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:26 smithi130 ceph-mon[26123]: pgmap v41: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:26.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:26 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:26.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:26 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:02:26.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:26 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:02:26.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:26 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:02:26.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:26 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:26.294 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index role_org_id_uid" 2024-06-18T02:02:26.294 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index role.uid" 2024-06-18T02:02:26.294 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="create seed assignment table" 2024-06-18T02:02:26.294 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index builtin_role_role_name" 2024-06-18T02:02:26.294 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="migrations completed" logger=migrator performed=381 skipped=0 duration=479.487041ms 2024-06-18T02:02:26.294 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Created default organization" logger=sqlstore 2024-06-18T02:02:26.295 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Initialising plugins" logger=plugin.manager 2024-06-18T02:02:26.295 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:25+0000 lvl=info msg="Plugin registered" logger=plugin.manager pluginId=input 2024-06-18T02:02:26.295 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:26 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:26+0000 lvl=info msg="Plugin registered" logger=plugin.manager pluginId=vonage-status-panel 2024-06-18T02:02:26.295 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:26 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:26+0000 lvl=info msg="Plugin registered" logger=plugin.manager pluginId=grafana-piechart-panel 2024-06-18T02:02:26.295 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:26 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:26+0000 lvl=info msg="Live Push Gateway initialization" logger=live.push_http 2024-06-18T02:02:26.295 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:26 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:26+0000 lvl=warn msg="[Deprecated] the datasource provisioning config is outdated. please upgrade" logger=provisioning.datasources filename=/etc/grafana/provisioning/datasources/ceph-dashboard.yml 2024-06-18T02:02:26.295 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:26 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:26+0000 lvl=info msg="inserting datasource from configuration " logger=provisioning.datasources name=Dashboard1 uid=P43CA22E17D0F9596 2024-06-18T02:02:26.295 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:26 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:26+0000 lvl=info msg="warming cache for startup" logger=ngalert 2024-06-18T02:02:26.295 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:26 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:26+0000 lvl=info msg="HTTP Server Listen" logger=http.server address=[::]:3000 protocol=https subUrl= socket= 2024-06-18T02:02:26.295 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:02:26 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:02:26+0000 lvl=info msg="starting MultiOrg Alertmanager" logger=ngalert.multiorg.alertmanager 2024-06-18T02:02:26.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:26 smithi007 ceph-mon[25091]: pgmap v41: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:26.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:26 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:26.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:26 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:02:26.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:26 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:02:26.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:26 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:02:26.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:26 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:26.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:26 smithi007 ceph-mon[29879]: pgmap v41: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:26.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:26 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:26.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:26 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:02:26.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:26 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:02:26.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:26 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:02:26.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:26 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:27.360 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:27 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:02:27.360 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:27 smithi130 ceph-mon[26123]: Reconfiguring alertmanager.a (dependencies changed)... 2024-06-18T02:02:27.360 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:27 smithi130 ceph-mon[26123]: Reconfiguring daemon alertmanager.a on smithi007 2024-06-18T02:02:27.409 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:27 smithi007 ceph-mon[25091]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:02:27.409 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:27 smithi007 ceph-mon[25091]: Reconfiguring alertmanager.a (dependencies changed)... 2024-06-18T02:02:27.409 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:27 smithi007 ceph-mon[25091]: Reconfiguring daemon alertmanager.a on smithi007 2024-06-18T02:02:27.409 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:27 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:02:27.409 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:27 smithi007 ceph-mon[29879]: Reconfiguring alertmanager.a (dependencies changed)... 2024-06-18T02:02:27.409 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:27 smithi007 ceph-mon[29879]: Reconfiguring daemon alertmanager.a on smithi007 2024-06-18T02:02:28.398 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:28 smithi130 ceph-mon[26123]: pgmap v42: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:28.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:28 smithi007 ceph-mon[25091]: pgmap v42: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:28.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:28 smithi007 ceph-mon[29879]: pgmap v42: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:28.850 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-06-18T02:02:28.852 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-06-18T02:02:29.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:29 smithi007 ceph-mon[25091]: pgmap v43: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:29.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:29 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:29.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:29 smithi007 ceph-mon[25091]: from='client.24508 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-18T02:02:29.903 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:29 smithi007 ceph-mon[29879]: pgmap v43: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:29.903 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:29 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:29.904 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:29 smithi007 ceph-mon[29879]: from='client.24508 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-18T02:02:30.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:29 smithi130 ceph-mon[26123]: pgmap v43: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:30.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:29 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:30.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:29 smithi130 ceph-mon[26123]: from='client.24508 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-18T02:02:30.599 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:02:30 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.130 - - [18/Jun/2024:02:02:30] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:02:30.630 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":43,"stamp":"2024-06-18T02:02:28.635561+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1586784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":749961216,"kb_used":48848,"kb_used_data":6160,"kb_used_omap":0,"kb_used_meta":42624,"kb_avail":749912368,"statfs":{"total":767960285184,"available":767910264832,"internally_reserved":0,"allocated":6307840,"data_stored":3511476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":43646976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002090"},"pg_stats":[{"pgid":"1.0","version":"60'128","reported_seq":267,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-06-18T02:01:08.716465+0000","last_change":"2024-06-18T02:00:55.428571+0000","last_active":"2024-06-18T02:01:08.716465+0000","last_peered":"2024-06-18T02:01:08.716465+0000","last_clean":"2024-06-18T02:01:08.716465+0000","last_became_active":"2024-06-18T02:00:55.428139+0000","last_became_peered":"2024-06-18T02:00:55.428139+0000","last_unstale":"2024-06-18T02:01:08.716465+0000","last_undegraded":"2024-06-18T02:01:08.716465+0000","last_fullsized":"2024-06-18T02:01:08.716465+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-18T01:58:50.912270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-18T01:58:50.912270+0000","last_clean_scrub_stamp":"2024-06-18T01:58:50.912270+0000","objects_scrubbed":0,"log_size":128,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-19T10:51:57.975538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1586784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1586784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1597440,"data_stored":1586784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201300,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6096,"kb_used_data":1096,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":93739056,"statfs":{"total":95995035648,"available":95988793344,"internally_reserved":0,"allocated":1122304,"data_stored":769588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jun 18 02:01:53 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.53700000000000003}]},{"osd":1,"last update":"Tue Jun 18 02:01:53 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.42999999999999999}]},{"osd":2,"last update":"Tue Jun 18 02:01:53 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.51300000000000001}]},{"osd":3,"last update":"Tue Jun 18 02:01:53 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.47099999999999997}]},{"osd":4,"last update":"Tue Jun 18 02:01:53 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.38700000000000001}]},{"osd":5,"last update":"Tue Jun 18 02:01:53 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.48999999999999999}]},{"osd":6,"last update":"Tue Jun 18 02:01:53 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.502}]}]},{"osd":6,"up_from":47,"seq":201863462937,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6160,"kb_used_data":1096,"kb_used_omap":0,"kb_used_meta":5056,"kb_avail":93738992,"statfs":{"total":95995035648,"available":95988727808,"internally_reserved":0,"allocated":1122304,"data_stored":769588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5177344},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jun 18 02:01:26 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":2.9889999999999999,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.45300000000000001}]},{"osd":1,"last update":"Tue Jun 18 02:01:26 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":3.0110000000000001,"5min":3.0110000000000001,"15min":3.0110000000000001},"last":0.42299999999999999}]},{"osd":2,"last update":"Tue Jun 18 02:01:26 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":3.0369999999999999,"5min":3.0369999999999999,"15min":3.0369999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.50800000000000001}]},{"osd":3,"last update":"Tue Jun 18 02:01:26 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.373},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":3.0249999999999999,"5min":3.0249999999999999,"15min":3.0249999999999999},"last":0.44400000000000001}]},{"osd":4,"last update":"Tue Jun 18 02:01:26 2024","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"last":0.34000000000000002}]},{"osd":5,"last update":"Tue Jun 18 02:01:26 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.38900000000000001}]},{"osd":7,"last update":"Tue Jun 18 02:01:51 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.48199999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574897,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":6344,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":5760,"kb_avail":93738808,"statfs":{"total":95995035648,"available":95988539392,"internally_reserved":0,"allocated":589824,"data_stored":240660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5898240},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jun 18 02:01:28 2024","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.36699999999999999,"15min":0.34899999999999998},"min":{"1min":0.254,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.376,"15min":0.36099999999999999},"min":{"1min":0.23699999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.318}]},{"osd":2,"last update":"Tue Jun 18 02:01:57 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.41399999999999998,"15min":0.40000000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.40999999999999998,"15min":0.40300000000000002},"min":{"1min":0.255,"5min":0.248,"15min":0.248},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.38200000000000001}]},{"osd":3,"last update":"Tue Jun 18 02:02:21 2024","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.46999999999999997,"15min":0.47699999999999998},"min":{"1min":0.27900000000000003,"5min":0.247,"15min":0.247},"max":{"1min":0.69899999999999995,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.378,"5min":0.45000000000000001,"15min":0.46200000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.622,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.40999999999999998}]},{"osd":4,"last update":"Tue Jun 18 02:01:39 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.58099999999999996,"15min":0.58399999999999996},"min":{"1min":0.442,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.623,"15min":0.624},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.81899999999999995,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.52500000000000002}]},{"osd":5,"last update":"Tue Jun 18 02:02:03 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.435,"5min":0.433,"15min":0.433},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.58599999999999997,"15min":0.58199999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.53200000000000003}]},{"osd":6,"last update":"Tue Jun 18 02:01:28 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.56699999999999995}]},{"osd":7,"last update":"Tue Jun 18 02:01:51 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.58899999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738423,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6928,"kb_used_data":1096,"kb_used_omap":0,"kb_used_meta":5824,"kb_avail":93738224,"statfs":{"total":95995035648,"available":95987941376,"internally_reserved":0,"allocated":1122304,"data_stored":769588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5963776},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Jun 18 02:01:28 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.34999999999999998,"15min":0.33900000000000002},"min":{"1min":0.24399999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.38200000000000001,"15min":0.36899999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.58199999999999996}]},{"osd":2,"last update":"Tue Jun 18 02:01:57 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.40100000000000002,"15min":0.39600000000000002},"min":{"1min":0.27800000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.44700000000000001,"15min":0.44600000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.60399999999999998}]},{"osd":3,"last update":"Tue Jun 18 02:02:18 2024","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.442,"15min":0.45000000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.55800000000000005,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.374,"5min":0.437,"15min":0.45000000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.51500000000000001,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.61899999999999999}]},{"osd":4,"last update":"Tue Jun 18 02:01:40 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.58299999999999996,"15min":0.59299999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.89700000000000002,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.61699999999999999,"15min":0.625},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.73299999999999998,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.97099999999999997}]},{"osd":5,"last update":"Tue Jun 18 02:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58199999999999996,"15min":0.57999999999999996},"min":{"1min":0.436,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.82099999999999995,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.876},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60199999999999998,"15min":0.59999999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.98099999999999998}]},{"osd":6,"last update":"Tue Jun 18 02:01:26 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.85299999999999998}]},{"osd":7,"last update":"Tue Jun 18 02:01:51 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":1.0289999999999999}]}]},{"osd":2,"up_from":18,"seq":77309411372,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":6216,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93738936,"statfs":{"total":95995035648,"available":95988670464,"internally_reserved":0,"allocated":589824,"data_stored":240660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jun 18 02:01:54 2024","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.38900000000000001,"15min":0.39400000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.371},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.41099999999999998,"15min":0.41199999999999998},"min":{"1min":0.253,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.27800000000000002}]},{"osd":1,"last update":"Tue Jun 18 02:01:54 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.27800000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.42099999999999999,"15min":0.41899999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.41399999999999998}]},{"osd":3,"last update":"Tue Jun 18 02:02:21 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.45000000000000001,"15min":0.45200000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.316},{"interface":"front","average":{"1min":0.438,"5min":0.46600000000000003,"15min":0.47299999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.69499999999999995,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.443}]},{"osd":4,"last update":"Tue Jun 18 02:01:46 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.57699999999999996,"15min":0.56799999999999995},"min":{"1min":0.434,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.59299999999999997,"15min":0.58599999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.53300000000000003}]},{"osd":5,"last update":"Tue Jun 18 02:02:03 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63300000000000001,"15min":0.63200000000000001},"min":{"1min":0.53600000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.79000000000000004,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.61899999999999999,"15min":0.61599999999999999},"min":{"1min":0.46400000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.748,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.45900000000000002}]},{"osd":6,"last update":"Tue Jun 18 02:01:28 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.49399999999999999}]},{"osd":7,"last update":"Tue Jun 18 02:01:54 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.62}]}]},{"osd":3,"up_from":26,"seq":111669149736,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5704,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":5120,"kb_avail":93739448,"statfs":{"total":95995035648,"available":95989194752,"internally_reserved":0,"allocated":589824,"data_stored":240660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5242880},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jun 18 02:02:18 2024","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.377,"15min":0.36599999999999999},"min":{"1min":0.27200000000000002,"5min":0.222,"15min":0.222},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.41399999999999998,"15min":0.41599999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.68999999999999995,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.28799999999999998}]},{"osd":1,"last update":"Tue Jun 18 02:02:18 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.439,"15min":0.441},"min":{"1min":0.30099999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.66100000000000003,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.376},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.42399999999999999,"15min":0.42199999999999999},"min":{"1min":0.27400000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.63500000000000001,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.47699999999999998}]},{"osd":2,"last update":"Tue Jun 18 02:02:18 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.46700000000000003,"15min":0.46100000000000002},"min":{"1min":0.34200000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.68400000000000005,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.437,"15min":0.439},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.67100000000000004,"5min":0.752,"15min":0.752},"last":0.42199999999999999}]},{"osd":4,"last update":"Tue Jun 18 02:01:38 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.59199999999999997,"15min":0.58399999999999996},"min":{"1min":0.44500000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.59799999999999998,"15min":0.59099999999999997},"min":{"1min":0.45000000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.503}]},{"osd":5,"last update":"Tue Jun 18 02:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.58299999999999996,"15min":0.57599999999999996},"min":{"1min":0.42999999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.63800000000000001,"15min":0.64000000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.92300000000000004,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.441}]},{"osd":6,"last update":"Tue Jun 18 02:01:26 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.52700000000000002}]},{"osd":7,"last update":"Tue Jun 18 02:01:52 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.53800000000000003}]}]},{"osd":4,"up_from":31,"seq":133143986211,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5768,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":5184,"kb_avail":93739384,"statfs":{"total":95995035648,"available":95989129216,"internally_reserved":0,"allocated":589824,"data_stored":240660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5308416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jun 18 02:01:38 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.41399999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.69399999999999995,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.53800000000000003,"15min":0.53300000000000003},"min":{"1min":0.34300000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.74399999999999999,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.52700000000000002}]},{"osd":1,"last update":"Tue Jun 18 02:01:38 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.53100000000000003,"15min":0.52500000000000002},"min":{"1min":0.434,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.69699999999999995,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.441},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.52200000000000002,"15min":0.51600000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.72799999999999998,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.44800000000000001}]},{"osd":2,"last update":"Tue Jun 18 02:01:38 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.55400000000000005,"15min":0.54600000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.77500000000000002,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.52300000000000002,"15min":0.51600000000000001},"min":{"1min":0.41499999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.74199999999999999,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.47299999999999998}]},{"osd":3,"last update":"Tue Jun 18 02:01:38 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.53800000000000003,"15min":0.53100000000000003},"min":{"1min":0.39500000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81000000000000005,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55000000000000004,"15min":0.54800000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.71099999999999997,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.46500000000000002}]},{"osd":5,"last update":"Tue Jun 18 02:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.39800000000000002,"15min":0.38600000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.40400000000000003,"15min":0.39200000000000002},"min":{"1min":0.30299999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.379}]},{"osd":6,"last update":"Tue Jun 18 02:01:26 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.498}]},{"osd":7,"last update":"Tue Jun 18 02:01:51 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.42999999999999999}]}]},{"osd":5,"up_from":39,"seq":167503724574,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5632,"kb_used_data":568,"kb_used_omap":0,"kb_used_meta":5056,"kb_avail":93739520,"statfs":{"total":95995035648,"available":95989268480,"internally_reserved":0,"allocated":581632,"data_stored":240072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5177344},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jun 18 02:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.57599999999999996,"15min":0.58199999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.79800000000000004,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.38400000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.79200000000000004,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.623}]},{"osd":1,"last update":"Tue Jun 18 02:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.55800000000000005,"15min":0.56000000000000005},"min":{"1min":0.41899999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.58699999999999997,"15min":0.59899999999999998},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.76200000000000001,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.72499999999999998}]},{"osd":2,"last update":"Tue Jun 18 02:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56499999999999995,"15min":0.56799999999999995},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.57699999999999996,"15min":0.58499999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.76700000000000002,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.70299999999999996}]},{"osd":3,"last update":"Tue Jun 18 02:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55500000000000005,"15min":0.55700000000000005},"min":{"1min":0.41599999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.58399999999999996,"15min":0.58799999999999997},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.74099999999999999}]},{"osd":4,"last update":"Tue Jun 18 02:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.55500000000000005,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.42599999999999999,"15min":0.42699999999999999},"min":{"1min":0.30399999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.56499999999999995,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.52200000000000002}]},{"osd":6,"last update":"Tue Jun 18 02:01:26 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.57899999999999996}]},{"osd":7,"last update":"Tue Jun 18 02:01:52 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.56999999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-18T02:02:30.632 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-06-18T02:02:30.632 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-06-18T02:02:30.633 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-06-18T02:02:30.633 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- ceph health --format=json 2024-06-18T02:02:31.200 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/mon.a/config 2024-06-18T02:02:31.328 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:31 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:31.328 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:31 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:31.329 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:02:31 smithi007 systemd[1]: Stopping Ceph alertmanager.a for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:02:31.329 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:02:31 smithi007 bash[50120]: Error: no container with name or ID "ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager.a" found: no such container 2024-06-18T02:02:31.474 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:31 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:31.657 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:02:31 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[48650]: level=info ts=2024-06-18T02:02:31.551Z caller=main.go:557 msg="Received SIGTERM, exiting gracefully..." 2024-06-18T02:02:32.426 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:32 smithi130 ceph-mon[26123]: pgmap v44: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:32.473 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:32 smithi007 ceph-mon[25091]: pgmap v44: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:32.473 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:02:32 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.130 - - [18/Jun/2024:02:02:32] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:02:32.474 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:32 smithi007 ceph-mon[29879]: pgmap v44: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:33.104 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-06-18T02:02:33.104 INFO:teuthology.orchestra.run.smithi007.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-06-18T02:02:33.104 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:02:32 smithi007 podman[50153]: 2024-06-18 02:02:32.901963246 +0000 UTC m=+1.657410921 container died d2ea381be400502e4e392808380b30c19b84638a1fda17eb4fa4a182b35b051d (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-06-18T02:02:33.418 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:02:33 smithi007 podman[50153]: 2024-06-18 02:02:33.25964438 +0000 UTC m=+2.015092127 container cleanup d2ea381be400502e4e392808380b30c19b84638a1fda17eb4fa4a182b35b051d (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-06-18T02:02:33.418 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:02:33 smithi007 bash[50153]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a 2024-06-18T02:02:33.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:33 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:33.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:33 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:33.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:33 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/2773638286' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-06-18T02:02:33.683 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:02:33 smithi007 podman[50174]: 2024-06-18 02:02:33.455219807 +0000 UTC m=+1.882923292 container remove d2ea381be400502e4e392808380b30c19b84638a1fda17eb4fa4a182b35b051d (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-06-18T02:02:33.683 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:02:33 smithi007 podman[50174]: 2024-06-18 02:02:33.62890054 +0000 UTC m=+2.056604026 volume remove 914db7f1820e17963e67d97b28328bd802654a1c669683ff13cafdadca98df33 2024-06-18T02:02:33.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:33 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:33.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:33 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:33.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:33 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/2773638286' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-06-18T02:02:33.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:33 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:33.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:33 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:33.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:33 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/2773638286' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-06-18T02:02:34.373 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-06-18T02:02:34.374 INFO:tasks.cephadm:Setup complete, yielding 2024-06-18T02:02:34.374 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-06-18T02:02:34.384 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi007.front.sepia.ceph.com 2024-06-18T02:02:34.385 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest false --force' 2024-06-18T02:02:34.675 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:34 smithi007 ceph-mon[25091]: pgmap v45: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:34.676 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:34 smithi007 ceph-mon[29879]: pgmap v45: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:34.676 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:02:34 smithi007 bash[50317]: Error: no container with name or ID "ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager.a" found: no such container 2024-06-18T02:02:34.676 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:02:34 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@alertmanager.a.service: Deactivated successfully. 2024-06-18T02:02:34.676 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:02:34 smithi007 systemd[1]: Stopped Ceph alertmanager.a for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:02:34.676 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:02:34 smithi007 systemd[1]: Starting Ceph alertmanager.a for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:02:34.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:34 smithi130 ceph-mon[26123]: pgmap v45: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:35.429 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:02:35 smithi007 podman[50515]: 2024-06-18 02:02:35.263520886 +0000 UTC m=+0.199481739 image pull ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4 quay.io/prometheus/alertmanager:v0.23.0 2024-06-18T02:02:35.429 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:02:35 smithi007 podman[50515]: 2024-06-18 02:02:35.372674142 +0000 UTC m=+0.308634974 volume create 99fd0926cde1826aa322da5c7ed36df621d184cc44eb9f17691b0897167c736c 2024-06-18T02:02:35.692 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:35 smithi007 ceph-mon[25091]: pgmap v46: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:35.693 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:35 smithi007 ceph-mon[29879]: pgmap v46: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:35.693 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:02:35 smithi007 podman[50515]: 2024-06-18 02:02:35.481467365 +0000 UTC m=+0.417428197 container create 8a3093399f5a9b89919a0ec6bbaa9a7c21ca8086f30f9a09247c9900288c6a8a (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-06-18T02:02:35.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:35 smithi130 ceph-mon[26123]: pgmap v46: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:36.110 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:02:35 smithi007 podman[50515]: 2024-06-18 02:02:35.801150643 +0000 UTC m=+0.737111490 container init 8a3093399f5a9b89919a0ec6bbaa9a7c21ca8086f30f9a09247c9900288c6a8a (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-06-18T02:02:36.110 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:02:35 smithi007 podman[50515]: 2024-06-18 02:02:35.80428883 +0000 UTC m=+0.740249668 container start 8a3093399f5a9b89919a0ec6bbaa9a7c21ca8086f30f9a09247c9900288c6a8a (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-06-18T02:02:36.110 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:02:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=info ts=2024-06-18T02:02:35.814Z caller=main.go:225 msg="Starting Alertmanager" version="(version=0.23.0, branch=HEAD, revision=61046b17771a57cfd4c4a51be370ab930a4d7d54)" 2024-06-18T02:02:36.110 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:02:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=info ts=2024-06-18T02:02:35.814Z caller=main.go:226 build_context="(go=go1.16.7, user=root@e21a959be8d2, date=20210825-10:48:55)" 2024-06-18T02:02:36.110 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:02:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=info ts=2024-06-18T02:02:35.815Z caller=cluster.go:184 component=cluster msg="setting advertise address explicitly" addr=172.21.15.7 port=9094 2024-06-18T02:02:36.110 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:02:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=info ts=2024-06-18T02:02:35.817Z caller=cluster.go:671 component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-06-18T02:02:36.110 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:02:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=info ts=2024-06-18T02:02:35.848Z caller=coordinator.go:113 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-06-18T02:02:36.110 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:02:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=info ts=2024-06-18T02:02:35.849Z caller=coordinator.go:126 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-06-18T02:02:36.110 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:02:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=info ts=2024-06-18T02:02:35.851Z caller=main.go:518 msg=Listening address=:9093 2024-06-18T02:02:36.110 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:02:35 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=info ts=2024-06-18T02:02:35.851Z caller=tls_config.go:191 msg="TLS is disabled." http2=false 2024-06-18T02:02:36.111 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:02:35 smithi007 bash[50515]: 8a3093399f5a9b89919a0ec6bbaa9a7c21ca8086f30f9a09247c9900288c6a8a 2024-06-18T02:02:36.111 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:02:35 smithi007 systemd[1]: Started Ceph alertmanager.a for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:02:37.095 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:36 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:37.095 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:36 smithi007 ceph-mon[25091]: Reconfiguring prometheus.a (dependencies changed)... 2024-06-18T02:02:37.095 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:36 smithi007 ceph-mon[25091]: Reconfiguring daemon prometheus.a on smithi130 2024-06-18T02:02:37.096 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:36 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:37.096 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:36 smithi007 ceph-mon[29879]: Reconfiguring prometheus.a (dependencies changed)... 2024-06-18T02:02:37.096 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:36 smithi007 ceph-mon[29879]: Reconfiguring daemon prometheus.a on smithi130 2024-06-18T02:02:37.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:36 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:37.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:36 smithi130 ceph-mon[26123]: Reconfiguring prometheus.a (dependencies changed)... 2024-06-18T02:02:37.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:36 smithi130 ceph-mon[26123]: Reconfiguring daemon prometheus.a on smithi130 2024-06-18T02:02:38.081 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:37 smithi007 ceph-mon[25091]: pgmap v47: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:38.081 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:37 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/1517914421' entity='client.admin' 2024-06-18T02:02:38.082 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:37 smithi007 ceph-mon[29879]: pgmap v47: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:38.082 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:37 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/1517914421' entity='client.admin' 2024-06-18T02:02:38.082 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:02:37 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=info ts=2024-06-18T02:02:37.818Z caller=cluster.go:696 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.00107485s 2024-06-18T02:02:38.109 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-06-18T02:02:38.118 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi007.front.sepia.ceph.com 2024-06-18T02:02:38.118 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -e sha1=3781e3a592387d16e8020f5db99cdee4198f6d00 -- bash -c 'radosgw-admin realm create --rgw-realm=r --default' 2024-06-18T02:02:38.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:37 smithi130 ceph-mon[26123]: pgmap v47: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:38.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:37 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/1517914421' entity='client.admin' 2024-06-18T02:02:38.699 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:02:38 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.7 - - [18/Jun/2024:02:02:38] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:02:39.043 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:02:38 smithi130 systemd[1]: Stopping Ceph prometheus.a for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:02:39.043 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:02:38 smithi130 bash[45366]: Error: no container with name or ID "ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus.a" found: no such container 2024-06-18T02:02:39.344 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:02:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[42259]: ts=2024-06-18T02:02:39.044Z caller=main.go:775 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-06-18T02:02:39.345 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:02:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[42259]: ts=2024-06-18T02:02:39.044Z caller=main.go:798 level=info msg="Stopping scrape discovery manager..." 2024-06-18T02:02:39.345 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:02:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[42259]: ts=2024-06-18T02:02:39.044Z caller=main.go:812 level=info msg="Stopping notify discovery manager..." 2024-06-18T02:02:39.345 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:02:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[42259]: ts=2024-06-18T02:02:39.044Z caller=main.go:834 level=info msg="Stopping scrape manager..." 2024-06-18T02:02:39.345 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:02:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[42259]: ts=2024-06-18T02:02:39.044Z caller=manager.go:945 level=info component="rule manager" msg="Stopping rule manager..." 2024-06-18T02:02:39.345 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:02:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[42259]: ts=2024-06-18T02:02:39.044Z caller=main.go:794 level=info msg="Scrape discovery manager stopped" 2024-06-18T02:02:39.345 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:02:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[42259]: ts=2024-06-18T02:02:39.044Z caller=main.go:828 level=info msg="Scrape manager stopped" 2024-06-18T02:02:39.345 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:02:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[42259]: ts=2024-06-18T02:02:39.045Z caller=main.go:808 level=info msg="Notify discovery manager stopped" 2024-06-18T02:02:39.345 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:02:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[42259]: ts=2024-06-18T02:02:39.044Z caller=manager.go:955 level=info component="rule manager" msg="Rule manager stopped" 2024-06-18T02:02:39.345 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:02:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[42259]: ts=2024-06-18T02:02:39.045Z caller=notifier.go:600 level=info component=notifier msg="Stopping notification manager..." 2024-06-18T02:02:39.345 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:02:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[42259]: ts=2024-06-18T02:02:39.045Z caller=main.go:1054 level=info msg="Notifier manager stopped" 2024-06-18T02:02:39.345 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:02:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[42259]: ts=2024-06-18T02:02:39.045Z caller=main.go:1066 level=info msg="See you next time!" 2024-06-18T02:02:39.345 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:02:39 smithi130 podman[45378]: 2024-06-18 02:02:39.054782547 +0000 UTC m=+0.135366556 container died 71be092acb00c2c950ffdd45ade4450a3ed83e46fa11749c314a43ef4ab10a54 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-06-18T02:02:39.677 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:39 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:39.678 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:39 smithi130 ceph-mon[26123]: pgmap v48: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:39.678 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:39 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:39.678 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:02:39 smithi130 podman[45378]: 2024-06-18 02:02:39.444016428 +0000 UTC m=+0.524600439 container cleanup 71be092acb00c2c950ffdd45ade4450a3ed83e46fa11749c314a43ef4ab10a54 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-06-18T02:02:39.678 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:02:39 smithi130 bash[45378]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a 2024-06-18T02:02:39.678 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:02:39 smithi130 bash[45404]: Error: no container with name or ID "ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus.a" found: no such container 2024-06-18T02:02:39.762 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:39 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:39.762 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:39 smithi007 ceph-mon[25091]: pgmap v48: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:39.762 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:39 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:39.762 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:39 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:39.763 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:39 smithi007 ceph-mon[29879]: pgmap v48: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:39.763 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:39 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:40.015 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:02:39 smithi130 podman[45390]: 2024-06-18 02:02:39.678864284 +0000 UTC m=+0.621366531 container remove 71be092acb00c2c950ffdd45ade4450a3ed83e46fa11749c314a43ef4ab10a54 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-06-18T02:02:40.015 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:02:39 smithi130 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@prometheus.a.service: Deactivated successfully. 2024-06-18T02:02:40.015 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:02:39 smithi130 systemd[1]: Stopped Ceph prometheus.a for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:02:40.016 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:02:39 smithi130 systemd[1]: Starting Ceph prometheus.a for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:02:40.016 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:02:39 smithi130 podman[45465]: 2024-06-18 02:02:39.913104939 +0000 UTC m=+0.112112841 container create 5b12ac431abe416e33ce133eb664b37ad1ba430038cffa488bf2807a1793beb1 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-06-18T02:02:40.016 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:02:39 smithi130 podman[45465]: 2024-06-18 02:02:39.81898139 +0000 UTC m=+0.017989295 image pull 514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d quay.io/prometheus/prometheus:v2.33.4 2024-06-18T02:02:40.452 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:02:40 smithi130 podman[45465]: 2024-06-18 02:02:40.132727523 +0000 UTC m=+0.331735440 container init 5b12ac431abe416e33ce133eb664b37ad1ba430038cffa488bf2807a1793beb1 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-06-18T02:02:40.453 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:02:40 smithi130 podman[45465]: 2024-06-18 02:02:40.135369093 +0000 UTC m=+0.334377000 container start 5b12ac431abe416e33ce133eb664b37ad1ba430038cffa488bf2807a1793beb1 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-06-18T02:02:40.453 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:02:40 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[45479]: ts=2024-06-18T02:02:40.158Z caller=main.go:475 level=info msg="No time or size retention was set so using the default time retention" duration=15d 2024-06-18T02:02:40.453 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:02:40 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[45479]: ts=2024-06-18T02:02:40.158Z caller=main.go:512 level=info msg="Starting Prometheus" version="(version=2.33.4, branch=HEAD, revision=83032011a5d3e6102624fe58241a374a7201fee8)" 2024-06-18T02:02:40.453 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:02:40 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[45479]: ts=2024-06-18T02:02:40.158Z caller=main.go:517 level=info build_context="(go=go1.17.7, user=root@d13bf69e7be8, date=20220222-16:51:28)" 2024-06-18T02:02:40.453 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:02:40 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[45479]: ts=2024-06-18T02:02:40.158Z caller=main.go:518 level=info host_details="(Linux 5.14.0-460.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024 x86_64 smithi130 (none))" 2024-06-18T02:02:40.453 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:02:40 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[45479]: ts=2024-06-18T02:02:40.158Z caller=main.go:519 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-06-18T02:02:40.453 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:02:40 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[45479]: ts=2024-06-18T02:02:40.158Z caller=main.go:520 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-06-18T02:02:40.453 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:02:40 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[45479]: ts=2024-06-18T02:02:40.159Z caller=web.go:570 level=info component=web msg="Start listening for connections" address=:9095 2024-06-18T02:02:40.453 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:02:40 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[45479]: ts=2024-06-18T02:02:40.160Z caller=main.go:923 level=info msg="Starting TSDB ..." 2024-06-18T02:02:40.453 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:02:40 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[45479]: ts=2024-06-18T02:02:40.160Z caller=tls_config.go:195 level=info component=web msg="TLS is disabled." http2=false 2024-06-18T02:02:40.453 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:02:40 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[45479]: ts=2024-06-18T02:02:40.162Z caller=head.go:493 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-06-18T02:02:40.453 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:02:40 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[45479]: ts=2024-06-18T02:02:40.162Z caller=head.go:527 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.411µs 2024-06-18T02:02:40.453 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:02:40 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[45479]: ts=2024-06-18T02:02:40.162Z caller=head.go:533 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-06-18T02:02:40.454 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:02:40 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[45479]: ts=2024-06-18T02:02:40.163Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=1 2024-06-18T02:02:40.454 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:02:40 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[45479]: ts=2024-06-18T02:02:40.164Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=1 2024-06-18T02:02:40.454 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:02:40 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[45479]: ts=2024-06-18T02:02:40.164Z caller=head.go:610 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=24.13µs wal_replay_duration=1.480067ms total_replay_duration=1.516604ms 2024-06-18T02:02:40.454 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:02:40 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[45479]: ts=2024-06-18T02:02:40.164Z caller=main.go:944 level=info fs_type=XFS_SUPER_MAGIC 2024-06-18T02:02:40.454 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:02:40 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[45479]: ts=2024-06-18T02:02:40.164Z caller=main.go:947 level=info msg="TSDB started" 2024-06-18T02:02:40.454 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:02:40 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[45479]: ts=2024-06-18T02:02:40.164Z caller=main.go:1128 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-06-18T02:02:40.454 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:02:40 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[45479]: ts=2024-06-18T02:02:40.179Z caller=main.go:1165 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=15.273731ms db_storage=603ns remote_storage=1.242µs web_handler=281ns query_engine=525ns scrape=770.815µs scrape_sd=41.826µs notify=36.175µs notify_sd=12.637µs rules=14.204868ms 2024-06-18T02:02:40.454 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:02:40 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[45479]: ts=2024-06-18T02:02:40.180Z caller=main.go:896 level=info msg="Server is ready to receive web requests." 2024-06-18T02:02:40.454 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:02:40 smithi130 bash[45465]: 5b12ac431abe416e33ce133eb664b37ad1ba430038cffa488bf2807a1793beb1 2024-06-18T02:02:40.454 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:02:40 smithi130 systemd[1]: Started Ceph prometheus.a for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:02:40.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:40 smithi007 ceph-mon[25091]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-06-18T02:02:40.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:40 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:40.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:40 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-06-18T02:02:40.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:40 smithi007 ceph-mon[25091]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-06-18T02:02:40.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:40 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.7:9093"}]: dispatch 2024-06-18T02:02:40.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:40 smithi007 ceph-mon[25091]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.7:9093"}]: dispatch 2024-06-18T02:02:40.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:40 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:40.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:40 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-06-18T02:02:40.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:40 smithi007 ceph-mon[25091]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-06-18T02:02:40.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:40 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-06-18T02:02:40.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:40 smithi007 ceph-mon[25091]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-06-18T02:02:40.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:40 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.130:3000"}]: dispatch 2024-06-18T02:02:40.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:40 smithi007 ceph-mon[25091]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.130:3000"}]: dispatch 2024-06-18T02:02:40.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:40 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:40.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:40 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:02:40.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:40 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:02:40.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:40 smithi007 ceph-mon[25091]: pgmap v49: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:40.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:40 smithi007 ceph-mon[25091]: pgmap v50: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:40.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:40 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:40.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:40 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:02:40.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:40 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:02:40.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:40 smithi007 ceph-mon[25091]: pgmap v51: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:40.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:40 smithi007 ceph-mon[25091]: pgmap v52: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:40.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:40 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:40.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:40 smithi007 ceph-mon[29879]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-06-18T02:02:40.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:40 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:40.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:40 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-06-18T02:02:40.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:40 smithi007 ceph-mon[29879]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-06-18T02:02:40.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:40 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.7:9093"}]: dispatch 2024-06-18T02:02:40.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:40 smithi007 ceph-mon[29879]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.7:9093"}]: dispatch 2024-06-18T02:02:40.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:40 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:40.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:40 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-06-18T02:02:40.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:40 smithi007 ceph-mon[29879]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-06-18T02:02:40.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:40 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-06-18T02:02:40.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:40 smithi007 ceph-mon[29879]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-06-18T02:02:40.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:40 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.130:3000"}]: dispatch 2024-06-18T02:02:40.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:40 smithi007 ceph-mon[29879]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.130:3000"}]: dispatch 2024-06-18T02:02:40.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:40 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:40.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:40 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:02:40.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:40 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:02:40.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:40 smithi007 ceph-mon[29879]: pgmap v49: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:40.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:40 smithi007 ceph-mon[29879]: pgmap v50: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:40.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:40 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:40.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:40 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:02:40.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:40 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:02:40.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:40 smithi007 ceph-mon[29879]: pgmap v51: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:40.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:40 smithi007 ceph-mon[29879]: pgmap v52: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:40.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:40 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:40.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:40 smithi130 ceph-mon[26123]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-06-18T02:02:40.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:40 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:40.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:40 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-06-18T02:02:40.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:40 smithi130 ceph-mon[26123]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-06-18T02:02:40.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:40 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.7:9093"}]: dispatch 2024-06-18T02:02:40.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:40 smithi130 ceph-mon[26123]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.7:9093"}]: dispatch 2024-06-18T02:02:40.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:40 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:40.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:40 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-06-18T02:02:40.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:40 smithi130 ceph-mon[26123]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-06-18T02:02:40.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:40 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-06-18T02:02:40.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:40 smithi130 ceph-mon[26123]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-06-18T02:02:40.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:40 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.130:3000"}]: dispatch 2024-06-18T02:02:40.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:40 smithi130 ceph-mon[26123]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.130:3000"}]: dispatch 2024-06-18T02:02:40.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:40 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:40.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:40 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:02:40.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:40 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:02:40.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:40 smithi130 ceph-mon[26123]: pgmap v49: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:40.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:40 smithi130 ceph-mon[26123]: pgmap v50: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:40.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:40 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:40.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:40 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:02:40.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:40 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:02:40.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:40 smithi130 ceph-mon[26123]: pgmap v51: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:40.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:40 smithi130 ceph-mon[26123]: pgmap v52: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:40.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:40 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:41.495 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:02:41.495 INFO:teuthology.orchestra.run.smithi007.stdout: "id": "f6f547f9-c1cf-47fd-a987-40812c89ecaa", 2024-06-18T02:02:41.495 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "r", 2024-06-18T02:02:41.495 INFO:teuthology.orchestra.run.smithi007.stdout: "current_period": "2b23ac97-7234-486a-a959-769b4b5969e5", 2024-06-18T02:02:41.495 INFO:teuthology.orchestra.run.smithi007.stdout: "epoch": 1 2024-06-18T02:02:41.496 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:02:41.681 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:41 smithi007 ceph-mon[29879]: osdmap e61: 8 total, 8 up, 8 in 2024-06-18T02:02:41.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:41 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/623659943' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-06-18T02:02:41.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:41 smithi007 ceph-mon[25091]: osdmap e61: 8 total, 8 up, 8 in 2024-06-18T02:02:41.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:41 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/623659943' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-06-18T02:02:41.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:41 smithi130 ceph-mon[26123]: osdmap e61: 8 total, 8 up, 8 in 2024-06-18T02:02:41.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:41 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/623659943' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-06-18T02:02:42.054 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -e sha1=3781e3a592387d16e8020f5db99cdee4198f6d00 -- bash -c 'radosgw-admin zonegroup create --rgw-zonegroup=default --master --default' 2024-06-18T02:02:42.671 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:42 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/623659943' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-06-18T02:02:42.671 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:42 smithi007 ceph-mon[25091]: osdmap e62: 8 total, 8 up, 8 in 2024-06-18T02:02:42.672 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:42 smithi007 ceph-mon[25091]: pgmap v55: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:42.672 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:42 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/623659943' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-06-18T02:02:42.672 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:42 smithi007 ceph-mon[29879]: osdmap e62: 8 total, 8 up, 8 in 2024-06-18T02:02:42.672 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:42 smithi007 ceph-mon[29879]: pgmap v55: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:42.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:42 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/623659943' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-06-18T02:02:42.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:42 smithi130 ceph-mon[26123]: osdmap e62: 8 total, 8 up, 8 in 2024-06-18T02:02:42.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:42 smithi130 ceph-mon[26123]: pgmap v55: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:43.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:43 smithi130 ceph-mon[26123]: osdmap e63: 8 total, 8 up, 8 in 2024-06-18T02:02:43.863 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:43 smithi007 ceph-mon[25091]: osdmap e63: 8 total, 8 up, 8 in 2024-06-18T02:02:43.863 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:43 smithi007 ceph-mon[29879]: osdmap e63: 8 total, 8 up, 8 in 2024-06-18T02:02:44.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:44 smithi130 ceph-mon[26123]: pgmap v57: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:44.811 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:44 smithi007 ceph-mon[25091]: pgmap v57: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:44.812 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:44 smithi007 ceph-mon[29879]: pgmap v57: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:45.801 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:02:45.801 INFO:teuthology.orchestra.run.smithi007.stdout: "id": "3f95264d-e1a8-458f-9e40-1ca06297b9e7", 2024-06-18T02:02:45.801 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "default", 2024-06-18T02:02:45.801 INFO:teuthology.orchestra.run.smithi007.stdout: "api_name": "default", 2024-06-18T02:02:45.801 INFO:teuthology.orchestra.run.smithi007.stdout: "is_master": "true", 2024-06-18T02:02:45.801 INFO:teuthology.orchestra.run.smithi007.stdout: "endpoints": [], 2024-06-18T02:02:45.801 INFO:teuthology.orchestra.run.smithi007.stdout: "hostnames": [], 2024-06-18T02:02:45.801 INFO:teuthology.orchestra.run.smithi007.stdout: "hostnames_s3website": [], 2024-06-18T02:02:45.801 INFO:teuthology.orchestra.run.smithi007.stdout: "master_zone": "", 2024-06-18T02:02:45.802 INFO:teuthology.orchestra.run.smithi007.stdout: "zones": [], 2024-06-18T02:02:45.802 INFO:teuthology.orchestra.run.smithi007.stdout: "placement_targets": [], 2024-06-18T02:02:45.802 INFO:teuthology.orchestra.run.smithi007.stdout: "default_placement": "", 2024-06-18T02:02:45.802 INFO:teuthology.orchestra.run.smithi007.stdout: "realm_id": "f6f547f9-c1cf-47fd-a987-40812c89ecaa", 2024-06-18T02:02:45.802 INFO:teuthology.orchestra.run.smithi007.stdout: "sync_policy": { 2024-06-18T02:02:45.802 INFO:teuthology.orchestra.run.smithi007.stdout: "groups": [] 2024-06-18T02:02:45.802 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-06-18T02:02:45.802 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:02:46.088 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:02:45 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=info ts=2024-06-18T02:02:45.821Z caller=cluster.go:688 component=cluster msg="gossip settled; proceeding" elapsed=10.003502304s 2024-06-18T02:02:46.493 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -e sha1=3781e3a592387d16e8020f5db99cdee4198f6d00 -- bash -c 'radosgw-admin zone create --rgw-zonegroup=default --rgw-zone=z --master --default' 2024-06-18T02:02:46.915 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:46 smithi007 ceph-mon[25091]: pgmap v58: 33 pgs: 33 active+clean; 577 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s wr, 1 op/s 2024-06-18T02:02:46.916 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:46 smithi007 ceph-mon[29879]: pgmap v58: 33 pgs: 33 active+clean; 577 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s wr, 1 op/s 2024-06-18T02:02:47.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:46 smithi130 ceph-mon[26123]: pgmap v58: 33 pgs: 33 active+clean; 577 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s wr, 1 op/s 2024-06-18T02:02:49.338 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:02:49.339 INFO:teuthology.orchestra.run.smithi007.stdout: "id": "a604fe2c-bd48-48e0-9da9-19516c4c4ead", 2024-06-18T02:02:49.339 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "z", 2024-06-18T02:02:49.339 INFO:teuthology.orchestra.run.smithi007.stdout: "domain_root": "z.rgw.meta:root", 2024-06-18T02:02:49.339 INFO:teuthology.orchestra.run.smithi007.stdout: "control_pool": "z.rgw.control", 2024-06-18T02:02:49.339 INFO:teuthology.orchestra.run.smithi007.stdout: "gc_pool": "z.rgw.log:gc", 2024-06-18T02:02:49.339 INFO:teuthology.orchestra.run.smithi007.stdout: "lc_pool": "z.rgw.log:lc", 2024-06-18T02:02:49.339 INFO:teuthology.orchestra.run.smithi007.stdout: "log_pool": "z.rgw.log", 2024-06-18T02:02:49.339 INFO:teuthology.orchestra.run.smithi007.stdout: "intent_log_pool": "z.rgw.log:intent", 2024-06-18T02:02:49.339 INFO:teuthology.orchestra.run.smithi007.stdout: "usage_log_pool": "z.rgw.log:usage", 2024-06-18T02:02:49.339 INFO:teuthology.orchestra.run.smithi007.stdout: "roles_pool": "z.rgw.meta:roles", 2024-06-18T02:02:49.339 INFO:teuthology.orchestra.run.smithi007.stdout: "reshard_pool": "z.rgw.log:reshard", 2024-06-18T02:02:49.340 INFO:teuthology.orchestra.run.smithi007.stdout: "user_keys_pool": "z.rgw.meta:users.keys", 2024-06-18T02:02:49.340 INFO:teuthology.orchestra.run.smithi007.stdout: "user_email_pool": "z.rgw.meta:users.email", 2024-06-18T02:02:49.340 INFO:teuthology.orchestra.run.smithi007.stdout: "user_swift_pool": "z.rgw.meta:users.swift", 2024-06-18T02:02:49.340 INFO:teuthology.orchestra.run.smithi007.stdout: "user_uid_pool": "z.rgw.meta:users.uid", 2024-06-18T02:02:49.340 INFO:teuthology.orchestra.run.smithi007.stdout: "otp_pool": "z.rgw.otp", 2024-06-18T02:02:49.340 INFO:teuthology.orchestra.run.smithi007.stdout: "system_key": { 2024-06-18T02:02:49.340 INFO:teuthology.orchestra.run.smithi007.stdout: "access_key": "", 2024-06-18T02:02:49.340 INFO:teuthology.orchestra.run.smithi007.stdout: "secret_key": "" 2024-06-18T02:02:49.340 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:02:49.340 INFO:teuthology.orchestra.run.smithi007.stdout: "placement_pools": [ 2024-06-18T02:02:49.340 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-06-18T02:02:49.340 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "default-placement", 2024-06-18T02:02:49.340 INFO:teuthology.orchestra.run.smithi007.stdout: "val": { 2024-06-18T02:02:49.341 INFO:teuthology.orchestra.run.smithi007.stdout: "index_pool": "z.rgw.buckets.index", 2024-06-18T02:02:49.341 INFO:teuthology.orchestra.run.smithi007.stdout: "storage_classes": { 2024-06-18T02:02:49.341 INFO:teuthology.orchestra.run.smithi007.stdout: "STANDARD": { 2024-06-18T02:02:49.341 INFO:teuthology.orchestra.run.smithi007.stdout: "data_pool": "z.rgw.buckets.data" 2024-06-18T02:02:49.341 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-06-18T02:02:49.341 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:02:49.341 INFO:teuthology.orchestra.run.smithi007.stdout: "data_extra_pool": "z.rgw.buckets.non-ec", 2024-06-18T02:02:49.341 INFO:teuthology.orchestra.run.smithi007.stdout: "index_type": 0 2024-06-18T02:02:49.341 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-06-18T02:02:49.341 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-06-18T02:02:49.341 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-06-18T02:02:49.341 INFO:teuthology.orchestra.run.smithi007.stdout: "realm_id": "f6f547f9-c1cf-47fd-a987-40812c89ecaa", 2024-06-18T02:02:49.341 INFO:teuthology.orchestra.run.smithi007.stdout: "notif_pool": "z.rgw.log:notif" 2024-06-18T02:02:49.341 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:02:49.682 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:02:49 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.7 - - [18/Jun/2024:02:02:49] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:02:49.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:49 smithi007 ceph-mon[29879]: pgmap v59: 33 pgs: 33 active+clean; 577 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s wr, 1 op/s 2024-06-18T02:02:49.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:49 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:49.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:49 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:49.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:49 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:02:49.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:49 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:02:49.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:49 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:49.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:49 smithi007 ceph-mon[25091]: pgmap v59: 33 pgs: 33 active+clean; 577 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s wr, 1 op/s 2024-06-18T02:02:49.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:49 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:49.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:49 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:49.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:49 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:02:49.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:49 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:02:49.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:49 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:49.729 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:49 smithi130 ceph-mon[26123]: pgmap v59: 33 pgs: 33 active+clean; 577 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s wr, 1 op/s 2024-06-18T02:02:49.729 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:49 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:49.729 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:49 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:49.729 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:49 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:02:49.730 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:49 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:02:49.730 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:49 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:50.011 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:02:49 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.7 - - [18/Jun/2024:02:02:49] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:02:50.193 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -e sha1=3781e3a592387d16e8020f5db99cdee4198f6d00 -- bash -c 'radosgw-admin period update --rgw-realm=r --commit' 2024-06-18T02:02:50.421 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:02:50 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:02:50] "GET /metrics HTTP/1.1" 200 191495 "" "Prometheus/2.33.4" 2024-06-18T02:02:50.422 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:50 smithi007 ceph-mon[29879]: pgmap v60: 33 pgs: 33 active+clean; 577 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s wr, 1 op/s 2024-06-18T02:02:50.422 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:50 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:50.422 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:50 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:50.422 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:50 smithi007 ceph-mon[29879]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-06-18T02:02:50.422 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:50 smithi007 ceph-mon[29879]: Cluster is now healthy 2024-06-18T02:02:50.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:50 smithi007 ceph-mon[25091]: pgmap v60: 33 pgs: 33 active+clean; 577 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s wr, 1 op/s 2024-06-18T02:02:50.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:50 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:50.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:50 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:50.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:50 smithi007 ceph-mon[25091]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-06-18T02:02:50.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:50 smithi007 ceph-mon[25091]: Cluster is now healthy 2024-06-18T02:02:50.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:50 smithi130 ceph-mon[26123]: pgmap v60: 33 pgs: 33 active+clean; 577 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s wr, 1 op/s 2024-06-18T02:02:50.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:50 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:50.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:50 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:50.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:50 smithi130 ceph-mon[26123]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-06-18T02:02:50.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:50 smithi130 ceph-mon[26123]: Cluster is now healthy 2024-06-18T02:02:51.767 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:51 smithi007 ceph-mon[25091]: pgmap v61: 33 pgs: 33 active+clean; 579 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 812 B/s rd, 1.8 KiB/s wr, 3 op/s 2024-06-18T02:02:51.768 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:51 smithi007 ceph-mon[29879]: pgmap v61: 33 pgs: 33 active+clean; 579 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 812 B/s rd, 1.8 KiB/s wr, 3 op/s 2024-06-18T02:02:52.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:51 smithi130 ceph-mon[26123]: pgmap v61: 33 pgs: 33 active+clean; 579 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 812 B/s rd, 1.8 KiB/s wr, 3 op/s 2024-06-18T02:02:52.932 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:02:52 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.130 - - [18/Jun/2024:02:02:52] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:02:53.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:02:53 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:02:53] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-06-18T02:02:53.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:53 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:53.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:53 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:53.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:53 smithi130 ceph-mon[26123]: osdmap e64: 8 total, 8 up, 8 in 2024-06-18T02:02:53.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:53 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/2700903093' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2024-06-18T02:02:53.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:53 smithi130 ceph-mon[26123]: pgmap v63: 65 pgs: 32 unknown, 33 active+clean; 579 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 812 B/s rd, 1.8 KiB/s wr, 3 op/s 2024-06-18T02:02:53.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:53 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:53.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:53 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:53.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:53 smithi007 ceph-mon[25091]: osdmap e64: 8 total, 8 up, 8 in 2024-06-18T02:02:53.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:53 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/2700903093' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2024-06-18T02:02:53.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:53 smithi007 ceph-mon[25091]: pgmap v63: 65 pgs: 32 unknown, 33 active+clean; 579 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 812 B/s rd, 1.8 KiB/s wr, 3 op/s 2024-06-18T02:02:53.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:53 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:53.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:53 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:53.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:53 smithi007 ceph-mon[29879]: osdmap e64: 8 total, 8 up, 8 in 2024-06-18T02:02:53.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:53 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/2700903093' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2024-06-18T02:02:53.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:53 smithi007 ceph-mon[29879]: pgmap v63: 65 pgs: 32 unknown, 33 active+clean; 579 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 812 B/s rd, 1.8 KiB/s wr, 3 op/s 2024-06-18T02:02:55.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:54 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/2700903093' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]': finished 2024-06-18T02:02:55.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:54 smithi130 ceph-mon[26123]: osdmap e65: 8 total, 8 up, 8 in 2024-06-18T02:02:55.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:54 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/2700903093' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]': finished 2024-06-18T02:02:55.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:54 smithi007 ceph-mon[25091]: osdmap e65: 8 total, 8 up, 8 in 2024-06-18T02:02:55.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:54 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/2700903093' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]': finished 2024-06-18T02:02:55.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:54 smithi007 ceph-mon[29879]: osdmap e65: 8 total, 8 up, 8 in 2024-06-18T02:02:55.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:55 smithi007 ceph-mon[25091]: osdmap e66: 8 total, 8 up, 8 in 2024-06-18T02:02:55.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:55 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/2700903093' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2024-06-18T02:02:55.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:55 smithi007 ceph-mon[25091]: pgmap v66: 97 pgs: 32 unknown, 65 active+clean; 579 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 5.0 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-06-18T02:02:55.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:55 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/2700903093' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]': finished 2024-06-18T02:02:55.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:55 smithi007 ceph-mon[25091]: osdmap e67: 8 total, 8 up, 8 in 2024-06-18T02:02:55.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:55 smithi007 ceph-mon[29879]: osdmap e66: 8 total, 8 up, 8 in 2024-06-18T02:02:55.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:55 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/2700903093' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2024-06-18T02:02:55.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:55 smithi007 ceph-mon[29879]: pgmap v66: 97 pgs: 32 unknown, 65 active+clean; 579 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 5.0 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-06-18T02:02:55.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:55 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/2700903093' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]': finished 2024-06-18T02:02:55.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:55 smithi007 ceph-mon[29879]: osdmap e67: 8 total, 8 up, 8 in 2024-06-18T02:02:56.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:55 smithi130 ceph-mon[26123]: osdmap e66: 8 total, 8 up, 8 in 2024-06-18T02:02:56.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:55 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/2700903093' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2024-06-18T02:02:56.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:55 smithi130 ceph-mon[26123]: pgmap v66: 97 pgs: 32 unknown, 65 active+clean; 579 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 5.0 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-06-18T02:02:56.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:55 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/2700903093' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]': finished 2024-06-18T02:02:56.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:55 smithi130 ceph-mon[26123]: osdmap e67: 8 total, 8 up, 8 in 2024-06-18T02:02:58.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:57 smithi130 ceph-mon[26123]: osdmap e68: 8 total, 8 up, 8 in 2024-06-18T02:02:58.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:57 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/2334946511' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2024-06-18T02:02:58.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:57 smithi130 ceph-mon[26123]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2024-06-18T02:02:58.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:57 smithi130 ceph-mon[26123]: pgmap v69: 129 pgs: 64 unknown, 65 active+clean; 579 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 5.7 KiB/s rd, 5 op/s 2024-06-18T02:02:58.181 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:57 smithi007 ceph-mon[29879]: osdmap e68: 8 total, 8 up, 8 in 2024-06-18T02:02:58.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:57 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/2334946511' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2024-06-18T02:02:58.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:57 smithi007 ceph-mon[29879]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2024-06-18T02:02:58.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:57 smithi007 ceph-mon[29879]: pgmap v69: 129 pgs: 64 unknown, 65 active+clean; 579 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 5.7 KiB/s rd, 5 op/s 2024-06-18T02:02:58.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:57 smithi007 ceph-mon[25091]: osdmap e68: 8 total, 8 up, 8 in 2024-06-18T02:02:58.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:57 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/2334946511' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2024-06-18T02:02:58.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:57 smithi007 ceph-mon[25091]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2024-06-18T02:02:58.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:57 smithi007 ceph-mon[25091]: pgmap v69: 129 pgs: 64 unknown, 65 active+clean; 579 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 5.7 KiB/s rd, 5 op/s 2024-06-18T02:02:58.995 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:58 smithi130 ceph-mon[26123]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]': finished 2024-06-18T02:02:58.995 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:58 smithi130 ceph-mon[26123]: osdmap e69: 8 total, 8 up, 8 in 2024-06-18T02:02:58.995 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:58 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/2334946511' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-06-18T02:02:58.995 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:58 smithi130 ceph-mon[26123]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-06-18T02:02:59.181 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:58 smithi007 ceph-mon[29879]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]': finished 2024-06-18T02:02:59.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:58 smithi007 ceph-mon[29879]: osdmap e69: 8 total, 8 up, 8 in 2024-06-18T02:02:59.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:58 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/2334946511' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-06-18T02:02:59.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:58 smithi007 ceph-mon[29879]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-06-18T02:02:59.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:58 smithi007 ceph-mon[25091]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]': finished 2024-06-18T02:02:59.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:58 smithi007 ceph-mon[25091]: osdmap e69: 8 total, 8 up, 8 in 2024-06-18T02:02:59.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:58 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/2334946511' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-06-18T02:02:59.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:58 smithi007 ceph-mon[25091]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-06-18T02:02:59.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:59 smithi130 ceph-mon[26123]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-06-18T02:02:59.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:59 smithi130 ceph-mon[26123]: osdmap e70: 8 total, 8 up, 8 in 2024-06-18T02:02:59.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:59 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/2334946511' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2024-06-18T02:02:59.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:59 smithi130 ceph-mon[26123]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2024-06-18T02:02:59.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:59 smithi130 ceph-mon[26123]: pgmap v72: 129 pgs: 64 unknown, 65 active+clean; 579 KiB data, 50 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:59.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:59 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:59.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:59 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:59.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:02:59 smithi130 ceph-mon[26123]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2024-06-18T02:02:59.797 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:02:59 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.130 - - [18/Jun/2024:02:02:59] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:02:59.797 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:59 smithi007 ceph-mon[29879]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-06-18T02:02:59.797 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:59 smithi007 ceph-mon[29879]: osdmap e70: 8 total, 8 up, 8 in 2024-06-18T02:02:59.798 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:59 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/2334946511' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2024-06-18T02:02:59.798 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:59 smithi007 ceph-mon[29879]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2024-06-18T02:02:59.798 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:59 smithi007 ceph-mon[29879]: pgmap v72: 129 pgs: 64 unknown, 65 active+clean; 579 KiB data, 50 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:59.798 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:59 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:59.798 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:59 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:59.798 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:02:59 smithi007 ceph-mon[29879]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2024-06-18T02:02:59.798 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:59 smithi007 ceph-mon[25091]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-06-18T02:02:59.798 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:59 smithi007 ceph-mon[25091]: osdmap e70: 8 total, 8 up, 8 in 2024-06-18T02:02:59.798 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:59 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/2334946511' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2024-06-18T02:02:59.798 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:59 smithi007 ceph-mon[25091]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2024-06-18T02:02:59.799 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:59 smithi007 ceph-mon[25091]: pgmap v72: 129 pgs: 64 unknown, 65 active+clean; 579 KiB data, 50 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:02:59.799 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:59 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:59.799 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:59 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:02:59.799 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:02:59 smithi007 ceph-mon[25091]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2024-06-18T02:02:59.799 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:02:59.799 INFO:teuthology.orchestra.run.smithi007.stdout: "id": "4841f9f2-5dda-4b20-9357-da27251ad0fe", 2024-06-18T02:02:59.799 INFO:teuthology.orchestra.run.smithi007.stdout: "epoch": 1, 2024-06-18T02:02:59.799 INFO:teuthology.orchestra.run.smithi007.stdout: "predecessor_uuid": "2b23ac97-7234-486a-a959-769b4b5969e5", 2024-06-18T02:02:59.799 INFO:teuthology.orchestra.run.smithi007.stdout: "sync_status": [], 2024-06-18T02:02:59.799 INFO:teuthology.orchestra.run.smithi007.stdout: "period_map": { 2024-06-18T02:02:59.799 INFO:teuthology.orchestra.run.smithi007.stdout: "id": "4841f9f2-5dda-4b20-9357-da27251ad0fe", 2024-06-18T02:02:59.800 INFO:teuthology.orchestra.run.smithi007.stdout: "zonegroups": [ 2024-06-18T02:02:59.800 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-06-18T02:02:59.800 INFO:teuthology.orchestra.run.smithi007.stdout: "id": "3f95264d-e1a8-458f-9e40-1ca06297b9e7", 2024-06-18T02:02:59.800 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "default", 2024-06-18T02:02:59.800 INFO:teuthology.orchestra.run.smithi007.stdout: "api_name": "default", 2024-06-18T02:02:59.800 INFO:teuthology.orchestra.run.smithi007.stdout: "is_master": "true", 2024-06-18T02:02:59.800 INFO:teuthology.orchestra.run.smithi007.stdout: "endpoints": [], 2024-06-18T02:02:59.800 INFO:teuthology.orchestra.run.smithi007.stdout: "hostnames": [], 2024-06-18T02:02:59.800 INFO:teuthology.orchestra.run.smithi007.stdout: "hostnames_s3website": [], 2024-06-18T02:02:59.800 INFO:teuthology.orchestra.run.smithi007.stdout: "master_zone": "a604fe2c-bd48-48e0-9da9-19516c4c4ead", 2024-06-18T02:02:59.800 INFO:teuthology.orchestra.run.smithi007.stdout: "zones": [ 2024-06-18T02:02:59.800 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-06-18T02:02:59.800 INFO:teuthology.orchestra.run.smithi007.stdout: "id": "a604fe2c-bd48-48e0-9da9-19516c4c4ead", 2024-06-18T02:02:59.800 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "z", 2024-06-18T02:02:59.801 INFO:teuthology.orchestra.run.smithi007.stdout: "endpoints": [], 2024-06-18T02:02:59.801 INFO:teuthology.orchestra.run.smithi007.stdout: "log_meta": "false", 2024-06-18T02:02:59.801 INFO:teuthology.orchestra.run.smithi007.stdout: "log_data": "false", 2024-06-18T02:02:59.801 INFO:teuthology.orchestra.run.smithi007.stdout: "bucket_index_max_shards": 11, 2024-06-18T02:02:59.801 INFO:teuthology.orchestra.run.smithi007.stdout: "read_only": "false", 2024-06-18T02:02:59.801 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_type": "", 2024-06-18T02:02:59.801 INFO:teuthology.orchestra.run.smithi007.stdout: "sync_from_all": "true", 2024-06-18T02:02:59.801 INFO:teuthology.orchestra.run.smithi007.stdout: "sync_from": [], 2024-06-18T02:02:59.801 INFO:teuthology.orchestra.run.smithi007.stdout: "redirect_zone": "" 2024-06-18T02:02:59.801 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-06-18T02:02:59.801 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-06-18T02:02:59.801 INFO:teuthology.orchestra.run.smithi007.stdout: "placement_targets": [ 2024-06-18T02:02:59.801 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-06-18T02:02:59.801 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "default-placement", 2024-06-18T02:02:59.802 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-06-18T02:02:59.802 INFO:teuthology.orchestra.run.smithi007.stdout: "storage_classes": [ 2024-06-18T02:02:59.802 INFO:teuthology.orchestra.run.smithi007.stdout: "STANDARD" 2024-06-18T02:02:59.802 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-06-18T02:02:59.802 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-06-18T02:02:59.802 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-06-18T02:02:59.802 INFO:teuthology.orchestra.run.smithi007.stdout: "default_placement": "default-placement", 2024-06-18T02:02:59.802 INFO:teuthology.orchestra.run.smithi007.stdout: "realm_id": "f6f547f9-c1cf-47fd-a987-40812c89ecaa", 2024-06-18T02:02:59.802 INFO:teuthology.orchestra.run.smithi007.stdout: "sync_policy": { 2024-06-18T02:02:59.802 INFO:teuthology.orchestra.run.smithi007.stdout: "groups": [] 2024-06-18T02:02:59.802 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-06-18T02:02:59.802 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-06-18T02:02:59.802 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-06-18T02:02:59.803 INFO:teuthology.orchestra.run.smithi007.stdout: "short_zone_ids": [ 2024-06-18T02:02:59.803 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-06-18T02:02:59.803 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "a604fe2c-bd48-48e0-9da9-19516c4c4ead", 2024-06-18T02:02:59.803 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 2530657949 2024-06-18T02:02:59.803 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-06-18T02:02:59.803 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-06-18T02:02:59.803 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:02:59.803 INFO:teuthology.orchestra.run.smithi007.stdout: "master_zonegroup": "3f95264d-e1a8-458f-9e40-1ca06297b9e7", 2024-06-18T02:02:59.803 INFO:teuthology.orchestra.run.smithi007.stdout: "master_zone": "a604fe2c-bd48-48e0-9da9-19516c4c4ead", 2024-06-18T02:02:59.803 INFO:teuthology.orchestra.run.smithi007.stdout: "period_config": { 2024-06-18T02:02:59.803 INFO:teuthology.orchestra.run.smithi007.stdout: "bucket_quota": { 2024-06-18T02:02:59.803 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": false, 2024-06-18T02:02:59.803 INFO:teuthology.orchestra.run.smithi007.stdout: "check_on_raw": false, 2024-06-18T02:02:59.803 INFO:teuthology.orchestra.run.smithi007.stdout: "max_size": -1, 2024-06-18T02:02:59.804 INFO:teuthology.orchestra.run.smithi007.stdout: "max_size_kb": 0, 2024-06-18T02:02:59.804 INFO:teuthology.orchestra.run.smithi007.stdout: "max_objects": -1 2024-06-18T02:02:59.804 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:02:59.804 INFO:teuthology.orchestra.run.smithi007.stdout: "user_quota": { 2024-06-18T02:02:59.804 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": false, 2024-06-18T02:02:59.804 INFO:teuthology.orchestra.run.smithi007.stdout: "check_on_raw": false, 2024-06-18T02:02:59.804 INFO:teuthology.orchestra.run.smithi007.stdout: "max_size": -1, 2024-06-18T02:02:59.804 INFO:teuthology.orchestra.run.smithi007.stdout: "max_size_kb": 0, 2024-06-18T02:02:59.804 INFO:teuthology.orchestra.run.smithi007.stdout: "max_objects": -1 2024-06-18T02:02:59.804 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:02:59.805 INFO:teuthology.orchestra.run.smithi007.stdout: "user_ratelimit": { 2024-06-18T02:02:59.805 INFO:teuthology.orchestra.run.smithi007.stdout: "max_read_ops": 0, 2024-06-18T02:02:59.805 INFO:teuthology.orchestra.run.smithi007.stdout: "max_write_ops": 0, 2024-06-18T02:02:59.805 INFO:teuthology.orchestra.run.smithi007.stdout: "max_read_bytes": 0, 2024-06-18T02:02:59.805 INFO:teuthology.orchestra.run.smithi007.stdout: "max_write_bytes": 0, 2024-06-18T02:02:59.805 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": false 2024-06-18T02:02:59.805 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:02:59.805 INFO:teuthology.orchestra.run.smithi007.stdout: "bucket_ratelimit": { 2024-06-18T02:02:59.805 INFO:teuthology.orchestra.run.smithi007.stdout: "max_read_ops": 0, 2024-06-18T02:02:59.805 INFO:teuthology.orchestra.run.smithi007.stdout: "max_write_ops": 0, 2024-06-18T02:02:59.805 INFO:teuthology.orchestra.run.smithi007.stdout: "max_read_bytes": 0, 2024-06-18T02:02:59.805 INFO:teuthology.orchestra.run.smithi007.stdout: "max_write_bytes": 0, 2024-06-18T02:02:59.805 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": false 2024-06-18T02:02:59.805 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:02:59.806 INFO:teuthology.orchestra.run.smithi007.stdout: "anonymous_ratelimit": { 2024-06-18T02:02:59.806 INFO:teuthology.orchestra.run.smithi007.stdout: "max_read_ops": 0, 2024-06-18T02:02:59.806 INFO:teuthology.orchestra.run.smithi007.stdout: "max_write_ops": 0, 2024-06-18T02:02:59.806 INFO:teuthology.orchestra.run.smithi007.stdout: "max_read_bytes": 0, 2024-06-18T02:02:59.806 INFO:teuthology.orchestra.run.smithi007.stdout: "max_write_bytes": 0, 2024-06-18T02:02:59.806 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": false 2024-06-18T02:02:59.806 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-06-18T02:02:59.806 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:02:59.806 INFO:teuthology.orchestra.run.smithi007.stdout: "realm_id": "f6f547f9-c1cf-47fd-a987-40812c89ecaa", 2024-06-18T02:02:59.806 INFO:teuthology.orchestra.run.smithi007.stdout: "realm_name": "r", 2024-06-18T02:02:59.806 INFO:teuthology.orchestra.run.smithi007.stdout: "realm_epoch": 2 2024-06-18T02:02:59.806 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:03:00.157 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:03:00 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:03:00] "GET /metrics HTTP/1.1" 200 194157 "" "Prometheus/2.33.4" 2024-06-18T02:03:00.514 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -e sha1=3781e3a592387d16e8020f5db99cdee4198f6d00 -- bash -c 'ceph orch apply rgw foo --realm r --zone z --placement=2 --port=8000' 2024-06-18T02:03:01.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:00 smithi130 ceph-mon[26123]: osdmap e71: 8 total, 8 up, 8 in 2024-06-18T02:03:01.162 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:00 smithi007 ceph-mon[25091]: osdmap e71: 8 total, 8 up, 8 in 2024-06-18T02:03:01.162 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:00 smithi007 ceph-mon[29879]: osdmap e71: 8 total, 8 up, 8 in 2024-06-18T02:03:02.008 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:01 smithi007 ceph-mon[25091]: pgmap v74: 129 pgs: 129 active+clean; 579 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 229 B/s rd, 458 B/s wr, 1 op/s 2024-06-18T02:03:02.009 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:01 smithi007 ceph-mon[29879]: pgmap v74: 129 pgs: 129 active+clean; 579 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 229 B/s rd, 458 B/s wr, 1 op/s 2024-06-18T02:03:02.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:01 smithi130 ceph-mon[26123]: pgmap v74: 129 pgs: 129 active+clean; 579 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 229 B/s rd, 458 B/s wr, 1 op/s 2024-06-18T02:03:03.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:03:03 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:03:03] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-06-18T02:03:03.562 INFO:teuthology.orchestra.run.smithi007.stdout:Scheduled rgw.foo update... 2024-06-18T02:03:04.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:04 smithi007 ceph-mon[25091]: pgmap v75: 129 pgs: 129 active+clean; 579 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 341 B/s wr, 0 op/s 2024-06-18T02:03:04.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:04 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:04.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:04 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:03:04.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:04 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:03:04.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:04 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:04.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:04 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:04.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:04 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:04.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:04 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:04.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:04 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi007.dvbvbk", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-06-18T02:03:04.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:04 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi007.dvbvbk", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-06-18T02:03:04.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:04 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:04.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:04 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:03:04.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:04 smithi007 ceph-mon[29879]: pgmap v75: 129 pgs: 129 active+clean; 579 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 341 B/s wr, 0 op/s 2024-06-18T02:03:04.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:04 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:04.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:04 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:03:04.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:04 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:03:04.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:04 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:04.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:04 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:04.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:04 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:04.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:04 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:04.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:04 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi007.dvbvbk", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-06-18T02:03:04.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:04 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi007.dvbvbk", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-06-18T02:03:04.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:04 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:04.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:04 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:03:04.481 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -e sha1=3781e3a592387d16e8020f5db99cdee4198f6d00 -- bash -c 'ceph orch apply rgw smpl' 2024-06-18T02:03:04.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:04 smithi130 ceph-mon[26123]: pgmap v75: 129 pgs: 129 active+clean; 579 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 341 B/s wr, 0 op/s 2024-06-18T02:03:04.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:04 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:04.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:04 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:03:04.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:04 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:03:04.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:04 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:04.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:04 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:04.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:04 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:04.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:04 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:04.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:04 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi007.dvbvbk", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-06-18T02:03:04.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:04 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi007.dvbvbk", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-06-18T02:03:04.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:04 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:04.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:04 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:03:05.381 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:05 smithi007 ceph-mon[25091]: from='client.24586 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo", "realm": "r", "zone": "z", "placement": "2", "port": 8000, "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:03:05.381 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:05 smithi007 ceph-mon[25091]: Saving service rgw.foo spec with placement count:2 2024-06-18T02:03:05.381 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:05 smithi007 ceph-mon[25091]: Saving service rgw.foo spec with placement count:2 2024-06-18T02:03:05.381 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:05 smithi007 ceph-mon[25091]: Deploying daemon rgw.foo.smithi007.dvbvbk on smithi007 2024-06-18T02:03:05.381 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:05 smithi007 ceph-mon[29879]: from='client.24586 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo", "realm": "r", "zone": "z", "placement": "2", "port": 8000, "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:03:05.381 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:05 smithi007 ceph-mon[29879]: Saving service rgw.foo spec with placement count:2 2024-06-18T02:03:05.381 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:05 smithi007 ceph-mon[29879]: Saving service rgw.foo spec with placement count:2 2024-06-18T02:03:05.382 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:05 smithi007 ceph-mon[29879]: Deploying daemon rgw.foo.smithi007.dvbvbk on smithi007 2024-06-18T02:03:05.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:05 smithi130 ceph-mon[26123]: from='client.24586 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo", "realm": "r", "zone": "z", "placement": "2", "port": 8000, "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:03:05.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:05 smithi130 ceph-mon[26123]: Saving service rgw.foo spec with placement count:2 2024-06-18T02:03:05.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:05 smithi130 ceph-mon[26123]: Saving service rgw.foo spec with placement count:2 2024-06-18T02:03:05.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:05 smithi130 ceph-mon[26123]: Deploying daemon rgw.foo.smithi007.dvbvbk on smithi007 2024-06-18T02:03:06.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:06 smithi130 ceph-mon[26123]: pgmap v76: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-06-18T02:03:06.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:06 smithi007 ceph-mon[25091]: pgmap v76: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-06-18T02:03:06.803 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:06 smithi007 ceph-mon[29879]: pgmap v76: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-06-18T02:03:08.175 INFO:teuthology.orchestra.run.smithi007.stdout:Scheduled rgw.smpl update... 2024-06-18T02:03:08.380 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:08 smithi007 ceph-mon[25091]: pgmap v77: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 968 B/s rd, 1.1 KiB/s wr, 2 op/s 2024-06-18T02:03:08.380 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:08 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:08.381 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:08 smithi007 ceph-mon[29879]: pgmap v77: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 968 B/s rd, 1.1 KiB/s wr, 2 op/s 2024-06-18T02:03:08.381 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:08 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:08.527 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:08 smithi130 ceph-mon[26123]: pgmap v77: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 968 B/s rd, 1.1 KiB/s wr, 2 op/s 2024-06-18T02:03:08.528 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:08 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:09.018 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -e sha1=3781e3a592387d16e8020f5db99cdee4198f6d00 -- bash -c 'ceph osd pool create foo' 2024-06-18T02:03:09.538 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:09 smithi007 ceph-mon[25091]: from='client.24592 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "smpl", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:03:09.538 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:09 smithi007 ceph-mon[25091]: Saving service rgw.smpl spec with placement count:2 2024-06-18T02:03:09.538 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:09 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:09.539 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:09 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi130.aakmof", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-06-18T02:03:09.539 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:09 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi130.aakmof", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-06-18T02:03:09.539 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:09 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:09.539 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:09 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:03:09.539 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:09 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2024-06-18T02:03:09.539 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:09 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2024-06-18T02:03:09.539 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:09 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-06-18T02:03:09.539 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:09 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2024-06-18T02:03:09.539 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:09 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-06-18T02:03:09.539 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:09 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-06-18T02:03:09.539 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:09 smithi007 ceph-mon[29879]: from='client.24592 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "smpl", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:03:09.540 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:09 smithi007 ceph-mon[29879]: Saving service rgw.smpl spec with placement count:2 2024-06-18T02:03:09.540 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:09 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:09.540 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:09 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi130.aakmof", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-06-18T02:03:09.540 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:09 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi130.aakmof", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-06-18T02:03:09.540 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:09 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:09.540 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:09 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:03:09.540 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:09 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2024-06-18T02:03:09.540 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:09 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2024-06-18T02:03:09.540 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:09 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-06-18T02:03:09.540 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:09 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2024-06-18T02:03:09.540 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:09 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-06-18T02:03:09.540 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:09 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-06-18T02:03:09.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:09 smithi130 ceph-mon[26123]: from='client.24592 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "smpl", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:03:09.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:09 smithi130 ceph-mon[26123]: Saving service rgw.smpl spec with placement count:2 2024-06-18T02:03:09.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:09 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:09.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:09 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi130.aakmof", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-06-18T02:03:09.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:09 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi130.aakmof", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-06-18T02:03:09.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:09 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:09.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:09 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:03:09.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:09 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2024-06-18T02:03:09.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:09 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2024-06-18T02:03:09.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:09 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-06-18T02:03:09.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:09 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2024-06-18T02:03:09.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:09 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-06-18T02:03:09.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:09 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-06-18T02:03:10.158 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:03:10 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:03:10] "GET /metrics HTTP/1.1" 200 202553 "" "Prometheus/2.33.4" 2024-06-18T02:03:10.158 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:03:10 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.7 - - [18/Jun/2024:02:03:10] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:03:10.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:10 smithi007 ceph-mon[25091]: Deploying daemon rgw.foo.smithi130.aakmof on smithi130 2024-06-18T02:03:10.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:10 smithi007 ceph-mon[25091]: pgmap v78: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 819 B/s rd, 921 B/s wr, 2 op/s 2024-06-18T02:03:10.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:10 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]': finished 2024-06-18T02:03:10.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:10 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]': finished 2024-06-18T02:03:10.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:10 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]': finished 2024-06-18T02:03:10.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:10 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]': finished 2024-06-18T02:03:10.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:10 smithi007 ceph-mon[25091]: osdmap e72: 8 total, 8 up, 8 in 2024-06-18T02:03:10.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:10 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:10.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:10 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:10.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:10 smithi007 ceph-mon[29879]: Deploying daemon rgw.foo.smithi130.aakmof on smithi130 2024-06-18T02:03:10.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:10 smithi007 ceph-mon[29879]: pgmap v78: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 819 B/s rd, 921 B/s wr, 2 op/s 2024-06-18T02:03:10.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:10 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]': finished 2024-06-18T02:03:10.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:10 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]': finished 2024-06-18T02:03:10.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:10 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]': finished 2024-06-18T02:03:10.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:10 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]': finished 2024-06-18T02:03:10.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:10 smithi007 ceph-mon[29879]: osdmap e72: 8 total, 8 up, 8 in 2024-06-18T02:03:10.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:10 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:10.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:10 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:10.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:10 smithi130 ceph-mon[26123]: Deploying daemon rgw.foo.smithi130.aakmof on smithi130 2024-06-18T02:03:10.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:10 smithi130 ceph-mon[26123]: pgmap v78: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 819 B/s rd, 921 B/s wr, 2 op/s 2024-06-18T02:03:10.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:10 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]': finished 2024-06-18T02:03:10.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:10 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]': finished 2024-06-18T02:03:10.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:10 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]': finished 2024-06-18T02:03:10.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:10 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]': finished 2024-06-18T02:03:10.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:10 smithi130 ceph-mon[26123]: osdmap e72: 8 total, 8 up, 8 in 2024-06-18T02:03:10.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:10 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:10.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:10 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:11.520 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:11 smithi130 ceph-mon[26123]: osdmap e73: 8 total, 8 up, 8 in 2024-06-18T02:03:11.520 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:11 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/1867198573' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "foo"}]: dispatch 2024-06-18T02:03:11.520 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:11 smithi130 ceph-mon[26123]: pgmap v81: 129 pgs: 4 peering, 125 active+clean; 584 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 84 KiB/s rd, 5.0 KiB/s wr, 185 op/s 2024-06-18T02:03:11.722 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'foo' created 2024-06-18T02:03:11.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:11 smithi007 ceph-mon[25091]: osdmap e73: 8 total, 8 up, 8 in 2024-06-18T02:03:11.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:11 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/1867198573' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "foo"}]: dispatch 2024-06-18T02:03:11.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:11 smithi007 ceph-mon[25091]: pgmap v81: 129 pgs: 4 peering, 125 active+clean; 584 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 84 KiB/s rd, 5.0 KiB/s wr, 185 op/s 2024-06-18T02:03:11.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:11 smithi007 ceph-mon[29879]: osdmap e73: 8 total, 8 up, 8 in 2024-06-18T02:03:11.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:11 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/1867198573' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "foo"}]: dispatch 2024-06-18T02:03:11.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:11 smithi007 ceph-mon[29879]: pgmap v81: 129 pgs: 4 peering, 125 active+clean; 584 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 84 KiB/s rd, 5.0 KiB/s wr, 185 op/s 2024-06-18T02:03:12.506 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -e sha1=3781e3a592387d16e8020f5db99cdee4198f6d00 -- bash -c 'rbd pool init foo' 2024-06-18T02:03:12.827 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:12 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:12.827 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:12 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:03:12.827 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:12 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:03:12.827 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:12 smithi007 ceph-mon[25091]: pgmap v82: 129 pgs: 4 peering, 125 active+clean; 584 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 104 KiB/s rd, 5.1 KiB/s wr, 229 op/s 2024-06-18T02:03:12.827 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:12 smithi007 ceph-mon[25091]: Checking dashboard <-> RGW credentials 2024-06-18T02:03:12.827 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:12 smithi007 ceph-mon[25091]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-06-18T02:03:12.827 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:12 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/1867198573' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "foo"}]': finished 2024-06-18T02:03:12.827 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:12 smithi007 ceph-mon[25091]: osdmap e74: 8 total, 8 up, 8 in 2024-06-18T02:03:12.828 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:12 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:12.828 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:12 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:12.828 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:12 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:12.828 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:12 smithi007 ceph-mon[25091]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:03:12.828 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:12 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:03:12.828 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:12 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:03:12.828 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:12 smithi007 ceph-mon[25091]: pgmap v84: 161 pgs: 32 unknown, 125 active+clean, 4 peering; 584 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 235 KiB/s rd, 12 KiB/s wr, 519 op/s 2024-06-18T02:03:12.828 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:12 smithi007 ceph-mon[25091]: pgmap v85: 161 pgs: 32 unknown, 125 active+clean, 4 peering; 584 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 263 KiB/s rd, 13 KiB/s wr, 580 op/s 2024-06-18T02:03:12.828 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:12 smithi007 ceph-mon[25091]: Checking dashboard <-> RGW credentials 2024-06-18T02:03:12.828 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:12 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:12.828 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:12 smithi007 ceph-mon[25091]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:03:12.829 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:12 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:12.829 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:12 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:03:12.829 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:12 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:03:12.829 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:12 smithi007 ceph-mon[29879]: pgmap v82: 129 pgs: 4 peering, 125 active+clean; 584 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 104 KiB/s rd, 5.1 KiB/s wr, 229 op/s 2024-06-18T02:03:12.829 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:12 smithi007 ceph-mon[29879]: Checking dashboard <-> RGW credentials 2024-06-18T02:03:12.829 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:12 smithi007 ceph-mon[29879]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-06-18T02:03:12.829 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:12 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/1867198573' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "foo"}]': finished 2024-06-18T02:03:12.829 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:12 smithi007 ceph-mon[29879]: osdmap e74: 8 total, 8 up, 8 in 2024-06-18T02:03:12.829 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:12 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:12.829 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:12 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:12.829 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:12 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:12.829 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:12 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:03:12.830 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:12 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:03:12.830 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:12 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:03:12.830 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:12 smithi007 ceph-mon[29879]: pgmap v84: 161 pgs: 32 unknown, 125 active+clean, 4 peering; 584 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 235 KiB/s rd, 12 KiB/s wr, 519 op/s 2024-06-18T02:03:12.830 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:12 smithi007 ceph-mon[29879]: pgmap v85: 161 pgs: 32 unknown, 125 active+clean, 4 peering; 584 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 263 KiB/s rd, 13 KiB/s wr, 580 op/s 2024-06-18T02:03:12.830 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:12 smithi007 ceph-mon[29879]: Checking dashboard <-> RGW credentials 2024-06-18T02:03:12.830 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:12 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:12.830 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:12 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:03:12.954 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:12 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:12.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:12 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:03:12.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:12 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:03:12.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:12 smithi130 ceph-mon[26123]: pgmap v82: 129 pgs: 4 peering, 125 active+clean; 584 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 104 KiB/s rd, 5.1 KiB/s wr, 229 op/s 2024-06-18T02:03:12.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:12 smithi130 ceph-mon[26123]: Checking dashboard <-> RGW credentials 2024-06-18T02:03:12.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:12 smithi130 ceph-mon[26123]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-06-18T02:03:12.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:12 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/1867198573' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "foo"}]': finished 2024-06-18T02:03:12.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:12 smithi130 ceph-mon[26123]: osdmap e74: 8 total, 8 up, 8 in 2024-06-18T02:03:12.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:12 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:12.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:12 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:12.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:12 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:12.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:12 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:03:12.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:12 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:03:12.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:12 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:03:12.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:12 smithi130 ceph-mon[26123]: pgmap v84: 161 pgs: 32 unknown, 125 active+clean, 4 peering; 584 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 235 KiB/s rd, 12 KiB/s wr, 519 op/s 2024-06-18T02:03:12.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:12 smithi130 ceph-mon[26123]: pgmap v85: 161 pgs: 32 unknown, 125 active+clean, 4 peering; 584 KiB data, 54 MiB used, 715 GiB / 715 GiB avail; 263 KiB/s rd, 13 KiB/s wr, 580 op/s 2024-06-18T02:03:12.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:12 smithi130 ceph-mon[26123]: Checking dashboard <-> RGW credentials 2024-06-18T02:03:12.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:12 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:12.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:12 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:03:13.240 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:03:13 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:03:13] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-06-18T02:03:13.851 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:13 smithi130 ceph-mon[26123]: osdmap e75: 8 total, 8 up, 8 in 2024-06-18T02:03:13.851 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:13 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:14.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:13 smithi007 ceph-mon[25091]: osdmap e75: 8 total, 8 up, 8 in 2024-06-18T02:03:14.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:13 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:14.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:13 smithi007 ceph-mon[29879]: osdmap e75: 8 total, 8 up, 8 in 2024-06-18T02:03:14.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:13 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:15.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:14 smithi130 ceph-mon[26123]: osdmap e76: 8 total, 8 up, 8 in 2024-06-18T02:03:15.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:14 smithi130 ceph-mon[26123]: pgmap v88: 161 pgs: 32 unknown, 125 active+clean, 4 peering; 584 KiB data, 54 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:03:15.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:14 smithi007 ceph-mon[25091]: osdmap e76: 8 total, 8 up, 8 in 2024-06-18T02:03:15.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:14 smithi007 ceph-mon[25091]: pgmap v88: 161 pgs: 32 unknown, 125 active+clean, 4 peering; 584 KiB data, 54 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:03:15.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:14 smithi007 ceph-mon[29879]: osdmap e76: 8 total, 8 up, 8 in 2024-06-18T02:03:15.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:14 smithi007 ceph-mon[29879]: pgmap v88: 161 pgs: 32 unknown, 125 active+clean, 4 peering; 584 KiB data, 54 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:03:16.181 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:03:15 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.130 - - [18/Jun/2024:02:03:15] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:03:16.681 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:03:16 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.7 - - [18/Jun/2024:02:03:16] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:03:16.923 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:16 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:16.923 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:16 smithi130 ceph-mon[26123]: pgmap v89: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 263 KiB/s rd, 712 B/s wr, 393 op/s 2024-06-18T02:03:16.923 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:16 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:16.923 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:16 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/2294529845' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]: dispatch 2024-06-18T02:03:16.924 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:16 smithi130 ceph-mon[26123]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]: dispatch 2024-06-18T02:03:17.173 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:16 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:17.173 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:16 smithi007 ceph-mon[25091]: pgmap v89: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 263 KiB/s rd, 712 B/s wr, 393 op/s 2024-06-18T02:03:17.173 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:16 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:17.173 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:16 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/2294529845' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]: dispatch 2024-06-18T02:03:17.173 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:16 smithi007 ceph-mon[25091]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]: dispatch 2024-06-18T02:03:17.174 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:16 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:17.174 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:16 smithi007 ceph-mon[29879]: pgmap v89: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 263 KiB/s rd, 712 B/s wr, 393 op/s 2024-06-18T02:03:17.174 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:16 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:17.174 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:16 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/2294529845' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]: dispatch 2024-06-18T02:03:17.174 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:16 smithi007 ceph-mon[29879]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]: dispatch 2024-06-18T02:03:18.431 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:18 smithi007 ceph-mon[29879]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]': finished 2024-06-18T02:03:18.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:18 smithi007 ceph-mon[29879]: osdmap e77: 8 total, 8 up, 8 in 2024-06-18T02:03:18.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:18 smithi007 ceph-mon[25091]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]': finished 2024-06-18T02:03:18.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:18 smithi007 ceph-mon[25091]: osdmap e77: 8 total, 8 up, 8 in 2024-06-18T02:03:18.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:18 smithi130 ceph-mon[26123]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]': finished 2024-06-18T02:03:18.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:18 smithi130 ceph-mon[26123]: osdmap e77: 8 total, 8 up, 8 in 2024-06-18T02:03:18.931 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:03:18 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.130 - - [18/Jun/2024:02:03:18] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:03:19.383 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:03:19 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.7 - - [18/Jun/2024:02:03:19] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:03:19.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:19 smithi007 ceph-mon[25091]: pgmap v91: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 189 KiB/s rd, 511 B/s wr, 282 op/s 2024-06-18T02:03:19.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:19 smithi007 ceph-mon[25091]: osdmap e78: 8 total, 8 up, 8 in 2024-06-18T02:03:19.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:19 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:19.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:19 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:19.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:19 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:19.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:19 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:19.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:19 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:03:19.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:19 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:03:19.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:19 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:19.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:19 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:19.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:19 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi007.hgrnmk", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-06-18T02:03:19.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:19 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi007.hgrnmk", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-06-18T02:03:19.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:19 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:19.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:19 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:03:19.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:19 smithi007 ceph-mon[29879]: pgmap v91: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 189 KiB/s rd, 511 B/s wr, 282 op/s 2024-06-18T02:03:19.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:19 smithi007 ceph-mon[29879]: osdmap e78: 8 total, 8 up, 8 in 2024-06-18T02:03:19.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:19 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:19.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:19 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:19.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:19 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:19.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:19 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:19.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:19 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:03:19.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:19 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:03:19.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:19 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:19.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:19 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:19.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:19 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi007.hgrnmk", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-06-18T02:03:19.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:19 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi007.hgrnmk", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-06-18T02:03:19.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:19 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:19.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:19 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:03:19.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:19 smithi130 ceph-mon[26123]: pgmap v91: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 189 KiB/s rd, 511 B/s wr, 282 op/s 2024-06-18T02:03:19.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:19 smithi130 ceph-mon[26123]: osdmap e78: 8 total, 8 up, 8 in 2024-06-18T02:03:19.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:19 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:19.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:19 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:19.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:19 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:19.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:19 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:19.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:19 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:03:19.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:19 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:03:19.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:19 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:19.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:19 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:19.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:19 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi007.hgrnmk", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-06-18T02:03:19.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:19 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi007.hgrnmk", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-06-18T02:03:19.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:19 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:19.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:19 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:03:20.047 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -e sha1=3781e3a592387d16e8020f5db99cdee4198f6d00 -- bash -c 'ceph orch apply iscsi foo u p' 2024-06-18T02:03:20.271 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:03:20 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:03:20] "GET /metrics HTTP/1.1" 200 202553 "" "Prometheus/2.33.4" 2024-06-18T02:03:20.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:20 smithi007 ceph-mon[29879]: pgmap v93: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 211 KiB/s rd, 570 B/s wr, 315 op/s 2024-06-18T02:03:20.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:20 smithi007 ceph-mon[29879]: Saving service rgw.smpl spec with placement count:2 2024-06-18T02:03:20.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:20 smithi007 ceph-mon[29879]: Deploying daemon rgw.smpl.smithi007.hgrnmk on smithi007 2024-06-18T02:03:20.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:20 smithi007 ceph-mon[29879]: osdmap e79: 8 total, 8 up, 8 in 2024-06-18T02:03:20.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:20 smithi007 ceph-mon[29879]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-06-18T02:03:20.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:20 smithi007 ceph-mon[29879]: Cluster is now healthy 2024-06-18T02:03:20.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:20 smithi007 ceph-mon[25091]: pgmap v93: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 211 KiB/s rd, 570 B/s wr, 315 op/s 2024-06-18T02:03:20.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:20 smithi007 ceph-mon[25091]: Saving service rgw.smpl spec with placement count:2 2024-06-18T02:03:20.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:20 smithi007 ceph-mon[25091]: Deploying daemon rgw.smpl.smithi007.hgrnmk on smithi007 2024-06-18T02:03:20.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:20 smithi007 ceph-mon[25091]: osdmap e79: 8 total, 8 up, 8 in 2024-06-18T02:03:20.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:20 smithi007 ceph-mon[25091]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-06-18T02:03:20.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:20 smithi007 ceph-mon[25091]: Cluster is now healthy 2024-06-18T02:03:20.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:20 smithi130 ceph-mon[26123]: pgmap v93: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 211 KiB/s rd, 570 B/s wr, 315 op/s 2024-06-18T02:03:20.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:20 smithi130 ceph-mon[26123]: Saving service rgw.smpl spec with placement count:2 2024-06-18T02:03:20.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:20 smithi130 ceph-mon[26123]: Deploying daemon rgw.smpl.smithi007.hgrnmk on smithi007 2024-06-18T02:03:20.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:20 smithi130 ceph-mon[26123]: osdmap e79: 8 total, 8 up, 8 in 2024-06-18T02:03:20.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:20 smithi130 ceph-mon[26123]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-06-18T02:03:20.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:20 smithi130 ceph-mon[26123]: Cluster is now healthy 2024-06-18T02:03:21.942 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:21 smithi007 ceph-mon[25091]: pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 74 MiB used, 715 GiB / 715 GiB avail; 24 KiB/s rd, 403 B/s wr, 37 op/s 2024-06-18T02:03:21.943 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:21 smithi007 ceph-mon[29879]: pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 74 MiB used, 715 GiB / 715 GiB avail; 24 KiB/s rd, 403 B/s wr, 37 op/s 2024-06-18T02:03:22.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:21 smithi130 ceph-mon[26123]: pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 74 MiB used, 715 GiB / 715 GiB avail; 24 KiB/s rd, 403 B/s wr, 37 op/s 2024-06-18T02:03:23.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:03:23 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:03:23] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-06-18T02:03:23.329 INFO:teuthology.orchestra.run.smithi007.stdout:Scheduled iscsi.foo update... 2024-06-18T02:03:24.104 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -e sha1=3781e3a592387d16e8020f5db99cdee4198f6d00 -- bash -c 'sleep 120' 2024-06-18T02:03:24.420 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:24 smithi007 ceph-mon[29879]: pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 74 MiB used, 715 GiB / 715 GiB avail; 22 KiB/s rd, 357 B/s wr, 32 op/s 2024-06-18T02:03:24.420 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:24 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:24.420 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:24 smithi007 ceph-mon[29879]: from='client.14817 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "foo", "api_user": "u", "api_password": "p", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:03:24.420 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:24 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi130.wwebfk", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-06-18T02:03:24.420 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:24 smithi007 ceph-mon[29879]: Saving service iscsi.foo spec with placement count:1 2024-06-18T02:03:24.420 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:24 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi130.wwebfk", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-06-18T02:03:24.420 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:24 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:24.420 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:24 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:24.420 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:24 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:03:24.420 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:24 smithi007 ceph-mon[29879]: Deploying daemon rgw.smpl.smithi130.wwebfk on smithi130 2024-06-18T02:03:24.421 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:24 smithi007 ceph-mon[25091]: pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 74 MiB used, 715 GiB / 715 GiB avail; 22 KiB/s rd, 357 B/s wr, 32 op/s 2024-06-18T02:03:24.421 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:24 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:24.421 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:24 smithi007 ceph-mon[25091]: from='client.14817 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "foo", "api_user": "u", "api_password": "p", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:03:24.421 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:24 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi130.wwebfk", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-06-18T02:03:24.421 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:24 smithi007 ceph-mon[25091]: Saving service iscsi.foo spec with placement count:1 2024-06-18T02:03:24.421 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:24 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi130.wwebfk", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-06-18T02:03:24.421 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:24 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:24.421 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:24 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:24.421 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:24 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:03:24.421 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:24 smithi007 ceph-mon[25091]: Deploying daemon rgw.smpl.smithi130.wwebfk on smithi130 2024-06-18T02:03:24.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:24 smithi130 ceph-mon[26123]: pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 74 MiB used, 715 GiB / 715 GiB avail; 22 KiB/s rd, 357 B/s wr, 32 op/s 2024-06-18T02:03:24.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:24 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:24.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:24 smithi130 ceph-mon[26123]: from='client.14817 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "foo", "api_user": "u", "api_password": "p", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:03:24.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:24 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi130.wwebfk", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-06-18T02:03:24.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:24 smithi130 ceph-mon[26123]: Saving service iscsi.foo spec with placement count:1 2024-06-18T02:03:24.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:24 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi130.wwebfk", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-06-18T02:03:24.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:24 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:24.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:24 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:24.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:24 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:03:24.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:24 smithi130 ceph-mon[26123]: Deploying daemon rgw.smpl.smithi130.wwebfk on smithi130 2024-06-18T02:03:26.596 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:26 smithi130 ceph-mon[26123]: pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 92 MiB used, 715 GiB / 715 GiB avail; 145 KiB/s rd, 434 B/s wr, 221 op/s 2024-06-18T02:03:26.596 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:26 smithi130 ceph-mon[26123]: osdmap e80: 8 total, 8 up, 8 in 2024-06-18T02:03:26.596 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:26 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:26.597 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:26 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:03:26.597 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:26 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:03:26.597 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:26 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:26.597 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:26 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:03:26.597 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:26 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:03:26.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:26 smithi007 ceph-mon[25091]: pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 92 MiB used, 715 GiB / 715 GiB avail; 145 KiB/s rd, 434 B/s wr, 221 op/s 2024-06-18T02:03:26.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:26 smithi007 ceph-mon[25091]: osdmap e80: 8 total, 8 up, 8 in 2024-06-18T02:03:26.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:26 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:26.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:26 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:03:26.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:26 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:03:26.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:26 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:26.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:26 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:03:26.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:26 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:03:26.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:26 smithi007 ceph-mon[29879]: pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 92 MiB used, 715 GiB / 715 GiB avail; 145 KiB/s rd, 434 B/s wr, 221 op/s 2024-06-18T02:03:26.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:26 smithi007 ceph-mon[29879]: osdmap e80: 8 total, 8 up, 8 in 2024-06-18T02:03:26.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:26 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:26.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:26 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:03:26.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:26 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:03:26.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:26 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:26.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:26 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:03:26.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:26 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:03:27.614 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:27 smithi130 ceph-mon[26123]: Checking dashboard <-> RGW credentials 2024-06-18T02:03:27.614 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:27 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:03:27.614 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:27 smithi130 ceph-mon[26123]: Checking dashboard <-> RGW credentials 2024-06-18T02:03:27.614 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:27 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:27.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:27 smithi007 ceph-mon[25091]: Checking dashboard <-> RGW credentials 2024-06-18T02:03:27.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:27 smithi007 ceph-mon[25091]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:03:27.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:27 smithi007 ceph-mon[25091]: Checking dashboard <-> RGW credentials 2024-06-18T02:03:27.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:27 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:27.628 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:27 smithi007 ceph-mon[29879]: Checking dashboard <-> RGW credentials 2024-06-18T02:03:27.628 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:27 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:03:27.628 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:27 smithi007 ceph-mon[29879]: Checking dashboard <-> RGW credentials 2024-06-18T02:03:27.628 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:27 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:28.387 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:28 smithi007 ceph-mon[25091]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:03:28.387 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:28 smithi007 ceph-mon[25091]: pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 92 MiB used, 715 GiB / 715 GiB avail; 128 KiB/s rd, 383 B/s wr, 195 op/s 2024-06-18T02:03:28.387 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:28 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:03:28.387 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:28 smithi007 ceph-mon[29879]: pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 92 MiB used, 715 GiB / 715 GiB avail; 128 KiB/s rd, 383 B/s wr, 195 op/s 2024-06-18T02:03:28.636 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:28 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:03:28.636 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:28 smithi130 ceph-mon[26123]: pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 92 MiB used, 715 GiB / 715 GiB avail; 128 KiB/s rd, 383 B/s wr, 195 op/s 2024-06-18T02:03:29.524 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:03:29 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.130 - - [18/Jun/2024:02:03:29] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:03:29.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:29 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:29.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:29 smithi007 ceph-mon[29879]: pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 92 MiB used, 715 GiB / 715 GiB avail; 105 KiB/s rd, 316 B/s wr, 161 op/s 2024-06-18T02:03:29.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:29 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:29.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:29 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:29.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:29 smithi007 ceph-mon[25091]: pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 92 MiB used, 715 GiB / 715 GiB avail; 105 KiB/s rd, 316 B/s wr, 161 op/s 2024-06-18T02:03:29.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:29 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:30.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:29 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:30.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:29 smithi130 ceph-mon[26123]: pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 92 MiB used, 715 GiB / 715 GiB avail; 105 KiB/s rd, 316 B/s wr, 161 op/s 2024-06-18T02:03:30.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:29 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:30.267 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:03:30 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:03:30] "GET /metrics HTTP/1.1" 200 210753 "" "Prometheus/2.33.4" 2024-06-18T02:03:30.603 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:03:30 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.7 - - [18/Jun/2024:02:03:30] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:03:31.633 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:31 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:31.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:31 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:31.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:31 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:32.369 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:03:31 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.130 - - [18/Jun/2024:02:03:31] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:03:32.681 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:03:32 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.7 - - [18/Jun/2024:02:03:32] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:03:32.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:32 smithi007 ceph-mon[25091]: pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 203 KiB/s rd, 204 B/s wr, 307 op/s 2024-06-18T02:03:32.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:32 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:32.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:32 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:32.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:32 smithi007 ceph-mon[29879]: pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 203 KiB/s rd, 204 B/s wr, 307 op/s 2024-06-18T02:03:32.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:32 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:32.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:32 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:32.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:32 smithi130 ceph-mon[26123]: pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 203 KiB/s rd, 204 B/s wr, 307 op/s 2024-06-18T02:03:32.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:32 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:32.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:32 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:33.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:03:33 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:03:33] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-06-18T02:03:33.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:33 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:33.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:33 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:33.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:33 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:03:33.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:33 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:03:33.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:33 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:33.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:33 smithi007 ceph-mon[25091]: Checking pool "foo" exists for service iscsi.foo 2024-06-18T02:03:33.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:33 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi007.xvdrwd", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-06-18T02:03:33.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:33 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi007.xvdrwd", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-06-18T02:03:33.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:33 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:03:33.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:33 smithi007 ceph-mon[25091]: Deploying daemon iscsi.foo.smithi007.xvdrwd on smithi007 2024-06-18T02:03:33.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:33 smithi007 ceph-mon[25091]: pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 203 KiB/s rd, 204 B/s wr, 307 op/s 2024-06-18T02:03:33.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:33 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:33.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:33 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:33.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:33 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:03:33.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:33 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:03:33.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:33 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:33.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:33 smithi007 ceph-mon[29879]: Checking pool "foo" exists for service iscsi.foo 2024-06-18T02:03:33.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:33 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi007.xvdrwd", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-06-18T02:03:33.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:33 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi007.xvdrwd", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-06-18T02:03:33.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:33 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:03:33.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:33 smithi007 ceph-mon[29879]: Deploying daemon iscsi.foo.smithi007.xvdrwd on smithi007 2024-06-18T02:03:33.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:33 smithi007 ceph-mon[29879]: pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 203 KiB/s rd, 204 B/s wr, 307 op/s 2024-06-18T02:03:34.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:33 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:34.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:33 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:34.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:33 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:03:34.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:33 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:03:34.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:33 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:34.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:33 smithi130 ceph-mon[26123]: Checking pool "foo" exists for service iscsi.foo 2024-06-18T02:03:34.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:33 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi007.xvdrwd", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-06-18T02:03:34.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:33 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi007.xvdrwd", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-06-18T02:03:34.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:33 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:03:34.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:33 smithi130 ceph-mon[26123]: Deploying daemon iscsi.foo.smithi007.xvdrwd on smithi007 2024-06-18T02:03:34.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:33 smithi130 ceph-mon[26123]: pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 203 KiB/s rd, 204 B/s wr, 307 op/s 2024-06-18T02:03:35.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:35 smithi007 ceph-mon[29879]: mgrmap e21: y(active, since 2m), standbys: x 2024-06-18T02:03:35.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:35 smithi007 ceph-mon[29879]: pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 124 KiB/s rd, 102 B/s wr, 185 op/s 2024-06-18T02:03:35.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:35 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:35.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:35 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:03:35.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:35 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:03:35.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:35 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:35.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:35 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-06-18T02:03:35.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:35 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-06-18T02:03:35.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:35 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:35.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:35 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi007"}]: dispatch 2024-06-18T02:03:35.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:35 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:35.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:35 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:03:35.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:35 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:03:35.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:35 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:35.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:35 smithi007 ceph-mon[25091]: mgrmap e21: y(active, since 2m), standbys: x 2024-06-18T02:03:35.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:35 smithi007 ceph-mon[25091]: pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 124 KiB/s rd, 102 B/s wr, 185 op/s 2024-06-18T02:03:35.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:35 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:35.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:35 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:03:35.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:35 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:03:35.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:35 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:35.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:35 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-06-18T02:03:35.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:35 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-06-18T02:03:35.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:35 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:35.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:35 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi007"}]: dispatch 2024-06-18T02:03:35.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:35 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:35.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:35 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:03:35.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:35 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:03:35.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:35 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:36.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:35 smithi130 ceph-mon[26123]: mgrmap e21: y(active, since 2m), standbys: x 2024-06-18T02:03:36.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:35 smithi130 ceph-mon[26123]: pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 124 KiB/s rd, 102 B/s wr, 185 op/s 2024-06-18T02:03:36.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:35 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:36.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:35 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:03:36.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:35 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:03:36.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:35 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:36.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:35 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-06-18T02:03:36.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:35 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-06-18T02:03:36.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:35 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:36.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:35 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi007"}]: dispatch 2024-06-18T02:03:36.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:35 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:36.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:35 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:03:36.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:35 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:03:36.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:35 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:36.818 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:36 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:03:36.818 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:36 smithi007 ceph-mon[29879]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-06-18T02:03:36.818 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:36 smithi007 ceph-mon[29879]: Adding iSCSI gateway http://:@172.21.15.7:5000 to Dashboard 2024-06-18T02:03:36.818 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:36 smithi007 ceph-mon[29879]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-06-18T02:03:36.818 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:36 smithi007 ceph-mon[29879]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi007"}]: dispatch 2024-06-18T02:03:36.818 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:36 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:03:36.819 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:36 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/758221146' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-18T02:03:36.819 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:36 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/248344821' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/695930575"}]: dispatch 2024-06-18T02:03:36.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:36 smithi007 ceph-mon[25091]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:03:36.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:36 smithi007 ceph-mon[25091]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-06-18T02:03:36.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:36 smithi007 ceph-mon[25091]: Adding iSCSI gateway http://:@172.21.15.7:5000 to Dashboard 2024-06-18T02:03:36.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:36 smithi007 ceph-mon[25091]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-06-18T02:03:36.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:36 smithi007 ceph-mon[25091]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi007"}]: dispatch 2024-06-18T02:03:36.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:36 smithi007 ceph-mon[25091]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:03:36.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:36 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/758221146' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-18T02:03:36.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:36 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/248344821' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/695930575"}]: dispatch 2024-06-18T02:03:37.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:36 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:03:37.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:36 smithi130 ceph-mon[26123]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-06-18T02:03:37.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:36 smithi130 ceph-mon[26123]: Adding iSCSI gateway http://:@172.21.15.7:5000 to Dashboard 2024-06-18T02:03:37.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:36 smithi130 ceph-mon[26123]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-06-18T02:03:37.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:36 smithi130 ceph-mon[26123]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi007"}]: dispatch 2024-06-18T02:03:37.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:36 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:03:37.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:36 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/758221146' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-18T02:03:37.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:36 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/248344821' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/695930575"}]: dispatch 2024-06-18T02:03:37.809 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:37 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/248344821' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/695930575"}]': finished 2024-06-18T02:03:37.809 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:37 smithi007 ceph-mon[25091]: osdmap e81: 8 total, 8 up, 8 in 2024-06-18T02:03:37.809 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:37 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/1706136229' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/1860870067"}]: dispatch 2024-06-18T02:03:37.809 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:37 smithi007 ceph-mon[25091]: pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 124 KiB/s rd, 102 B/s wr, 185 op/s 2024-06-18T02:03:37.810 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:37 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/248344821' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/695930575"}]': finished 2024-06-18T02:03:37.810 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:37 smithi007 ceph-mon[29879]: osdmap e81: 8 total, 8 up, 8 in 2024-06-18T02:03:37.810 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:37 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/1706136229' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/1860870067"}]: dispatch 2024-06-18T02:03:37.810 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:37 smithi007 ceph-mon[29879]: pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 124 KiB/s rd, 102 B/s wr, 185 op/s 2024-06-18T02:03:38.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:37 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/248344821' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/695930575"}]': finished 2024-06-18T02:03:38.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:37 smithi130 ceph-mon[26123]: osdmap e81: 8 total, 8 up, 8 in 2024-06-18T02:03:38.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:37 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/1706136229' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/1860870067"}]: dispatch 2024-06-18T02:03:38.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:37 smithi130 ceph-mon[26123]: pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 124 KiB/s rd, 102 B/s wr, 185 op/s 2024-06-18T02:03:39.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:38 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/1706136229' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/1860870067"}]': finished 2024-06-18T02:03:39.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:38 smithi130 ceph-mon[26123]: osdmap e82: 8 total, 8 up, 8 in 2024-06-18T02:03:39.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:38 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/503123625' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/1865804911"}]: dispatch 2024-06-18T02:03:39.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:38 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:39.044 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:38 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/1706136229' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/1860870067"}]': finished 2024-06-18T02:03:39.044 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:38 smithi007 ceph-mon[25091]: osdmap e82: 8 total, 8 up, 8 in 2024-06-18T02:03:39.044 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:38 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/503123625' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/1865804911"}]: dispatch 2024-06-18T02:03:39.044 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:38 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:39.044 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:38 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/1706136229' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/1860870067"}]': finished 2024-06-18T02:03:39.045 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:38 smithi007 ceph-mon[29879]: osdmap e82: 8 total, 8 up, 8 in 2024-06-18T02:03:39.045 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:38 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/503123625' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/1865804911"}]: dispatch 2024-06-18T02:03:39.045 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:38 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:39.681 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:03:39 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.7 - - [18/Jun/2024:02:03:39] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:03:40.010 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:39 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/503123625' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/1865804911"}]': finished 2024-06-18T02:03:40.011 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:39 smithi007 ceph-mon[25091]: osdmap e83: 8 total, 8 up, 8 in 2024-06-18T02:03:40.011 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:39 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/165114886' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6801/3838966942"}]: dispatch 2024-06-18T02:03:40.011 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:39 smithi007 ceph-mon[25091]: pgmap v108: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 25 op/s 2024-06-18T02:03:40.011 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:39 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:40.011 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:39 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/503123625' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/1865804911"}]': finished 2024-06-18T02:03:40.011 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:39 smithi007 ceph-mon[29879]: osdmap e83: 8 total, 8 up, 8 in 2024-06-18T02:03:40.011 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:39 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/165114886' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6801/3838966942"}]: dispatch 2024-06-18T02:03:40.011 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:39 smithi007 ceph-mon[29879]: pgmap v108: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 25 op/s 2024-06-18T02:03:40.011 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:39 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:40.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:39 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/503123625' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/1865804911"}]': finished 2024-06-18T02:03:40.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:39 smithi130 ceph-mon[26123]: osdmap e83: 8 total, 8 up, 8 in 2024-06-18T02:03:40.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:39 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/165114886' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6801/3838966942"}]: dispatch 2024-06-18T02:03:40.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:39 smithi130 ceph-mon[26123]: pgmap v108: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 25 op/s 2024-06-18T02:03:40.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:39 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:40.303 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:03:40 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:03:40] "GET /metrics HTTP/1.1" 200 214985 "" "Prometheus/2.33.4" 2024-06-18T02:03:41.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:40 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/165114886' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6801/3838966942"}]': finished 2024-06-18T02:03:41.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:40 smithi130 ceph-mon[26123]: osdmap e84: 8 total, 8 up, 8 in 2024-06-18T02:03:41.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:40 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/1153581483' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/586006455"}]: dispatch 2024-06-18T02:03:41.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:40 smithi130 ceph-mon[26123]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/586006455"}]: dispatch 2024-06-18T02:03:41.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:40 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/165114886' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6801/3838966942"}]': finished 2024-06-18T02:03:41.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:40 smithi007 ceph-mon[25091]: osdmap e84: 8 total, 8 up, 8 in 2024-06-18T02:03:41.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:40 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/1153581483' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/586006455"}]: dispatch 2024-06-18T02:03:41.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:40 smithi007 ceph-mon[25091]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/586006455"}]: dispatch 2024-06-18T02:03:41.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:40 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/165114886' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6801/3838966942"}]': finished 2024-06-18T02:03:41.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:40 smithi007 ceph-mon[29879]: osdmap e84: 8 total, 8 up, 8 in 2024-06-18T02:03:41.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:40 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/1153581483' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/586006455"}]: dispatch 2024-06-18T02:03:41.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:40 smithi007 ceph-mon[29879]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/586006455"}]: dispatch 2024-06-18T02:03:41.931 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:41 smithi007 ceph-mon[29879]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/586006455"}]': finished 2024-06-18T02:03:41.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:41 smithi007 ceph-mon[29879]: osdmap e85: 8 total, 8 up, 8 in 2024-06-18T02:03:41.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:41 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/1779385172' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6801/4064257282"}]: dispatch 2024-06-18T02:03:41.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:41 smithi007 ceph-mon[29879]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6801/4064257282"}]: dispatch 2024-06-18T02:03:41.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:41 smithi007 ceph-mon[29879]: pgmap v111: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 255 B/s wr, 3 op/s 2024-06-18T02:03:41.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:41 smithi007 ceph-mon[25091]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/586006455"}]': finished 2024-06-18T02:03:41.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:41 smithi007 ceph-mon[25091]: osdmap e85: 8 total, 8 up, 8 in 2024-06-18T02:03:41.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:41 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/1779385172' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6801/4064257282"}]: dispatch 2024-06-18T02:03:41.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:41 smithi007 ceph-mon[25091]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6801/4064257282"}]: dispatch 2024-06-18T02:03:41.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:41 smithi007 ceph-mon[25091]: pgmap v111: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 255 B/s wr, 3 op/s 2024-06-18T02:03:42.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:41 smithi130 ceph-mon[26123]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/586006455"}]': finished 2024-06-18T02:03:42.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:41 smithi130 ceph-mon[26123]: osdmap e85: 8 total, 8 up, 8 in 2024-06-18T02:03:42.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:41 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/1779385172' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6801/4064257282"}]: dispatch 2024-06-18T02:03:42.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:41 smithi130 ceph-mon[26123]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6801/4064257282"}]: dispatch 2024-06-18T02:03:42.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:41 smithi130 ceph-mon[26123]: pgmap v111: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 255 B/s wr, 3 op/s 2024-06-18T02:03:42.432 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:03:42 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.7 - - [18/Jun/2024:02:03:42] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:03:43.041 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:42 smithi130 ceph-mon[26123]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6801/4064257282"}]': finished 2024-06-18T02:03:43.041 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:42 smithi130 ceph-mon[26123]: osdmap e86: 8 total, 8 up, 8 in 2024-06-18T02:03:43.041 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:42 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:43.041 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:42 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:43.041 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:42 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/2756126563' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/2859032966"}]: dispatch 2024-06-18T02:03:43.041 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:42 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:03:43.041 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:42 smithi130 ceph-mon[26123]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/2859032966"}]: dispatch 2024-06-18T02:03:43.042 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:42 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:03:43.042 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:42 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:43.078 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:42 smithi007 ceph-mon[25091]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6801/4064257282"}]': finished 2024-06-18T02:03:43.078 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:42 smithi007 ceph-mon[25091]: osdmap e86: 8 total, 8 up, 8 in 2024-06-18T02:03:43.078 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:42 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:43.078 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:42 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:43.078 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:42 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/2756126563' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/2859032966"}]: dispatch 2024-06-18T02:03:43.078 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:42 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:03:43.079 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:42 smithi007 ceph-mon[25091]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/2859032966"}]: dispatch 2024-06-18T02:03:43.079 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:42 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:03:43.079 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:42 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:43.079 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:42 smithi007 ceph-mon[29879]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6801/4064257282"}]': finished 2024-06-18T02:03:43.079 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:42 smithi007 ceph-mon[29879]: osdmap e86: 8 total, 8 up, 8 in 2024-06-18T02:03:43.079 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:42 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:43.079 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:42 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:43.079 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:42 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/2756126563' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/2859032966"}]: dispatch 2024-06-18T02:03:43.079 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:42 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:03:43.079 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:42 smithi007 ceph-mon[29879]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/2859032966"}]: dispatch 2024-06-18T02:03:43.079 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:42 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:03:43.080 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:42 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:43.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:03:43 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:03:43] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-06-18T02:03:43.931 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:03:43 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=warn ts=2024-06-18T02:03:43.521Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.7:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.7 because it doesn't contain any IP SANs" 2024-06-18T02:03:43.932 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:03:43 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=warn ts=2024-06-18T02:03:43.521Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.130:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.130 because it doesn't contain any IP SANs" 2024-06-18T02:03:44.431 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:44 smithi007 ceph-mon[29879]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/2859032966"}]': finished 2024-06-18T02:03:44.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:44 smithi007 ceph-mon[29879]: osdmap e87: 8 total, 8 up, 8 in 2024-06-18T02:03:44.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:44 smithi007 ceph-mon[29879]: pgmap v114: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 255 B/s wr, 3 op/s 2024-06-18T02:03:44.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:44 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/242695368' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6800/4064257282"}]: dispatch 2024-06-18T02:03:44.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:44 smithi007 ceph-mon[29879]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6800/4064257282"}]: dispatch 2024-06-18T02:03:44.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:44 smithi007 ceph-mon[25091]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/2859032966"}]': finished 2024-06-18T02:03:44.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:44 smithi007 ceph-mon[25091]: osdmap e87: 8 total, 8 up, 8 in 2024-06-18T02:03:44.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:44 smithi007 ceph-mon[25091]: pgmap v114: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 255 B/s wr, 3 op/s 2024-06-18T02:03:44.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:44 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/242695368' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6800/4064257282"}]: dispatch 2024-06-18T02:03:44.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:44 smithi007 ceph-mon[25091]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6800/4064257282"}]: dispatch 2024-06-18T02:03:44.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:44 smithi130 ceph-mon[26123]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/2859032966"}]': finished 2024-06-18T02:03:44.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:44 smithi130 ceph-mon[26123]: osdmap e87: 8 total, 8 up, 8 in 2024-06-18T02:03:44.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:44 smithi130 ceph-mon[26123]: pgmap v114: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 255 B/s wr, 3 op/s 2024-06-18T02:03:44.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:44 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/242695368' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6800/4064257282"}]: dispatch 2024-06-18T02:03:44.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:44 smithi130 ceph-mon[26123]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6800/4064257282"}]: dispatch 2024-06-18T02:03:45.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:45 smithi007 ceph-mon[25091]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6800/4064257282"}]': finished 2024-06-18T02:03:45.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:45 smithi007 ceph-mon[25091]: osdmap e88: 8 total, 8 up, 8 in 2024-06-18T02:03:45.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:45 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/1528911463' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/2197821776"}]: dispatch 2024-06-18T02:03:45.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:45 smithi007 ceph-mon[29879]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6800/4064257282"}]': finished 2024-06-18T02:03:45.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:45 smithi007 ceph-mon[29879]: osdmap e88: 8 total, 8 up, 8 in 2024-06-18T02:03:45.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:45 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/1528911463' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/2197821776"}]: dispatch 2024-06-18T02:03:45.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:45 smithi130 ceph-mon[26123]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6800/4064257282"}]': finished 2024-06-18T02:03:45.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:45 smithi130 ceph-mon[26123]: osdmap e88: 8 total, 8 up, 8 in 2024-06-18T02:03:45.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:45 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/1528911463' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/2197821776"}]: dispatch 2024-06-18T02:03:46.231 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:46 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/1528911463' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/2197821776"}]': finished 2024-06-18T02:03:46.231 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:46 smithi130 ceph-mon[26123]: osdmap e89: 8 total, 8 up, 8 in 2024-06-18T02:03:46.231 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:46 smithi130 ceph-mon[26123]: pgmap v117: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:03:46.231 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:46 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/1658184664' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/919215153"}]: dispatch 2024-06-18T02:03:46.231 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:46 smithi130 ceph-mon[26123]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/919215153"}]: dispatch 2024-06-18T02:03:46.431 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:03:46 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.130 - - [18/Jun/2024:02:03:46] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:03:46.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:46 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/1528911463' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/2197821776"}]': finished 2024-06-18T02:03:46.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:46 smithi007 ceph-mon[29879]: osdmap e89: 8 total, 8 up, 8 in 2024-06-18T02:03:46.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:46 smithi007 ceph-mon[29879]: pgmap v117: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:03:46.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:46 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/1658184664' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/919215153"}]: dispatch 2024-06-18T02:03:46.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:46 smithi007 ceph-mon[29879]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/919215153"}]: dispatch 2024-06-18T02:03:46.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:46 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/1528911463' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/2197821776"}]': finished 2024-06-18T02:03:46.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:46 smithi007 ceph-mon[25091]: osdmap e89: 8 total, 8 up, 8 in 2024-06-18T02:03:46.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:46 smithi007 ceph-mon[25091]: pgmap v117: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:03:46.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:46 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/1658184664' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/919215153"}]: dispatch 2024-06-18T02:03:46.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:46 smithi007 ceph-mon[25091]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/919215153"}]: dispatch 2024-06-18T02:03:47.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:47 smithi130 ceph-mon[26123]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:03:47.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:47 smithi130 ceph-mon[26123]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/919215153"}]': finished 2024-06-18T02:03:47.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:47 smithi130 ceph-mon[26123]: osdmap e90: 8 total, 8 up, 8 in 2024-06-18T02:03:47.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:47 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:47.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:47 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:47.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:47 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/432666999' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/1098197333"}]: dispatch 2024-06-18T02:03:47.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:47 smithi130 ceph-mon[26123]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/1098197333"}]: dispatch 2024-06-18T02:03:47.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:47 smithi007 ceph-mon[25091]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:03:47.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:47 smithi007 ceph-mon[25091]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/919215153"}]': finished 2024-06-18T02:03:47.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:47 smithi007 ceph-mon[25091]: osdmap e90: 8 total, 8 up, 8 in 2024-06-18T02:03:47.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:47 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:47.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:47 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:47.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:47 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/432666999' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/1098197333"}]: dispatch 2024-06-18T02:03:47.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:47 smithi007 ceph-mon[25091]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/1098197333"}]: dispatch 2024-06-18T02:03:47.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:47 smithi007 ceph-mon[29879]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:03:47.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:47 smithi007 ceph-mon[29879]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/919215153"}]': finished 2024-06-18T02:03:47.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:47 smithi007 ceph-mon[29879]: osdmap e90: 8 total, 8 up, 8 in 2024-06-18T02:03:47.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:47 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:47.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:47 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:47.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:47 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/432666999' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/1098197333"}]: dispatch 2024-06-18T02:03:47.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:47 smithi007 ceph-mon[29879]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/1098197333"}]: dispatch 2024-06-18T02:03:48.440 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:48 smithi130 ceph-mon[26123]: pgmap v119: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:03:48.440 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:48 smithi130 ceph-mon[26123]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/1098197333"}]': finished 2024-06-18T02:03:48.441 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:48 smithi130 ceph-mon[26123]: osdmap e91: 8 total, 8 up, 8 in 2024-06-18T02:03:48.441 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:48 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/983542058' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/3239039203"}]: dispatch 2024-06-18T02:03:48.441 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:48 smithi130 ceph-mon[26123]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/3239039203"}]: dispatch 2024-06-18T02:03:48.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:48 smithi007 ceph-mon[25091]: pgmap v119: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:03:48.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:48 smithi007 ceph-mon[25091]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/1098197333"}]': finished 2024-06-18T02:03:48.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:48 smithi007 ceph-mon[25091]: osdmap e91: 8 total, 8 up, 8 in 2024-06-18T02:03:48.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:48 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/983542058' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/3239039203"}]: dispatch 2024-06-18T02:03:48.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:48 smithi007 ceph-mon[25091]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/3239039203"}]: dispatch 2024-06-18T02:03:48.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:48 smithi007 ceph-mon[29879]: pgmap v119: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:03:48.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:48 smithi007 ceph-mon[29879]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/1098197333"}]': finished 2024-06-18T02:03:48.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:48 smithi007 ceph-mon[29879]: osdmap e91: 8 total, 8 up, 8 in 2024-06-18T02:03:48.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:48 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/983542058' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/3239039203"}]: dispatch 2024-06-18T02:03:48.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:48 smithi007 ceph-mon[29879]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/3239039203"}]: dispatch 2024-06-18T02:03:49.508 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:49 smithi130 ceph-mon[26123]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/3239039203"}]': finished 2024-06-18T02:03:49.508 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:49 smithi130 ceph-mon[26123]: osdmap e92: 8 total, 8 up, 8 in 2024-06-18T02:03:49.508 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:49 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/2151324274' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/3183920300"}]: dispatch 2024-06-18T02:03:49.508 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:49 smithi130 ceph-mon[26123]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/3183920300"}]: dispatch 2024-06-18T02:03:49.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:49 smithi007 ceph-mon[29879]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/3239039203"}]': finished 2024-06-18T02:03:49.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:49 smithi007 ceph-mon[29879]: osdmap e92: 8 total, 8 up, 8 in 2024-06-18T02:03:49.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:49 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/2151324274' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/3183920300"}]: dispatch 2024-06-18T02:03:49.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:49 smithi007 ceph-mon[29879]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/3183920300"}]: dispatch 2024-06-18T02:03:49.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:49 smithi007 ceph-mon[25091]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/3239039203"}]': finished 2024-06-18T02:03:49.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:49 smithi007 ceph-mon[25091]: osdmap e92: 8 total, 8 up, 8 in 2024-06-18T02:03:49.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:49 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/2151324274' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/3183920300"}]: dispatch 2024-06-18T02:03:49.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:49 smithi007 ceph-mon[25091]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/3183920300"}]: dispatch 2024-06-18T02:03:50.263 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:50 smithi007 ceph-mon[25091]: pgmap v122: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:03:50.263 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:50 smithi007 ceph-mon[25091]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/3183920300"}]': finished 2024-06-18T02:03:50.263 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:50 smithi007 ceph-mon[25091]: osdmap e93: 8 total, 8 up, 8 in 2024-06-18T02:03:50.263 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:50 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/2272524077' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6800/81675152"}]: dispatch 2024-06-18T02:03:50.263 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:50 smithi007 ceph-mon[29879]: pgmap v122: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:03:50.264 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:50 smithi007 ceph-mon[29879]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/3183920300"}]': finished 2024-06-18T02:03:50.264 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:50 smithi007 ceph-mon[29879]: osdmap e93: 8 total, 8 up, 8 in 2024-06-18T02:03:50.264 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:50 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/2272524077' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6800/81675152"}]: dispatch 2024-06-18T02:03:50.264 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:03:50 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:03:50] "GET /metrics HTTP/1.1" 200 214985 "" "Prometheus/2.33.4" 2024-06-18T02:03:50.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:50 smithi130 ceph-mon[26123]: pgmap v122: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:03:50.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:50 smithi130 ceph-mon[26123]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/3183920300"}]': finished 2024-06-18T02:03:50.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:50 smithi130 ceph-mon[26123]: osdmap e93: 8 total, 8 up, 8 in 2024-06-18T02:03:50.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:50 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/2272524077' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6800/81675152"}]: dispatch 2024-06-18T02:03:51.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:51 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/2272524077' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6800/81675152"}]': finished 2024-06-18T02:03:51.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:51 smithi130 ceph-mon[26123]: osdmap e94: 8 total, 8 up, 8 in 2024-06-18T02:03:51.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:51 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/582378510' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6800/3838966942"}]: dispatch 2024-06-18T02:03:51.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:51 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/2272524077' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6800/81675152"}]': finished 2024-06-18T02:03:51.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:51 smithi007 ceph-mon[25091]: osdmap e94: 8 total, 8 up, 8 in 2024-06-18T02:03:51.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:51 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/582378510' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6800/3838966942"}]: dispatch 2024-06-18T02:03:51.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:51 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/2272524077' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6800/81675152"}]': finished 2024-06-18T02:03:51.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:51 smithi007 ceph-mon[29879]: osdmap e94: 8 total, 8 up, 8 in 2024-06-18T02:03:51.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:51 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/582378510' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6800/3838966942"}]: dispatch 2024-06-18T02:03:52.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:52 smithi130 ceph-mon[26123]: pgmap v125: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:03:52.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:52 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/582378510' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6800/3838966942"}]': finished 2024-06-18T02:03:52.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:52 smithi130 ceph-mon[26123]: osdmap e95: 8 total, 8 up, 8 in 2024-06-18T02:03:52.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:52 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/1159781767' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6801/81675152"}]: dispatch 2024-06-18T02:03:52.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:52 smithi130 ceph-mon[26123]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6801/81675152"}]: dispatch 2024-06-18T02:03:52.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:52 smithi007 ceph-mon[25091]: pgmap v125: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:03:52.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:52 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/582378510' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6800/3838966942"}]': finished 2024-06-18T02:03:52.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:52 smithi007 ceph-mon[25091]: osdmap e95: 8 total, 8 up, 8 in 2024-06-18T02:03:52.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:52 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/1159781767' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6801/81675152"}]: dispatch 2024-06-18T02:03:52.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:52 smithi007 ceph-mon[25091]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6801/81675152"}]: dispatch 2024-06-18T02:03:52.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:52 smithi007 ceph-mon[29879]: pgmap v125: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:03:52.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:52 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/582378510' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6800/3838966942"}]': finished 2024-06-18T02:03:52.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:52 smithi007 ceph-mon[29879]: osdmap e95: 8 total, 8 up, 8 in 2024-06-18T02:03:52.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:52 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/1159781767' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6801/81675152"}]: dispatch 2024-06-18T02:03:52.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:52 smithi007 ceph-mon[29879]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6801/81675152"}]: dispatch 2024-06-18T02:03:53.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:53 smithi130 ceph-mon[26123]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6801/81675152"}]': finished 2024-06-18T02:03:53.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:53 smithi130 ceph-mon[26123]: osdmap e96: 8 total, 8 up, 8 in 2024-06-18T02:03:53.294 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:03:53 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:03:53] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-06-18T02:03:53.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:53 smithi007 ceph-mon[25091]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6801/81675152"}]': finished 2024-06-18T02:03:53.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:53 smithi007 ceph-mon[25091]: osdmap e96: 8 total, 8 up, 8 in 2024-06-18T02:03:53.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:53 smithi007 ceph-mon[29879]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6801/81675152"}]': finished 2024-06-18T02:03:53.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:53 smithi007 ceph-mon[29879]: osdmap e96: 8 total, 8 up, 8 in 2024-06-18T02:03:53.682 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:03:53 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=error ts=2024-06-18T02:03:53.507Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=6 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.130:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.130 because it doesn't contain any IP SANs; ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://172.21.15.7:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.7 because it doesn't contain any IP SANs" 2024-06-18T02:03:53.682 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:03:53 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=warn ts=2024-06-18T02:03:53.509Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.7:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.7 because it doesn't contain any IP SANs" 2024-06-18T02:03:53.683 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:03:53 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=warn ts=2024-06-18T02:03:53.510Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.130:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.130 because it doesn't contain any IP SANs" 2024-06-18T02:03:54.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:54 smithi130 ceph-mon[26123]: pgmap v128: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:03:54.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:54 smithi007 ceph-mon[25091]: pgmap v128: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:03:54.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:54 smithi007 ceph-mon[29879]: pgmap v128: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:03:56.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:56 smithi130 ceph-mon[26123]: pgmap v129: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-06-18T02:03:56.554 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:56 smithi007 ceph-mon[25091]: pgmap v129: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-06-18T02:03:56.555 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:56 smithi007 ceph-mon[29879]: pgmap v129: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-06-18T02:03:57.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:57 smithi130 ceph-mon[26123]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:03:57.603 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:57 smithi007 ceph-mon[25091]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:03:57.603 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:57 smithi007 ceph-mon[29879]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:03:58.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:58 smithi007 ceph-mon[25091]: pgmap v130: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 745 B/s rd, 0 op/s 2024-06-18T02:03:58.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:58 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:58.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:03:58 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:58.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:58 smithi007 ceph-mon[29879]: pgmap v130: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 745 B/s rd, 0 op/s 2024-06-18T02:03:58.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:58 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:58.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:03:58 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:58.434 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:03:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.7 - - [18/Jun/2024:02:03:58] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:03:58.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:58 smithi130 ceph-mon[26123]: pgmap v130: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 745 B/s rd, 0 op/s 2024-06-18T02:03:58.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:58 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:03:58.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:03:58 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:04:00.278 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:04:00 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:04:00] "GET /metrics HTTP/1.1" 200 215008 "" "Prometheus/2.33.4" 2024-06-18T02:04:00.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:04:00 smithi130 ceph-mon[26123]: pgmap v131: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-06-18T02:04:00.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:04:00 smithi007 ceph-mon[25091]: pgmap v131: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-06-18T02:04:00.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:04:00 smithi007 ceph-mon[29879]: pgmap v131: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-06-18T02:04:02.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:04:01 smithi130 ceph-mon[26123]: pgmap v132: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-06-18T02:04:02.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:04:01 smithi007 ceph-mon[25091]: pgmap v132: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-06-18T02:04:02.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:04:01 smithi007 ceph-mon[29879]: pgmap v132: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-06-18T02:04:03.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:04:03 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:04:03] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-06-18T02:04:03.932 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:04:03 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=error ts=2024-06-18T02:04:03.508Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=6 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.130:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.130 because it doesn't contain any IP SANs; ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://172.21.15.7:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.7 because it doesn't contain any IP SANs" 2024-06-18T02:04:04.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:04:04 smithi007 ceph-mon[25091]: pgmap v133: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 943 B/s rd, 0 op/s 2024-06-18T02:04:04.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:04:04 smithi007 ceph-mon[29879]: pgmap v133: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 943 B/s rd, 0 op/s 2024-06-18T02:04:04.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:04:04 smithi130 ceph-mon[26123]: pgmap v133: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 943 B/s rd, 0 op/s 2024-06-18T02:04:06.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:04:06 smithi007 ceph-mon[25091]: pgmap v134: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:04:06.432 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:04:06 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.130 - - [18/Jun/2024:02:04:06] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:04:06.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:04:06 smithi007 ceph-mon[29879]: pgmap v134: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:04:06.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:04:06 smithi130 ceph-mon[26123]: pgmap v134: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:04:07.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:04:07 smithi007 ceph-mon[25091]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:04:07.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:04:07 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:04:07.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:04:07 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:04:07.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:04:07 smithi007 ceph-mon[29879]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:04:07.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:04:07 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:04:07.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:04:07 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:04:07.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:04:07 smithi130 ceph-mon[26123]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:04:07.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:04:07 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:04:07.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:04:07 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:04:08.572 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:04:08 smithi130 ceph-mon[26123]: pgmap v135: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:04:08.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:04:08 smithi007 ceph-mon[25091]: pgmap v135: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:04:08.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:04:08 smithi007 ceph-mon[29879]: pgmap v135: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:04:09.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:04:09 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-06-18T02:04:09.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:04:09 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-06-18T02:04:09.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:04:09 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-06-18T02:04:09.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:04:09 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-06-18T02:04:09.497 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:04:09 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-06-18T02:04:09.497 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:04:09 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-06-18T02:04:10.181 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:04:10 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:04:10] "GET /metrics HTTP/1.1" 200 214954 "" "Prometheus/2.33.4" 2024-06-18T02:04:10.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:04:10 smithi130 ceph-mon[26123]: pgmap v136: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:04:10.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:04:10 smithi007 ceph-mon[25091]: pgmap v136: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:04:10.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:04:10 smithi007 ceph-mon[29879]: pgmap v136: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:04:12.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:04:11 smithi130 ceph-mon[26123]: pgmap v137: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:04:12.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:04:11 smithi007 ceph-mon[25091]: pgmap v137: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:04:12.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:04:11 smithi007 ceph-mon[29879]: pgmap v137: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:04:13.294 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:04:13 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:04:13] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-06-18T02:04:14.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:04:14 smithi007 ceph-mon[25091]: pgmap v138: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:04:14.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:04:14 smithi007 ceph-mon[29879]: pgmap v138: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:04:14.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:04:14 smithi130 ceph-mon[26123]: pgmap v138: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:04:16.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:04:16 smithi007 ceph-mon[25091]: pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:04:16.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:04:16 smithi007 ceph-mon[29879]: pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:04:16.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:04:16 smithi130 ceph-mon[26123]: pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:04:17.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:04:17 smithi007 ceph-mon[25091]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:04:17.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:04:17 smithi007 ceph-mon[29879]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:04:17.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:04:17 smithi130 ceph-mon[26123]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:04:18.315 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:04:18 smithi007 ceph-mon[25091]: pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:04:18.315 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:04:18 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.7 - - [18/Jun/2024:02:04:18] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:04:18.316 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:04:18 smithi007 ceph-mon[29879]: pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:04:18.445 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:04:18 smithi130 ceph-mon[26123]: pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:04:19.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:04:19 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:04:19.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:04:19 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:04:19.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:04:19 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:04:19.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:04:19 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:04:19.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:04:19 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:04:19.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:04:19 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:04:20.182 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:04:20 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:04:20] "GET /metrics HTTP/1.1" 200 214954 "" "Prometheus/2.33.4" 2024-06-18T02:04:20.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:04:20 smithi130 ceph-mon[26123]: pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:04:20.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:04:20 smithi007 ceph-mon[25091]: pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:04:20.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:04:20 smithi007 ceph-mon[29879]: pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:04:22.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:04:21 smithi130 ceph-mon[26123]: pgmap v142: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:04:22.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:04:21 smithi007 ceph-mon[25091]: pgmap v142: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:04:22.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:04:21 smithi007 ceph-mon[29879]: pgmap v142: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:04:23.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:04:23 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:04:23] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-06-18T02:04:24.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:04:24 smithi007 ceph-mon[25091]: pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:04:24.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:04:24 smithi007 ceph-mon[29879]: pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:04:24.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:04:24 smithi130 ceph-mon[26123]: pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:04:26.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:04:26 smithi007 ceph-mon[25091]: pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:04:26.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:04:26 smithi007 ceph-mon[29879]: pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:04:26.442 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:04:26 smithi130 ceph-mon[26123]: pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:04:26.931 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:04:26 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.130 - - [18/Jun/2024:02:04:26] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:04:27.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:04:27 smithi130 ceph-mon[26123]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:04:27.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:04:27 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:04:27.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:04:27 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:04:27.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:04:27 smithi007 ceph-mon[25091]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:04:27.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:04:27 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:04:27.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:04:27 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:04:27.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:04:27 smithi007 ceph-mon[29879]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:04:27.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:04:27 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:04:27.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:04:27 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:04:28.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:04:28 smithi130 ceph-mon[26123]: pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:04:28.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:04:28 smithi007 ceph-mon[25091]: pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:04:28.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:04:28 smithi007 ceph-mon[29879]: pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:04:29.746 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:04:29 smithi130 ceph-mon[26123]: pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:04:29.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:04:29 smithi007 ceph-mon[25091]: pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:04:29.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:04:29 smithi007 ceph-mon[29879]: pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:04:30.431 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:04:30 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:04:30] "GET /metrics HTTP/1.1" 200 214918 "" "Prometheus/2.33.4" 2024-06-18T02:04:32.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:04:31 smithi130 ceph-mon[26123]: pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:04:32.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:04:31 smithi007 ceph-mon[25091]: pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:04:32.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:04:31 smithi007 ceph-mon[29879]: pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:04:33.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:04:33 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:04:33] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-06-18T02:04:33.932 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:04:33 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=warn ts=2024-06-18T02:04:33.508Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.7:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.7 because it doesn't contain any IP SANs" 2024-06-18T02:04:33.932 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:04:33 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=warn ts=2024-06-18T02:04:33.509Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.130:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.130 because it doesn't contain any IP SANs" 2024-06-18T02:04:34.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:04:34 smithi007 ceph-mon[25091]: pgmap v148: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:04:34.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:04:34 smithi007 ceph-mon[29879]: pgmap v148: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:04:34.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:04:34 smithi130 ceph-mon[26123]: pgmap v148: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:04:36.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:04:36 smithi007 ceph-mon[25091]: pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:04:36.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:04:36 smithi007 ceph-mon[29879]: pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:04:36.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:04:36 smithi130 ceph-mon[26123]: pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:04:37.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:04:37 smithi130 ceph-mon[26123]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:04:37.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:04:37 smithi007 ceph-mon[25091]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:04:37.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:04:37 smithi007 ceph-mon[29879]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:04:38.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:04:38 smithi130 ceph-mon[26123]: pgmap v150: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:04:38.605 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:04:38 smithi007 ceph-mon[25091]: pgmap v150: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:04:38.605 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:04:38 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.7 - - [18/Jun/2024:02:04:38] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:04:38.606 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:04:38 smithi007 ceph-mon[29879]: pgmap v150: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:04:39.681 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:04:39 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:04:39.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:04:39 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:04:39.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:04:39 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:04:39.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:04:39 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:04:39.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:04:39 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:04:39.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:04:39 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:04:40.330 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:04:40 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:04:40] "GET /metrics HTTP/1.1" 200 214923 "" "Prometheus/2.33.4" 2024-06-18T02:04:40.587 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:04:40 smithi007 ceph-mon[25091]: pgmap v151: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:04:40.588 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:04:40 smithi007 ceph-mon[29879]: pgmap v151: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:04:40.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:04:40 smithi130 ceph-mon[26123]: pgmap v151: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:04:42.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:04:41 smithi130 ceph-mon[26123]: pgmap v152: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:04:42.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:04:41 smithi007 ceph-mon[25091]: pgmap v152: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:04:42.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:04:41 smithi007 ceph-mon[29879]: pgmap v152: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:04:43.041 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:04:42 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:04:43.041 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:04:42 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:04:43.041 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:04:42 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:04:43.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:04:42 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:04:43.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:04:42 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:04:43.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:04:42 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:04:43.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:04:42 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:04:43.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:04:42 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:04:43.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:04:42 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:04:43.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:04:43 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:04:43] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-06-18T02:04:43.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:04:43 smithi007 ceph-mon[25091]: pgmap v153: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:04:43.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:04:43 smithi007 ceph-mon[29879]: pgmap v153: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:04:43.932 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:04:43 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=error ts=2024-06-18T02:04:43.508Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://172.21.15.7:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.7 because it doesn't contain any IP SANs; ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://172.21.15.130:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.130 because it doesn't contain any IP SANs" 2024-06-18T02:04:43.932 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:04:43 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=warn ts=2024-06-18T02:04:43.509Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.130:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.130 because it doesn't contain any IP SANs" 2024-06-18T02:04:43.932 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:04:43 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=warn ts=2024-06-18T02:04:43.510Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.7:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.7 because it doesn't contain any IP SANs" 2024-06-18T02:04:44.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:04:43 smithi130 ceph-mon[26123]: pgmap v153: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:04:46.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:04:46 smithi007 ceph-mon[25091]: pgmap v154: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:04:46.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:04:46 smithi007 ceph-mon[29879]: pgmap v154: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:04:46.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:04:46 smithi130 ceph-mon[26123]: pgmap v154: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:04:46.931 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:04:46 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.130 - - [18/Jun/2024:02:04:46] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:04:47.431 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:04:47 smithi007 ceph-mon[29879]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:04:47.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:04:47 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:04:47.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:04:47 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:04:47.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:04:47 smithi007 ceph-mon[25091]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:04:47.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:04:47 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:04:47.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:04:47 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:04:47.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:04:47 smithi130 ceph-mon[26123]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:04:47.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:04:47 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:04:47.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:04:47 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:04:48.445 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:04:48 smithi130 ceph-mon[26123]: pgmap v155: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:04:48.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:04:48 smithi007 ceph-mon[25091]: pgmap v155: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:04:48.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:04:48 smithi007 ceph-mon[29879]: pgmap v155: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:04:50.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:04:50 smithi007 ceph-mon[25091]: pgmap v156: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:04:50.432 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:04:50 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:04:50] "GET /metrics HTTP/1.1" 200 214923 "" "Prometheus/2.33.4" 2024-06-18T02:04:50.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:04:50 smithi007 ceph-mon[29879]: pgmap v156: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:04:50.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:04:50 smithi130 ceph-mon[26123]: pgmap v156: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:04:52.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:04:51 smithi130 ceph-mon[26123]: pgmap v157: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:04:52.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:04:51 smithi007 ceph-mon[25091]: pgmap v157: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:04:52.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:04:51 smithi007 ceph-mon[29879]: pgmap v157: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:04:53.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:04:53 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:04:53] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-06-18T02:04:53.931 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:04:53 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=error ts=2024-06-18T02:04:53.508Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.130:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.130 because it doesn't contain any IP SANs; ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://172.21.15.7:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.7 because it doesn't contain any IP SANs" 2024-06-18T02:04:53.932 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:04:53 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=warn ts=2024-06-18T02:04:53.510Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.7:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.7 because it doesn't contain any IP SANs" 2024-06-18T02:04:53.932 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:04:53 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=warn ts=2024-06-18T02:04:53.510Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.130:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.130 because it doesn't contain any IP SANs" 2024-06-18T02:04:54.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:04:54 smithi130 ceph-mon[26123]: pgmap v158: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:04:54.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:04:54 smithi007 ceph-mon[25091]: pgmap v158: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:04:54.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:04:54 smithi007 ceph-mon[29879]: pgmap v158: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:04:56.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:04:56 smithi130 ceph-mon[26123]: pgmap v159: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:04:56.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:04:56 smithi007 ceph-mon[25091]: pgmap v159: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:04:56.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:04:56 smithi007 ceph-mon[29879]: pgmap v159: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:04:57.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:04:57 smithi130 ceph-mon[26123]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:04:57.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:04:57 smithi007 ceph-mon[25091]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:04:57.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:04:57 smithi007 ceph-mon[29879]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:04:58.468 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:04:58 smithi007 ceph-mon[25091]: pgmap v160: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:04:58.469 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:04:58 smithi007 ceph-mon[29879]: pgmap v160: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:04:58.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:04:58 smithi130 ceph-mon[26123]: pgmap v160: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:04:58.720 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:04:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.7 - - [18/Jun/2024:02:04:58] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:04:59.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:04:59 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:04:59.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:04:59 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:04:59.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:04:59 smithi130 ceph-mon[26123]: pgmap v161: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:04:59.810 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:04:59 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:04:59.810 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:04:59 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:04:59.810 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:04:59 smithi007 ceph-mon[25091]: pgmap v161: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:04:59.811 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:04:59 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:04:59.811 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:04:59 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:04:59.811 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:04:59 smithi007 ceph-mon[29879]: pgmap v161: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:05:00.070 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:05:00 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:05:00] "GET /metrics HTTP/1.1" 200 214923 "" "Prometheus/2.33.4" 2024-06-18T02:05:02.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:01 smithi130 ceph-mon[26123]: pgmap v162: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:05:02.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:01 smithi007 ceph-mon[25091]: pgmap v162: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:05:02.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:01 smithi007 ceph-mon[29879]: pgmap v162: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:05:03.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:05:03 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:05:03] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-06-18T02:05:03.932 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:05:03 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=error ts=2024-06-18T02:05:03.509Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.130:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.130 because it doesn't contain any IP SANs; ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://172.21.15.7:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.7 because it doesn't contain any IP SANs" 2024-06-18T02:05:03.932 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:05:03 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=warn ts=2024-06-18T02:05:03.511Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.7:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.7 because it doesn't contain any IP SANs" 2024-06-18T02:05:03.932 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:05:03 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=warn ts=2024-06-18T02:05:03.511Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.130:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.130 because it doesn't contain any IP SANs" 2024-06-18T02:05:04.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:04 smithi130 ceph-mon[26123]: pgmap v163: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:05:04.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:04 smithi007 ceph-mon[25091]: pgmap v163: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:05:04.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:04 smithi007 ceph-mon[29879]: pgmap v163: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:05:06.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:06 smithi007 ceph-mon[25091]: pgmap v164: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:05:06.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:06 smithi007 ceph-mon[29879]: pgmap v164: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:05:06.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:06 smithi130 ceph-mon[26123]: pgmap v164: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:05:06.931 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:05:06 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.130 - - [18/Jun/2024:02:05:06] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:05:07.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:07 smithi130 ceph-mon[26123]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:05:07.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:07 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:05:07.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:07 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:05:07.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:07 smithi007 ceph-mon[25091]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:05:07.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:07 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:05:07.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:07 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:05:07.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:07 smithi007 ceph-mon[29879]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:05:07.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:07 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:05:07.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:07 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:05:08.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:08 smithi130 ceph-mon[26123]: pgmap v165: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:05:08.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:08 smithi007 ceph-mon[25091]: pgmap v165: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:05:08.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:08 smithi007 ceph-mon[29879]: pgmap v165: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:05:09.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:09 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-06-18T02:05:09.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:09 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-06-18T02:05:09.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:09 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-06-18T02:05:09.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:09 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-06-18T02:05:09.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:09 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-06-18T02:05:09.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:09 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-06-18T02:05:10.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:10 smithi007 ceph-mon[25091]: pgmap v166: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:05:10.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:10 smithi007 ceph-mon[29879]: pgmap v166: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:05:10.432 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:05:10 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:05:10] "GET /metrics HTTP/1.1" 200 214945 "" "Prometheus/2.33.4" 2024-06-18T02:05:10.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:10 smithi130 ceph-mon[26123]: pgmap v166: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:05:11.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:11 smithi130 ceph-mon[26123]: pgmap v167: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:05:12.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:11 smithi007 ceph-mon[25091]: pgmap v167: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:05:12.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:11 smithi007 ceph-mon[29879]: pgmap v167: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:05:13.288 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:05:13 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:05:13] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-06-18T02:05:13.932 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:05:13 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=error ts=2024-06-18T02:05:13.510Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=4 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://172.21.15.7:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.7 because it doesn't contain any IP SANs; ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.130:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.130 because it doesn't contain any IP SANs" 2024-06-18T02:05:13.932 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:05:13 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=warn ts=2024-06-18T02:05:13.513Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.7:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.7 because it doesn't contain any IP SANs" 2024-06-18T02:05:13.932 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:05:13 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=warn ts=2024-06-18T02:05:13.513Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.130:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.130 because it doesn't contain any IP SANs" 2024-06-18T02:05:14.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:14 smithi007 ceph-mon[25091]: pgmap v168: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:05:14.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:14 smithi007 ceph-mon[29879]: pgmap v168: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:05:14.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:14 smithi130 ceph-mon[26123]: pgmap v168: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:05:16.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:16 smithi130 ceph-mon[26123]: pgmap v169: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:05:16.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:16 smithi007 ceph-mon[25091]: pgmap v169: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:05:16.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:16 smithi007 ceph-mon[29879]: pgmap v169: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:05:17.461 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:17 smithi007 ceph-mon[25091]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:05:17.462 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:17 smithi007 ceph-mon[29879]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:05:17.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:17 smithi130 ceph-mon[26123]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:05:18.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:18 smithi130 ceph-mon[26123]: pgmap v170: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:05:18.579 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:18 smithi007 ceph-mon[25091]: pgmap v170: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:05:18.580 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:18 smithi007 ceph-mon[29879]: pgmap v170: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:05:18.931 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:05:18 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.7 - - [18/Jun/2024:02:05:18] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:05:19.854 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:19 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:05:19.854 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:19 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:05:19.854 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:19 smithi007 ceph-mon[25091]: pgmap v171: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:05:19.854 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:19 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:05:19.854 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:19 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:05:19.855 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:19 smithi007 ceph-mon[29879]: pgmap v171: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:05:20.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:19 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:05:20.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:19 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:05:20.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:19 smithi130 ceph-mon[26123]: pgmap v171: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:05:20.115 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:05:20 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:05:20] "GET /metrics HTTP/1.1" 200 214945 "" "Prometheus/2.33.4" 2024-06-18T02:05:21.872 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:21 smithi007 ceph-mon[25091]: pgmap v172: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:05:21.872 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:21 smithi007 ceph-mon[29879]: pgmap v172: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:05:22.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:21 smithi130 ceph-mon[26123]: pgmap v172: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:05:23.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:05:23 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:05:23] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-06-18T02:05:23.931 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:05:23 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=error ts=2024-06-18T02:05:23.510Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=7 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://172.21.15.7:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.7 because it doesn't contain any IP SANs; ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://172.21.15.130:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.130 because it doesn't contain any IP SANs" 2024-06-18T02:05:23.932 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:05:23 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=warn ts=2024-06-18T02:05:23.513Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.130:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.130 because it doesn't contain any IP SANs" 2024-06-18T02:05:23.932 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:05:23 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=warn ts=2024-06-18T02:05:23.513Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.7:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.7 because it doesn't contain any IP SANs" 2024-06-18T02:05:24.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:24 smithi130 ceph-mon[26123]: pgmap v173: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:05:24.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:24 smithi007 ceph-mon[25091]: pgmap v173: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:05:24.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:24 smithi007 ceph-mon[29879]: pgmap v173: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:05:26.268 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:26 smithi007 ceph-mon[25091]: pgmap v174: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:05:26.268 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:26 smithi007 ceph-mon[29879]: pgmap v174: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:05:26.298 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -e sha1=3781e3a592387d16e8020f5db99cdee4198f6d00 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-06-18T02:05:26.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:26 smithi130 ceph-mon[26123]: pgmap v174: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:05:26.912 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:05:26 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.130 - - [18/Jun/2024:02:05:26] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:05:27.524 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:27 smithi007 ceph-mon[25091]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:05:27.525 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:27 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:05:27.525 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:27 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:05:27.525 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:27 smithi007 ceph-mon[29879]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:05:27.525 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:27 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:05:27.525 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:27 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:05:27.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:27 smithi130 ceph-mon[26123]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:05:27.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:27 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:05:27.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:27 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:05:28.473 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:28 smithi007 ceph-mon[25091]: pgmap v175: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:05:28.473 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:28 smithi007 ceph-mon[29879]: pgmap v175: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:05:28.497 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:28 smithi130 ceph-mon[26123]: pgmap v175: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:05:28.878 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -e sha1=3781e3a592387d16e8020f5db99cdee4198f6d00 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-06-18T02:05:30.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:30 smithi007 ceph-mon[25091]: pgmap v176: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:05:30.337 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:05:30 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:05:30] "GET /metrics HTTP/1.1" 200 214939 "" "Prometheus/2.33.4" 2024-06-18T02:05:30.337 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:30 smithi007 ceph-mon[29879]: pgmap v176: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:05:30.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:30 smithi130 ceph-mon[26123]: pgmap v176: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:05:31.424 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -e sha1=3781e3a592387d16e8020f5db99cdee4198f6d00 -- bash -c 'ceph config set global log_to_journald false --force' 2024-06-18T02:05:32.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:31 smithi130 ceph-mon[26123]: pgmap v177: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:05:32.051 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:31 smithi007 ceph-mon[25091]: pgmap v177: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:05:32.051 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:31 smithi007 ceph-mon[29879]: pgmap v177: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:05:33.175 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:05:33 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:05:33] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-06-18T02:05:33.806 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:05:33 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=error ts=2024-06-18T02:05:33.511Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=7 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.130:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.130 because it doesn't contain any IP SANs; ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://172.21.15.7:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.7 because it doesn't contain any IP SANs" 2024-06-18T02:05:33.807 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:05:33 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=warn ts=2024-06-18T02:05:33.513Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.130:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.130 because it doesn't contain any IP SANs" 2024-06-18T02:05:33.807 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:05:33 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=warn ts=2024-06-18T02:05:33.513Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.7:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.7 because it doesn't contain any IP SANs" 2024-06-18T02:05:33.832 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -e sha1=3781e3a592387d16e8020f5db99cdee4198f6d00 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-06-18T02:05:34.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:34 smithi130 ceph-mon[26123]: pgmap v178: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:05:34.409 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:34 smithi007 ceph-mon[25091]: pgmap v178: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:05:34.409 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:34 smithi007 ceph-mon[29879]: pgmap v178: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:05:35.734 INFO:teuthology.orchestra.run.smithi007.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:05:36.332 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-06-18T02:05:36.342 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi007.front.sepia.ceph.com 2024-06-18T02:05:36.342 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -e sha1=3781e3a592387d16e8020f5db99cdee4198f6d00 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-06-18T02:05:36.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:36 smithi130 ceph-mon[26123]: pgmap v179: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:05:36.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:36 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:05:36.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:36 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:05:36.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:36 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:05:36.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:36 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:05:36.657 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:36 smithi007 ceph-mon[25091]: pgmap v179: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:05:36.658 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:36 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:05:36.658 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:36 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:05:36.658 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:36 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:05:36.658 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:36 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:05:36.658 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:36 smithi007 ceph-mon[29879]: pgmap v179: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:05:36.658 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:36 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:05:36.658 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:36 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:05:36.658 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:36 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:05:36.658 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:36 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:05:37.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:37 smithi007 ceph-mon[25091]: from='client.24970 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:05:37.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:37 smithi007 ceph-mon[25091]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:05:37.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:37 smithi007 ceph-mon[25091]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:05:37.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:37 smithi007 ceph-mon[25091]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:05:37.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:37 smithi007 ceph-mon[29879]: from='client.24970 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:05:37.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:37 smithi007 ceph-mon[29879]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:05:37.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:37 smithi007 ceph-mon[29879]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:05:37.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:37 smithi007 ceph-mon[29879]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:05:37.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:37 smithi130 ceph-mon[26123]: from='client.24970 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:05:37.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:37 smithi130 ceph-mon[26123]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:05:37.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:37 smithi130 ceph-mon[26123]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:05:37.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:37 smithi130 ceph-mon[26123]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:05:38.278 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:38 smithi007 ceph-mon[25091]: pgmap v180: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:05:38.279 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:38 smithi007 ceph-mon[29879]: pgmap v180: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:05:38.487 INFO:teuthology.orchestra.run.smithi007.stdout:true 2024-06-18T02:05:38.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:38 smithi130 ceph-mon[26123]: pgmap v180: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:05:39.181 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:05:38 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.7 - - [18/Jun/2024:02:05:38] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:05:39.204 INFO:teuthology.orchestra.run.smithi007.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-18T02:05:39.204 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi007 smithi007 running 0s ago 8m - - 2024-06-18T02:05:39.204 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi130 smithi130 running 12s ago 8m - - 2024-06-18T02:05:39.204 INFO:teuthology.orchestra.run.smithi007.stdout:alertmanager.a smithi007 *:9093,9094 running (3m) 0s ago 3m 28.8M - ba2b418f427c 8a3093399f5a 2024-06-18T02:05:39.205 INFO:teuthology.orchestra.run.smithi007.stdout:grafana.a smithi130 *:3000 running (3m) 12s ago 3m 55.2M - 8.3.5 dad864ee21e9 b39a3781d434 2024-06-18T02:05:39.205 INFO:teuthology.orchestra.run.smithi007.stdout:iscsi.foo.smithi007.xvdrwd smithi007 running (2m) 0s ago 2m 46.5M - 3.5 e1d6a67b021e da0b75a0afdc 2024-06-18T02:05:39.205 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.x smithi130 *:8443 running (8m) 12s ago 8m 412M - 17.2.0 e1d6a67b021e 02d55b2b38c8 2024-06-18T02:05:39.205 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.y smithi007 *:9283 running (9m) 0s ago 9m 464M - 17.2.0 e1d6a67b021e 78a1afd0bddd 2024-06-18T02:05:39.205 INFO:teuthology.orchestra.run.smithi007.stdout:mon.a smithi007 running (9m) 0s ago 9m 52.0M 2048M 17.2.0 e1d6a67b021e 147f3ea02ae3 2024-06-18T02:05:39.205 INFO:teuthology.orchestra.run.smithi007.stdout:mon.b smithi130 running (8m) 12s ago 8m 43.8M 2048M 17.2.0 e1d6a67b021e a0b38a9a595f 2024-06-18T02:05:39.205 INFO:teuthology.orchestra.run.smithi007.stdout:mon.c smithi007 running (8m) 0s ago 8m 40.5M 2048M 17.2.0 e1d6a67b021e 1d1e2628656b 2024-06-18T02:05:39.205 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.a smithi007 *:9100 running (4m) 0s ago 4m 19.4M - 1dbe0e931976 68ab68346698 2024-06-18T02:05:39.205 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.b smithi130 *:9100 running (4m) 12s ago 3m 16.9M - 1dbe0e931976 02601fb28ea2 2024-06-18T02:05:39.205 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0 smithi007 running (7m) 0s ago 7m 52.2M 4096M 17.2.0 e1d6a67b021e 1ef6e23afd55 2024-06-18T02:05:39.205 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1 smithi007 running (7m) 0s ago 7m 53.2M 4096M 17.2.0 e1d6a67b021e a967706523cb 2024-06-18T02:05:39.205 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2 smithi007 running (6m) 0s ago 6m 47.3M 4096M 17.2.0 e1d6a67b021e 2c1b76bd0876 2024-06-18T02:05:39.205 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3 smithi007 running (6m) 0s ago 6m 51.1M 4096M 17.2.0 e1d6a67b021e 8b91b2a07564 2024-06-18T02:05:39.206 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4 smithi130 running (6m) 12s ago 6m 53.1M 4096M 17.2.0 e1d6a67b021e c428dccffdf0 2024-06-18T02:05:39.206 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5 smithi130 running (5m) 12s ago 5m 52.1M 4096M 17.2.0 e1d6a67b021e f645d7f12378 2024-06-18T02:05:39.206 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6 smithi130 running (5m) 12s ago 5m 47.4M 4096M 17.2.0 e1d6a67b021e c7af86c14959 2024-06-18T02:05:39.206 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7 smithi130 running (4m) 12s ago 4m 51.0M 4096M 17.2.0 e1d6a67b021e 3688af8b2c46 2024-06-18T02:05:39.206 INFO:teuthology.orchestra.run.smithi007.stdout:prometheus.a smithi130 *:9095 running (2m) 12s ago 4m 65.9M - 514e6a882f6e 5b12ac431abe 2024-06-18T02:05:39.206 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi007.dvbvbk smithi007 *:8000 running (2m) 0s ago 2m 72.9M - 17.2.0 e1d6a67b021e 1344b55b763c 2024-06-18T02:05:39.206 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi130.aakmof smithi130 *:8000 running (2m) 12s ago 2m 71.0M - 17.2.0 e1d6a67b021e e257e3230c6c 2024-06-18T02:05:39.206 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi007.hgrnmk smithi007 *:80 running (2m) 0s ago 2m 71.8M - 17.2.0 e1d6a67b021e 2173947bc4d6 2024-06-18T02:05:39.206 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi130.wwebfk smithi130 *:80 running (2m) 12s ago 2m 72.9M - 17.2.0 e1d6a67b021e 8662706b2231 2024-06-18T02:05:39.614 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:05:39.614 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": { 2024-06-18T02:05:39.614 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-06-18T02:05:39.614 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:05:39.615 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": { 2024-06-18T02:05:39.615 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2 2024-06-18T02:05:39.615 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:05:39.615 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": { 2024-06-18T02:05:39.615 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-06-18T02:05:39.615 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:05:39.615 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": {}, 2024-06-18T02:05:39.615 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw": { 2024-06-18T02:05:39.615 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-06-18T02:05:39.615 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:05:39.615 INFO:teuthology.orchestra.run.smithi007.stdout: "overall": { 2024-06-18T02:05:39.615 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 17 2024-06-18T02:05:39.615 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-06-18T02:05:39.615 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:05:39.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:39 smithi007 ceph-mon[25091]: from='client.15066 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:05:39.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:39 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:05:39.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:39 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:05:39.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:39 smithi007 ceph-mon[25091]: from='client.24887 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:05:39.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:39 smithi007 ceph-mon[25091]: pgmap v181: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:05:39.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:39 smithi007 ceph-mon[25091]: from='client.15078 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:05:39.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:39 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/4169278207' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:05:39.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:39 smithi007 ceph-mon[29879]: from='client.15066 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:05:39.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:39 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:05:39.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:39 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:05:39.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:39 smithi007 ceph-mon[29879]: from='client.24887 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:05:39.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:39 smithi007 ceph-mon[29879]: pgmap v181: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:05:39.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:39 smithi007 ceph-mon[29879]: from='client.15078 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:05:39.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:39 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/4169278207' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:05:39.971 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:05:39.971 INFO:teuthology.orchestra.run.smithi007.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00", 2024-06-18T02:05:39.971 INFO:teuthology.orchestra.run.smithi007.stdout: "in_progress": true, 2024-06-18T02:05:39.971 INFO:teuthology.orchestra.run.smithi007.stdout: "services_complete": [], 2024-06-18T02:05:39.971 INFO:teuthology.orchestra.run.smithi007.stdout: "progress": "", 2024-06-18T02:05:39.972 INFO:teuthology.orchestra.run.smithi007.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 image" 2024-06-18T02:05:39.972 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:05:40.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:39 smithi130 ceph-mon[26123]: from='client.15066 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:05:40.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:39 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:05:40.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:39 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:05:40.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:39 smithi130 ceph-mon[26123]: from='client.24887 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:05:40.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:39 smithi130 ceph-mon[26123]: pgmap v181: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:05:40.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:39 smithi130 ceph-mon[26123]: from='client.15078 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:05:40.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:39 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/4169278207' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:05:40.279 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:05:40 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:05:40] "GET /metrics HTTP/1.1" 200 214927 "" "Prometheus/2.33.4" 2024-06-18T02:05:40.387 INFO:teuthology.orchestra.run.smithi007.stdout:HEALTH_OK 2024-06-18T02:05:40.931 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:40 smithi007 ceph-mon[29879]: from='client.15090 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:05:40.931 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:40 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/2178263868' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:05:40.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:40 smithi007 ceph-mon[25091]: from='client.15090 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:05:40.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:40 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/2178263868' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:05:41.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:40 smithi130 ceph-mon[26123]: from='client.15090 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:05:41.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:40 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/2178263868' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:05:41.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:41 smithi007 ceph-mon[25091]: pgmap v182: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:05:41.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:41 smithi007 ceph-mon[29879]: pgmap v182: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:05:42.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:41 smithi130 ceph-mon[26123]: pgmap v182: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:05:43.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:05:43 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:05:43] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-06-18T02:05:43.836 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:05:43 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=error ts=2024-06-18T02:05:43.511Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=7 err="ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://172.21.15.130:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.130 because it doesn't contain any IP SANs; ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://172.21.15.7:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.7 because it doesn't contain any IP SANs" 2024-06-18T02:05:43.836 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:05:43 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=warn ts=2024-06-18T02:05:43.513Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.130:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.130 because it doesn't contain any IP SANs" 2024-06-18T02:05:43.836 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:05:43 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=warn ts=2024-06-18T02:05:43.514Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.7:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.7 because it doesn't contain any IP SANs" 2024-06-18T02:05:44.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:44 smithi130 ceph-mon[26123]: pgmap v183: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:05:44.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:44 smithi007 ceph-mon[25091]: pgmap v183: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:05:44.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:44 smithi007 ceph-mon[29879]: pgmap v183: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:05:46.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:46 smithi130 ceph-mon[26123]: pgmap v184: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:05:46.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:46 smithi007 ceph-mon[25091]: pgmap v184: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:05:46.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:46 smithi007 ceph-mon[29879]: pgmap v184: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:05:47.181 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:05:46 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.130 - - [18/Jun/2024:02:05:46] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:05:47.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:47 smithi130 ceph-mon[26123]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:05:47.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:47 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:05:47.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:47 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:05:47.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:47 smithi007 ceph-mon[25091]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:05:47.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:47 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:05:47.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:47 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:05:47.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:47 smithi007 ceph-mon[29879]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:05:47.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:47 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:05:47.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:47 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:05:48.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:48 smithi130 ceph-mon[26123]: pgmap v185: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:05:48.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:48 smithi007 ceph-mon[25091]: pgmap v185: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:05:48.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:48 smithi007 ceph-mon[29879]: pgmap v185: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:05:50.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:50 smithi007 ceph-mon[25091]: pgmap v186: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:05:50.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:50 smithi007 ceph-mon[29879]: pgmap v186: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:05:50.432 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:05:50 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:05:50] "GET /metrics HTTP/1.1" 200 214927 "" "Prometheus/2.33.4" 2024-06-18T02:05:50.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:50 smithi130 ceph-mon[26123]: pgmap v186: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:05:52.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:51 smithi130 ceph-mon[26123]: pgmap v187: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:05:52.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:51 smithi007 ceph-mon[25091]: pgmap v187: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:05:52.181 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:51 smithi007 ceph-mon[29879]: pgmap v187: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:05:53.294 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:05:53 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:05:53] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-06-18T02:05:53.931 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:05:53 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=error ts=2024-06-18T02:05:53.512Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=7 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.130:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.130 because it doesn't contain any IP SANs; ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://172.21.15.7:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.7 because it doesn't contain any IP SANs" 2024-06-18T02:05:53.931 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:05:53 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=warn ts=2024-06-18T02:05:53.514Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.130:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.130 because it doesn't contain any IP SANs" 2024-06-18T02:05:53.932 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:05:53 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=warn ts=2024-06-18T02:05:53.515Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.7:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.7 because it doesn't contain any IP SANs" 2024-06-18T02:05:54.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:54 smithi130 ceph-mon[26123]: pgmap v188: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:05:54.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:54 smithi007 ceph-mon[25091]: pgmap v188: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:05:54.681 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:54 smithi007 ceph-mon[29879]: pgmap v188: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:05:56.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:56 smithi130 ceph-mon[26123]: pgmap v189: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:05:56.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:56 smithi007 ceph-mon[25091]: pgmap v189: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:05:56.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:56 smithi007 ceph-mon[29879]: pgmap v189: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:05:57.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:57 smithi130 ceph-mon[26123]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:05:57.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:57 smithi007 ceph-mon[25091]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:05:57.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:57 smithi007 ceph-mon[29879]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:05:58.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:58 smithi130 ceph-mon[26123]: pgmap v190: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:05:58.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:58 smithi007 ceph-mon[25091]: pgmap v190: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:05:58.681 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:58 smithi007 ceph-mon[29879]: pgmap v190: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:05:59.181 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:05:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.7 - - [18/Jun/2024:02:05:58] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:06:00.181 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:06:00 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:06:00] "GET /metrics HTTP/1.1" 200 214910 "" "Prometheus/2.33.4" 2024-06-18T02:06:00.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:59 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:06:00.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:59 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:06:00.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:05:59 smithi007 ceph-mon[25091]: pgmap v191: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:06:00.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:59 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:06:00.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:59 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:06:00.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:05:59 smithi007 ceph-mon[29879]: pgmap v191: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:06:00.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:59 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:06:00.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:59 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:06:00.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:05:59 smithi130 ceph-mon[26123]: pgmap v191: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:06:02.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:01 smithi130 ceph-mon[26123]: pgmap v192: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:06:02.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:01 smithi007 ceph-mon[25091]: pgmap v192: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:06:02.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:01 smithi007 ceph-mon[29879]: pgmap v192: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:06:03.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:03 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:06:03] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-06-18T02:06:03.931 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:06:03 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=error ts=2024-06-18T02:06:03.513Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=7 err="ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://172.21.15.130:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.130 because it doesn't contain any IP SANs; ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://172.21.15.7:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.7 because it doesn't contain any IP SANs" 2024-06-18T02:06:03.932 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:06:03 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=warn ts=2024-06-18T02:06:03.515Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.7:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.7 because it doesn't contain any IP SANs" 2024-06-18T02:06:03.932 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:06:03 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=warn ts=2024-06-18T02:06:03.515Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.130:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.130 because it doesn't contain any IP SANs" 2024-06-18T02:06:04.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:04 smithi130 ceph-mon[26123]: pgmap v193: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:06:04.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:04 smithi007 ceph-mon[25091]: pgmap v193: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:06:04.681 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:04 smithi007 ceph-mon[29879]: pgmap v193: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:06:06.445 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:06 smithi007 ceph-mon[25091]: pgmap v194: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:06:06.445 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:06 smithi007 ceph-mon[29879]: pgmap v194: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:06:06.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:06 smithi130 ceph-mon[26123]: pgmap v194: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:06:07.181 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:06:06 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.130 - - [18/Jun/2024:02:06:06] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:06:07.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:07 smithi130 ceph-mon[26123]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:06:07.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:07 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:06:07.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:07 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:06:07.517 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:07 smithi007 ceph-mon[25091]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:06:07.517 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:07 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:06:07.517 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:07 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:06:07.517 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:07 smithi007 ceph-mon[29879]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:06:07.517 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:07 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:06:07.517 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:07 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:06:08.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:08 smithi130 ceph-mon[26123]: pgmap v195: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:06:08.566 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:08 smithi007 ceph-mon[25091]: pgmap v195: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:06:08.567 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:08 smithi007 ceph-mon[29879]: pgmap v195: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:06:09.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:09 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-06-18T02:06:09.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:09 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-06-18T02:06:09.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:09 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:06:09.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:09 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:06:09.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:09 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:06:09.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:09 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-06-18T02:06:09.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:09 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-06-18T02:06:09.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:09 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:06:09.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:09 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:06:09.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:09 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:06:09.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:09 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-06-18T02:06:09.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:09 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-06-18T02:06:09.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:09 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:06:09.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:09 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:06:09.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:09 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:06:10.181 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:06:10 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:06:10] "GET /metrics HTTP/1.1" 200 214873 "" "Prometheus/2.33.4" 2024-06-18T02:06:10.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:10 smithi007 ceph-mon[25091]: Upgrade: Target is version 19.0.0-3124-g3781e3a5 (unknown) 2024-06-18T02:06:10.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:10 smithi007 ceph-mon[25091]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, digests ['quay.ceph.io/ceph-ci/ceph@sha256:64b08d1c422bf6aa753839cabed8a69924a54ceb6ef0660c2e561d19ca874314'] 2024-06-18T02:06:10.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:10 smithi007 ceph-mon[25091]: Upgrade: Need to upgrade myself (mgr.y) 2024-06-18T02:06:10.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:10 smithi007 ceph-mon[25091]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 on smithi130 2024-06-18T02:06:10.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:10 smithi007 ceph-mon[25091]: pgmap v196: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:06:10.542 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:10 smithi007 ceph-mon[29879]: Upgrade: Target is version 19.0.0-3124-g3781e3a5 (unknown) 2024-06-18T02:06:10.542 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:10 smithi007 ceph-mon[29879]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, digests ['quay.ceph.io/ceph-ci/ceph@sha256:64b08d1c422bf6aa753839cabed8a69924a54ceb6ef0660c2e561d19ca874314'] 2024-06-18T02:06:10.543 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:10 smithi007 ceph-mon[29879]: Upgrade: Need to upgrade myself (mgr.y) 2024-06-18T02:06:10.543 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:10 smithi007 ceph-mon[29879]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 on smithi130 2024-06-18T02:06:10.543 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:10 smithi007 ceph-mon[29879]: pgmap v196: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:06:10.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:10 smithi130 ceph-mon[26123]: Upgrade: Target is version 19.0.0-3124-g3781e3a5 (unknown) 2024-06-18T02:06:10.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:10 smithi130 ceph-mon[26123]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, digests ['quay.ceph.io/ceph-ci/ceph@sha256:64b08d1c422bf6aa753839cabed8a69924a54ceb6ef0660c2e561d19ca874314'] 2024-06-18T02:06:10.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:10 smithi130 ceph-mon[26123]: Upgrade: Need to upgrade myself (mgr.y) 2024-06-18T02:06:10.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:10 smithi130 ceph-mon[26123]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 on smithi130 2024-06-18T02:06:10.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:10 smithi130 ceph-mon[26123]: pgmap v196: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:06:10.722 INFO:teuthology.orchestra.run.smithi007.stdout:true 2024-06-18T02:06:11.342 INFO:teuthology.orchestra.run.smithi007.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-18T02:06:11.342 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi007 smithi007 running 12s ago 9m - - 2024-06-18T02:06:11.342 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi130 smithi130 running 4s ago 9m - - 2024-06-18T02:06:11.342 INFO:teuthology.orchestra.run.smithi007.stdout:alertmanager.a smithi007 *:9093,9094 running (3m) 12s ago 4m 28.1M - ba2b418f427c 8a3093399f5a 2024-06-18T02:06:11.342 INFO:teuthology.orchestra.run.smithi007.stdout:grafana.a smithi130 *:3000 running (3m) 4s ago 3m 56.8M - 8.3.5 dad864ee21e9 b39a3781d434 2024-06-18T02:06:11.342 INFO:teuthology.orchestra.run.smithi007.stdout:iscsi.foo.smithi007.xvdrwd smithi007 running (2m) 12s ago 2m 48.6M - 3.5 e1d6a67b021e da0b75a0afdc 2024-06-18T02:06:11.342 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.x smithi130 *:8443 running (8m) 4s ago 8m 412M - 17.2.0 e1d6a67b021e 02d55b2b38c8 2024-06-18T02:06:11.342 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.y smithi007 *:9283 running (10m) 12s ago 10m 465M - 17.2.0 e1d6a67b021e 78a1afd0bddd 2024-06-18T02:06:11.343 INFO:teuthology.orchestra.run.smithi007.stdout:mon.a smithi007 running (10m) 12s ago 10m 52.7M 2048M 17.2.0 e1d6a67b021e 147f3ea02ae3 2024-06-18T02:06:11.343 INFO:teuthology.orchestra.run.smithi007.stdout:mon.b smithi130 running (8m) 4s ago 8m 40.7M 2048M 17.2.0 e1d6a67b021e a0b38a9a595f 2024-06-18T02:06:11.343 INFO:teuthology.orchestra.run.smithi007.stdout:mon.c smithi007 running (9m) 12s ago 9m 40.3M 2048M 17.2.0 e1d6a67b021e 1d1e2628656b 2024-06-18T02:06:11.343 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.a smithi007 *:9100 running (4m) 12s ago 4m 16.3M - 1dbe0e931976 68ab68346698 2024-06-18T02:06:11.343 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.b smithi130 *:9100 running (4m) 4s ago 4m 16.5M - 1dbe0e931976 02601fb28ea2 2024-06-18T02:06:11.343 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0 smithi007 running (8m) 12s ago 8m 52.5M 4096M 17.2.0 e1d6a67b021e 1ef6e23afd55 2024-06-18T02:06:11.343 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1 smithi007 running (7m) 12s ago 7m 53.3M 4096M 17.2.0 e1d6a67b021e a967706523cb 2024-06-18T02:06:11.343 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2 smithi007 running (7m) 12s ago 7m 47.5M 4096M 17.2.0 e1d6a67b021e 2c1b76bd0876 2024-06-18T02:06:11.343 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3 smithi007 running (7m) 12s ago 7m 51.3M 4096M 17.2.0 e1d6a67b021e 8b91b2a07564 2024-06-18T02:06:11.343 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4 smithi130 running (6m) 4s ago 6m 53.5M 4096M 17.2.0 e1d6a67b021e c428dccffdf0 2024-06-18T02:06:11.343 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5 smithi130 running (6m) 4s ago 6m 52.4M 4096M 17.2.0 e1d6a67b021e f645d7f12378 2024-06-18T02:06:11.343 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6 smithi130 running (5m) 4s ago 5m 47.7M 4096M 17.2.0 e1d6a67b021e c7af86c14959 2024-06-18T02:06:11.343 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7 smithi130 running (5m) 4s ago 5m 51.3M 4096M 17.2.0 e1d6a67b021e 3688af8b2c46 2024-06-18T02:06:11.344 INFO:teuthology.orchestra.run.smithi007.stdout:prometheus.a smithi130 *:9095 running (3m) 4s ago 4m 68.0M - 514e6a882f6e 5b12ac431abe 2024-06-18T02:06:11.344 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi007.dvbvbk smithi007 *:8000 running (3m) 12s ago 3m 73.0M - 17.2.0 e1d6a67b021e 1344b55b763c 2024-06-18T02:06:11.344 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi130.aakmof smithi130 *:8000 running (3m) 4s ago 2m 71.2M - 17.2.0 e1d6a67b021e e257e3230c6c 2024-06-18T02:06:11.344 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi007.hgrnmk smithi007 *:80 running (2m) 12s ago 2m 71.9M - 17.2.0 e1d6a67b021e 2173947bc4d6 2024-06-18T02:06:11.344 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi130.wwebfk smithi130 *:80 running (2m) 4s ago 2m 73.2M - 17.2.0 e1d6a67b021e 8662706b2231 2024-06-18T02:06:11.708 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:06:11.708 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": { 2024-06-18T02:06:11.708 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-06-18T02:06:11.708 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:06:11.708 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": { 2024-06-18T02:06:11.708 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2 2024-06-18T02:06:11.708 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:06:11.708 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": { 2024-06-18T02:06:11.708 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-06-18T02:06:11.708 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:06:11.709 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": {}, 2024-06-18T02:06:11.709 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw": { 2024-06-18T02:06:11.709 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-06-18T02:06:11.709 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:06:11.709 INFO:teuthology.orchestra.run.smithi007.stdout: "overall": { 2024-06-18T02:06:11.709 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 17 2024-06-18T02:06:11.709 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-06-18T02:06:11.709 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:06:12.017 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:06:12.017 INFO:teuthology.orchestra.run.smithi007.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00", 2024-06-18T02:06:12.017 INFO:teuthology.orchestra.run.smithi007.stdout: "in_progress": true, 2024-06-18T02:06:12.017 INFO:teuthology.orchestra.run.smithi007.stdout: "services_complete": [], 2024-06-18T02:06:12.017 INFO:teuthology.orchestra.run.smithi007.stdout: "progress": "0/23 daemons upgraded", 2024-06-18T02:06:12.017 INFO:teuthology.orchestra.run.smithi007.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 image on host smithi130" 2024-06-18T02:06:12.017 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:06:12.018 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:11 smithi007 ceph-mon[25091]: from='client.25012 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:06:12.018 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:11 smithi007 ceph-mon[25091]: from='client.15108 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:06:12.018 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:11 smithi007 ceph-mon[25091]: pgmap v197: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:06:12.018 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:11 smithi007 ceph-mon[25091]: from='client.25024 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:06:12.018 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:11 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/1705035896' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:06:12.018 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:11 smithi007 ceph-mon[29879]: from='client.25012 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:06:12.018 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:11 smithi007 ceph-mon[29879]: from='client.15108 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:06:12.018 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:11 smithi007 ceph-mon[29879]: pgmap v197: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:06:12.019 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:11 smithi007 ceph-mon[29879]: from='client.25024 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:06:12.019 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:11 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/1705035896' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:06:12.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:11 smithi130 ceph-mon[26123]: from='client.25012 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:06:12.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:11 smithi130 ceph-mon[26123]: from='client.15108 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:06:12.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:11 smithi130 ceph-mon[26123]: pgmap v197: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:06:12.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:11 smithi130 ceph-mon[26123]: from='client.25024 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:06:12.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:11 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/1705035896' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:06:12.381 INFO:teuthology.orchestra.run.smithi007.stdout:HEALTH_OK 2024-06-18T02:06:13.041 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:12 smithi130 ceph-mon[26123]: from='client.25036 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:06:13.041 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:12 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/3632530045' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:06:13.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:12 smithi007 ceph-mon[25091]: from='client.25036 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:06:13.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:12 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/3632530045' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:06:13.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:12 smithi007 ceph-mon[29879]: from='client.25036 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:06:13.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:12 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/3632530045' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:06:13.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:13 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:06:13] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-06-18T02:06:13.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:13 smithi007 ceph-mon[25091]: pgmap v198: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:06:13.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:13 smithi007 ceph-mon[29879]: pgmap v198: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:06:13.932 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:06:13 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=error ts=2024-06-18T02:06:13.513Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=7 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.130:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.130 because it doesn't contain any IP SANs; ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://172.21.15.7:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.7 because it doesn't contain any IP SANs" 2024-06-18T02:06:13.932 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:06:13 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=warn ts=2024-06-18T02:06:13.515Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.130:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.130 because it doesn't contain any IP SANs" 2024-06-18T02:06:13.932 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:06:13 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=warn ts=2024-06-18T02:06:13.516Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.7:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.7 because it doesn't contain any IP SANs" 2024-06-18T02:06:14.011 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:13 smithi130 ceph-mon[26123]: pgmap v198: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:06:16.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:16 smithi130 ceph-mon[26123]: pgmap v199: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:06:16.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:16 smithi007 ceph-mon[25091]: pgmap v199: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:06:16.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:16 smithi007 ceph-mon[29879]: pgmap v199: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:06:17.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:17 smithi130 ceph-mon[26123]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:06:17.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:17 smithi007 ceph-mon[25091]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:06:17.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:17 smithi007 ceph-mon[29879]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:06:18.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:18 smithi130 ceph-mon[26123]: pgmap v200: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:06:18.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:18 smithi007 ceph-mon[29879]: pgmap v200: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:06:18.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:18 smithi007 ceph-mon[25091]: pgmap v200: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:06:19.431 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:06:18 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.7 - - [18/Jun/2024:02:06:18] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:06:20.181 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:06:20 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:06:20] "GET /metrics HTTP/1.1" 200 214873 "" "Prometheus/2.33.4" 2024-06-18T02:06:20.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:19 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:06:20.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:19 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:06:20.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:19 smithi007 ceph-mon[29879]: pgmap v201: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:06:20.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:19 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:06:20.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:19 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:06:20.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:19 smithi007 ceph-mon[25091]: pgmap v201: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:06:20.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:19 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:06:20.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:19 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:06:20.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:19 smithi130 ceph-mon[26123]: pgmap v201: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:06:22.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:21 smithi130 ceph-mon[26123]: pgmap v202: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:06:22.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:21 smithi007 ceph-mon[25091]: pgmap v202: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:06:22.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:21 smithi007 ceph-mon[29879]: pgmap v202: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:06:23.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:23 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:06:23] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-06-18T02:06:23.932 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:06:23 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=error ts=2024-06-18T02:06:23.515Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=7 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://172.21.15.7:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.7 because it doesn't contain any IP SANs; ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.130:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.130 because it doesn't contain any IP SANs" 2024-06-18T02:06:23.932 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:06:23 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=warn ts=2024-06-18T02:06:23.517Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.7:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.7 because it doesn't contain any IP SANs" 2024-06-18T02:06:23.932 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:06:23 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=warn ts=2024-06-18T02:06:23.517Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.130:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.130 because it doesn't contain any IP SANs" 2024-06-18T02:06:24.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:24 smithi130 ceph-mon[26123]: pgmap v203: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:06:24.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:24 smithi007 ceph-mon[25091]: pgmap v203: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:06:24.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:24 smithi007 ceph-mon[29879]: pgmap v203: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:06:26.317 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:26 smithi007 ceph-mon[25091]: pgmap v204: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:06:26.318 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:26 smithi007 ceph-mon[29879]: pgmap v204: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:06:26.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:26 smithi130 ceph-mon[26123]: pgmap v204: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:06:27.295 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:06:27 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.130 - - [18/Jun/2024:02:06:27] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:06:27.295 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:27 smithi007 ceph-mon[25091]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:06:27.295 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:27 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:06:27.296 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:27 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:06:27.296 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:27 smithi007 ceph-mon[29879]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:06:27.296 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:27 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:06:27.296 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:27 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:06:27.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:27 smithi130 ceph-mon[26123]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:06:27.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:27 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:06:27.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:27 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:06:28.499 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:28 smithi007 ceph-mon[25091]: pgmap v205: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:06:28.500 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:28 smithi007 ceph-mon[29879]: pgmap v205: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:06:28.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:28 smithi130 ceph-mon[26123]: pgmap v205: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:06:30.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:30 smithi007 ceph-mon[25091]: pgmap v206: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:06:30.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:30 smithi007 ceph-mon[29879]: pgmap v206: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:06:30.432 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:06:30 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:06:30] "GET /metrics HTTP/1.1" 200 214872 "" "Prometheus/2.33.4" 2024-06-18T02:06:30.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:30 smithi130 ceph-mon[26123]: pgmap v206: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:06:32.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:31 smithi130 ceph-mon[26123]: pgmap v207: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:06:32.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:31 smithi007 ceph-mon[25091]: pgmap v207: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:06:32.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:31 smithi007 ceph-mon[29879]: pgmap v207: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:06:33.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:33 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:06:33] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-06-18T02:06:33.931 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:06:33 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=error ts=2024-06-18T02:06:33.515Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=7 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://172.21.15.7:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.7 because it doesn't contain any IP SANs; ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://172.21.15.130:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.130 because it doesn't contain any IP SANs" 2024-06-18T02:06:33.932 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:06:33 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=warn ts=2024-06-18T02:06:33.517Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.7:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.7 because it doesn't contain any IP SANs" 2024-06-18T02:06:33.932 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:06:33 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=warn ts=2024-06-18T02:06:33.518Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.130:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.130 because it doesn't contain any IP SANs" 2024-06-18T02:06:34.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:34 smithi130 ceph-mon[26123]: pgmap v208: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:06:34.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:34 smithi007 ceph-mon[25091]: pgmap v208: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:06:34.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:34 smithi007 ceph-mon[29879]: pgmap v208: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:06:36.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:36 smithi007 ceph-mon[25091]: pgmap v209: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:06:36.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:36 smithi007 ceph-mon[29879]: pgmap v209: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:06:36.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:36 smithi130 ceph-mon[26123]: pgmap v209: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:06:37.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:37 smithi130 ceph-mon[26123]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:06:37.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:37 smithi007 ceph-mon[25091]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:06:37.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:37 smithi007 ceph-mon[29879]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:06:38.512 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:38 smithi130 ceph-mon[26123]: pgmap v210: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:06:38.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:38 smithi007 ceph-mon[25091]: pgmap v210: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:06:38.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:38 smithi007 ceph-mon[29879]: pgmap v210: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:06:39.431 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:06:39 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 172.21.15.7 - - [18/Jun/2024:02:06:39] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-06-18T02:06:40.289 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:40 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:06:40.289 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:40 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:06:40.290 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:40 smithi130 ceph-mon[26123]: pgmap v211: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:06:40.431 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:06:40 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:06:40] "GET /metrics HTTP/1.1" 200 214878 "" "Prometheus/2.33.4" 2024-06-18T02:06:40.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:40 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:06:40.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:40 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:06:40.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:40 smithi007 ceph-mon[25091]: pgmap v211: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:06:40.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:40 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:06:40.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:40 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:06:40.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:40 smithi007 ceph-mon[29879]: pgmap v211: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:06:41.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:41 smithi007 ceph-mon[25091]: Upgrade: Updating mgr.x 2024-06-18T02:06:41.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:41 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:06:41.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:41 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-18T02:06:41.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:41 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-18T02:06:41.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:41 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:06:41.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:41 smithi007 ceph-mon[25091]: Deploying daemon mgr.x on smithi130 2024-06-18T02:06:41.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:41 smithi007 ceph-mon[25091]: pgmap v212: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:06:41.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:41 smithi007 ceph-mon[29879]: Upgrade: Updating mgr.x 2024-06-18T02:06:41.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:41 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:06:41.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:41 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-18T02:06:41.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:41 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-18T02:06:41.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:41 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:06:41.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:41 smithi007 ceph-mon[29879]: Deploying daemon mgr.x on smithi130 2024-06-18T02:06:41.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:41 smithi007 ceph-mon[29879]: pgmap v212: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:06:42.030 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:41 smithi130 ceph-mon[26123]: Upgrade: Updating mgr.x 2024-06-18T02:06:42.031 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:41 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:06:42.031 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:41 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-18T02:06:42.031 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:41 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-18T02:06:42.031 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:41 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:06:42.031 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:41 smithi130 ceph-mon[26123]: Deploying daemon mgr.x on smithi130 2024-06-18T02:06:42.031 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:41 smithi130 ceph-mon[26123]: pgmap v212: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:06:42.717 INFO:teuthology.orchestra.run.smithi007.stdout:true 2024-06-18T02:06:43.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:43 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[27664]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:06:43] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-06-18T02:06:43.326 INFO:teuthology.orchestra.run.smithi007.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-18T02:06:43.326 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi007 smithi007 running 4s ago 9m - - 2024-06-18T02:06:43.326 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi130 smithi130 running 16s ago 9m - - 2024-06-18T02:06:43.327 INFO:teuthology.orchestra.run.smithi007.stdout:alertmanager.a smithi007 *:9093,9094 running (4m) 4s ago 4m 27.9M - ba2b418f427c 8a3093399f5a 2024-06-18T02:06:43.327 INFO:teuthology.orchestra.run.smithi007.stdout:grafana.a smithi130 *:3000 running (4m) 16s ago 4m 55.4M - 8.3.5 dad864ee21e9 b39a3781d434 2024-06-18T02:06:43.327 INFO:teuthology.orchestra.run.smithi007.stdout:iscsi.foo.smithi007.xvdrwd smithi007 running (3m) 4s ago 3m 48.7M - 3.5 e1d6a67b021e da0b75a0afdc 2024-06-18T02:06:43.327 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.x smithi130 *:8443 running (9m) 16s ago 9m 412M - 17.2.0 e1d6a67b021e 02d55b2b38c8 2024-06-18T02:06:43.327 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.y smithi007 *:9283 running (10m) 4s ago 10m 466M - 17.2.0 e1d6a67b021e 78a1afd0bddd 2024-06-18T02:06:43.327 INFO:teuthology.orchestra.run.smithi007.stdout:mon.a smithi007 running (10m) 4s ago 11m 53.3M 2048M 17.2.0 e1d6a67b021e 147f3ea02ae3 2024-06-18T02:06:43.327 INFO:teuthology.orchestra.run.smithi007.stdout:mon.b smithi130 running (9m) 16s ago 9m 41.2M 2048M 17.2.0 e1d6a67b021e a0b38a9a595f 2024-06-18T02:06:43.327 INFO:teuthology.orchestra.run.smithi007.stdout:mon.c smithi007 running (9m) 4s ago 9m 40.4M 2048M 17.2.0 e1d6a67b021e 1d1e2628656b 2024-06-18T02:06:43.327 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.a smithi007 *:9100 running (5m) 4s ago 5m 16.5M - 1dbe0e931976 68ab68346698 2024-06-18T02:06:43.327 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.b smithi130 *:9100 running (5m) 16s ago 5m 16.0M - 1dbe0e931976 02601fb28ea2 2024-06-18T02:06:43.327 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0 smithi007 running (8m) 4s ago 8m 52.9M 4096M 17.2.0 e1d6a67b021e 1ef6e23afd55 2024-06-18T02:06:43.327 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1 smithi007 running (8m) 4s ago 8m 53.6M 4096M 17.2.0 e1d6a67b021e a967706523cb 2024-06-18T02:06:43.327 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2 smithi007 running (8m) 4s ago 8m 47.8M 4096M 17.2.0 e1d6a67b021e 2c1b76bd0876 2024-06-18T02:06:43.328 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3 smithi007 running (7m) 4s ago 7m 51.7M 4096M 17.2.0 e1d6a67b021e 8b91b2a07564 2024-06-18T02:06:43.328 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4 smithi130 running (7m) 16s ago 7m 53.7M 4096M 17.2.0 e1d6a67b021e c428dccffdf0 2024-06-18T02:06:43.328 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5 smithi130 running (6m) 16s ago 6m 52.5M 4096M 17.2.0 e1d6a67b021e f645d7f12378 2024-06-18T02:06:43.328 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6 smithi130 running (6m) 16s ago 6m 47.9M 4096M 17.2.0 e1d6a67b021e c7af86c14959 2024-06-18T02:06:43.328 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7 smithi130 running (5m) 16s ago 5m 51.4M 4096M 17.2.0 e1d6a67b021e 3688af8b2c46 2024-06-18T02:06:43.328 INFO:teuthology.orchestra.run.smithi007.stdout:prometheus.a smithi130 *:9095 running (4m) 16s ago 5m 68.0M - 514e6a882f6e 5b12ac431abe 2024-06-18T02:06:43.328 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi007.dvbvbk smithi007 *:8000 running (3m) 4s ago 3m 73.3M - 17.2.0 e1d6a67b021e 1344b55b763c 2024-06-18T02:06:43.328 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi130.aakmof smithi130 *:8000 running (3m) 16s ago 3m 71.4M - 17.2.0 e1d6a67b021e e257e3230c6c 2024-06-18T02:06:43.328 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi007.hgrnmk smithi007 *:80 running (3m) 4s ago 3m 71.9M - 17.2.0 e1d6a67b021e 2173947bc4d6 2024-06-18T02:06:43.328 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi130.wwebfk smithi130 *:80 running (3m) 16s ago 3m 73.2M - 17.2.0 e1d6a67b021e 8662706b2231 2024-06-18T02:06:43.629 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:06:43 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=error ts=2024-06-18T02:06:43.516Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=7 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.130:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.130 because it doesn't contain any IP SANs; ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://172.21.15.7:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.7 because it doesn't contain any IP SANs" 2024-06-18T02:06:43.629 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:06:43 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=warn ts=2024-06-18T02:06:43.518Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.130:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.130 because it doesn't contain any IP SANs" 2024-06-18T02:06:43.630 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:06:43 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=warn ts=2024-06-18T02:06:43.518Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.7:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.7 because it doesn't contain any IP SANs" 2024-06-18T02:06:43.693 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:06:43.693 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": { 2024-06-18T02:06:43.693 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-06-18T02:06:43.693 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:06:43.693 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": { 2024-06-18T02:06:43.693 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2 2024-06-18T02:06:43.693 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:06:43.693 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": { 2024-06-18T02:06:43.693 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-06-18T02:06:43.693 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:06:43.693 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": {}, 2024-06-18T02:06:43.694 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw": { 2024-06-18T02:06:43.694 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-06-18T02:06:43.694 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:06:43.694 INFO:teuthology.orchestra.run.smithi007.stdout: "overall": { 2024-06-18T02:06:43.694 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 17 2024-06-18T02:06:43.694 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-06-18T02:06:43.694 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:06:43.948 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:43 smithi130 systemd[1]: Stopping Ceph mgr.x for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:06:43.949 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:43 smithi130 bash[51675]: Error: no container with name or ID "ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr.x" found: no such container 2024-06-18T02:06:44.014 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:06:44.014 INFO:teuthology.orchestra.run.smithi007.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00", 2024-06-18T02:06:44.014 INFO:teuthology.orchestra.run.smithi007.stdout: "in_progress": true, 2024-06-18T02:06:44.014 INFO:teuthology.orchestra.run.smithi007.stdout: "services_complete": [], 2024-06-18T02:06:44.014 INFO:teuthology.orchestra.run.smithi007.stdout: "progress": "0/23 daemons upgraded", 2024-06-18T02:06:44.014 INFO:teuthology.orchestra.run.smithi007.stdout: "message": "Currently upgrading mgr daemons" 2024-06-18T02:06:44.014 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:06:44.214 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:43 smithi130 podman[51686]: 2024-06-18 02:06:43.948893498 +0000 UTC m=+0.164630484 container died 02d55b2b38c8863174cdafffac90f3d4cc878e54a950a52f63c36629c195b031 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, distribution-scope=public, CEPH_POINT_RELEASE=-17.2.0, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., GIT_BRANCH=HEAD, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, release=754, vcs-type=git, io.buildah.version=1.19.8, io.k8s.display-name=CentOS Stream 8, build-date=2022-05-03T08:36:31.336870, architecture=x86_64, version=8, name=centos-stream, GIT_REPO=https://github.com/ceph/ceph-container.git, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, RELEASE=HEAD, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, vendor=Red Hat, Inc., io.openshift.expose-services=, GIT_CLEAN=True, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, ceph=True, maintainer=Guillaume Abrioux , description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, com.redhat.component=centos-stream-container, io.openshift.tags=base centos centos-stream, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754) 2024-06-18T02:06:44.385 INFO:teuthology.orchestra.run.smithi007.stdout:HEALTH_OK 2024-06-18T02:06:44.466 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:44 smithi007 ceph-mon[25091]: from='client.25048 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:06:44.466 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:44 smithi007 ceph-mon[25091]: from='client.25054 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:06:44.466 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:44 smithi007 ceph-mon[25091]: pgmap v213: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:06:44.466 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:44 smithi007 ceph-mon[25091]: from='client.25060 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:06:44.466 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:44 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/719379802' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:06:44.467 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:44 smithi007 ceph-mon[29879]: from='client.25048 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:06:44.467 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:44 smithi007 ceph-mon[29879]: from='client.25054 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:06:44.467 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:44 smithi007 ceph-mon[29879]: pgmap v213: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:06:44.467 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:44 smithi007 ceph-mon[29879]: from='client.25060 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:06:44.467 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:44 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/719379802' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:06:44.467 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:06:44 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=warn ts=2024-06-18T02:06:44.212Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=2 err="Post \"https://172.21.15.130:8443/api/prometheus_receiver\": dial tcp 172.21.15.130:8443: connect: connection refused" 2024-06-18T02:06:44.494 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:44 smithi130 ceph-mon[26123]: from='client.25048 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:06:44.494 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:44 smithi130 ceph-mon[26123]: from='client.25054 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:06:44.494 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:44 smithi130 ceph-mon[26123]: pgmap v213: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:06:44.495 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:44 smithi130 ceph-mon[26123]: from='client.25060 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:06:44.495 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:44 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/719379802' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:06:44.495 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:44 smithi130 podman[51686]: 2024-06-18 02:06:44.294634645 +0000 UTC m=+0.510371587 container cleanup 02d55b2b38c8863174cdafffac90f3d4cc878e54a950a52f63c36629c195b031 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x, io.openshift.tags=base centos centos-stream, maintainer=Guillaume Abrioux , architecture=x86_64, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, name=centos-stream, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, distribution-scope=public, com.redhat.component=centos-stream-container, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.k8s.display-name=CentOS Stream 8, build-date=2022-05-03T08:36:31.336870, RELEASE=HEAD, io.openshift.expose-services=, GIT_BRANCH=HEAD, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, CEPH_POINT_RELEASE=-17.2.0, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, vendor=Red Hat, Inc., version=8, vcs-type=git, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.buildah.version=1.19.8, release=754, GIT_CLEAN=True, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True) 2024-06-18T02:06:44.495 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:44 smithi130 bash[51686]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x 2024-06-18T02:06:44.795 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:44 smithi130 podman[51700]: 2024-06-18 02:06:44.495908412 +0000 UTC m=+0.538276683 container remove 02d55b2b38c8863174cdafffac90f3d4cc878e54a950a52f63c36629c195b031 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., release=754, com.redhat.component=centos-stream-container, vcs-type=git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, architecture=x86_64, io.openshift.expose-services=, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, name=centos-stream, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, RELEASE=HEAD, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, distribution-scope=public, io.buildah.version=1.19.8, ceph=True, vendor=Red Hat, Inc., io.k8s.display-name=CentOS Stream 8, GIT_REPO=https://github.com/ceph/ceph-container.git, io.openshift.tags=base centos centos-stream, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, version=8, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, GIT_CLEAN=True, build-date=2022-05-03T08:36:31.336870, CEPH_POINT_RELEASE=-17.2.0) 2024-06-18T02:06:44.795 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:44 smithi130 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mgr.x.service: Main process exited, code=exited, status=143/n/a 2024-06-18T02:06:44.795 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:44 smithi130 bash[51727]: Error: no container with name or ID "ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr.x" found: no such container 2024-06-18T02:06:44.795 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:44 smithi130 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mgr.x.service: Failed with result 'exit-code'. 2024-06-18T02:06:44.795 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:44 smithi130 systemd[1]: Stopped Ceph mgr.x for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:06:44.795 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:44 smithi130 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mgr.x.service: Consumed 17.259s CPU time. 2024-06-18T02:06:44.795 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:44 smithi130 systemd[1]: Starting Ceph mgr.x for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:06:45.207 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:44 smithi130 podman[51867]: 2024-06-18 02:06:44.857974105 +0000 UTC m=+0.019075369 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:06:45.207 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:44 smithi130 podman[51867]: 2024-06-18 02:06:44.97273702 +0000 UTC m=+0.133838274 container create a297d5406893f70868773fe6ae699ec3dd47479d94f7b068c83d2c3a9d0e24ff (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240612, RELEASE=squid-3781e3a, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-18T02:06:45.390 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:45 smithi007 ceph-mon[25091]: from='client.15162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:06:45.390 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:45 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/1270507183' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:06:45.390 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:45 smithi007 ceph-mon[29879]: from='client.15162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:06:45.391 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:45 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/1270507183' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:06:45.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:45 smithi130 ceph-mon[26123]: from='client.15162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:06:45.516 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:45 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/1270507183' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:06:45.516 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:45 smithi130 podman[51867]: 2024-06-18 02:06:45.208531737 +0000 UTC m=+0.369633003 container init a297d5406893f70868773fe6ae699ec3dd47479d94f7b068c83d2c3a9d0e24ff (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-3781e3a, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240612, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.vendor=CentOS) 2024-06-18T02:06:45.516 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:45 smithi130 podman[51867]: 2024-06-18 02:06:45.211680906 +0000 UTC m=+0.372782166 container start a297d5406893f70868773fe6ae699ec3dd47479d94f7b068c83d2c3a9d0e24ff (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240612, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-3781e3a, CEPH_POINT_RELEASE=, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-06-18T02:06:45.516 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:45 smithi130 ceph-mgr[51920]: -- 172.21.15.130:0/2231051416 <== mon.2 v2:172.21.15.130:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5627459c50e0 con 0x5627459a3000 2024-06-18T02:06:45.516 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:45 smithi130 bash[51867]: a297d5406893f70868773fe6ae699ec3dd47479d94f7b068c83d2c3a9d0e24ff 2024-06-18T02:06:45.516 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:45 smithi130 systemd[1]: Started Ceph mgr.x for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:06:45.516 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:45 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: 2024-06-18T02:06:45.340+0000 7f6cb62cc040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-18T02:06:45.516 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:45 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: 2024-06-18T02:06:45.516+0000 7f6cb62cc040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-18T02:06:45.793 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:45 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: 2024-06-18T02:06:45.604+0000 7f6cb62cc040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-18T02:06:46.169 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:45 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: 2024-06-18T02:06:45.873+0000 7f6cb62cc040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-18T02:06:46.169 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:45 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: 2024-06-18T02:06:45.936+0000 7f6cb62cc040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-18T02:06:46.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:46 smithi130 ceph-mon[26123]: pgmap v214: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:06:46.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:46 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:06:46.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:46 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:06:46.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:46 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:06:46.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:46 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:06:46.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:46 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:06:46.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:46 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:06:46.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:46 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-06-18T02:06:46.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:46 smithi130 ceph-mon[26123]: osdmap e97: 8 total, 8 up, 8 in 2024-06-18T02:06:46.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:46 smithi130 ceph-mon[26123]: Standby manager daemon y started 2024-06-18T02:06:46.550 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:46 smithi007 ceph-mon[25091]: pgmap v214: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:06:46.550 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:46 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:06:46.550 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:46 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:06:46.550 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:46 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:06:46.550 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:46 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:06:46.550 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:46 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:06:46.550 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:46 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:06:46.551 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:46 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-06-18T02:06:46.551 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:46 smithi007 ceph-mon[25091]: osdmap e97: 8 total, 8 up, 8 in 2024-06-18T02:06:46.551 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:46 smithi007 ceph-mon[25091]: Standby manager daemon y started 2024-06-18T02:06:46.551 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:46 smithi007 ceph-mon[29879]: pgmap v214: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:06:46.551 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:46 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:06:46.551 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:46 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:06:46.551 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:46 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:06:46.551 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:46 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:06:46.551 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:46 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' 2024-06-18T02:06:46.551 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:46 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:06:46.551 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:46 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-06-18T02:06:46.551 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:46 smithi007 ceph-mon[29879]: osdmap e97: 8 total, 8 up, 8 in 2024-06-18T02:06:46.551 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:46 smithi007 ceph-mon[29879]: Standby manager daemon y started 2024-06-18T02:06:46.833 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:06:46 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: ignoring --setuser ceph since I am not root 2024-06-18T02:06:46.834 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:06:46 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: ignoring --setgroup ceph since I am not root 2024-06-18T02:06:46.834 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:06:46 smithi007 ceph-mgr[25326]: -- 172.21.15.7:0/42508261 <== mon.0 v2:172.21.15.7:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e6fec0e340 con 0x55e6febe7000 2024-06-18T02:06:46.834 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:06:46 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T02:06:46.833+0000 7fa3d0d0f000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-18T02:06:47.181 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:06:46 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T02:06:46.970+0000 7fa3d0d0f000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-18T02:06:47.181 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:06:47 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T02:06:47.073+0000 7fa3d0d0f000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-18T02:06:47.294 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:46 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: 2024-06-18T02:06:46.943+0000 7f6cb62cc040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-18T02:06:47.294 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:47 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: 2024-06-18T02:06:47.061+0000 7f6cb62cc040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-18T02:06:47.294 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:47 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: 2024-06-18T02:06:47.147+0000 7f6cb62cc040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-18T02:06:47.681 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:06:47 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T02:06:47.394+0000 7fa3d0d0f000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-18T02:06:47.682 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:06:47 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T02:06:47.480+0000 7fa3d0d0f000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-18T02:06:47.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:47 smithi007 ceph-mon[25091]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:06:47.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:47 smithi007 ceph-mon[25091]: Upgrade: Need to upgrade myself (mgr.y) 2024-06-18T02:06:47.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:47 smithi007 ceph-mon[25091]: Failing over to other MGR 2024-06-18T02:06:47.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:47 smithi007 ceph-mon[25091]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:06:47.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:47 smithi007 ceph-mon[25091]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2024-06-18T02:06:47.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:47 smithi007 ceph-mon[25091]: mgrmap e22: x(active, starting, since 1.00174s), standbys: y 2024-06-18T02:06:47.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:47 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:06:47.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:47 smithi007 ceph-mon[29879]: Upgrade: Need to upgrade myself (mgr.y) 2024-06-18T02:06:47.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:47 smithi007 ceph-mon[29879]: Failing over to other MGR 2024-06-18T02:06:47.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:47 smithi007 ceph-mon[29879]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:06:47.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:47 smithi007 ceph-mon[29879]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2024-06-18T02:06:47.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:47 smithi007 ceph-mon[29879]: mgrmap e22: x(active, starting, since 1.00174s), standbys: y 2024-06-18T02:06:47.693 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:47 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:06:47.693 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:47 smithi130 ceph-mon[26123]: Upgrade: Need to upgrade myself (mgr.y) 2024-06-18T02:06:47.693 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:47 smithi130 ceph-mon[26123]: Failing over to other MGR 2024-06-18T02:06:47.693 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:47 smithi130 ceph-mon[26123]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:06:47.693 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:47 smithi130 ceph-mon[26123]: from='mgr.14430 172.21.15.7:0/506224897' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2024-06-18T02:06:47.693 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:47 smithi130 ceph-mon[26123]: mgrmap e22: x(active, starting, since 1.00174s), standbys: y 2024-06-18T02:06:47.693 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:47 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: 2024-06-18T02:06:47.402+0000 7f6cb62cc040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-18T02:06:47.694 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:47 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: 2024-06-18T02:06:47.465+0000 7f6cb62cc040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-18T02:06:47.694 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:47 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: 2024-06-18T02:06:47.535+0000 7f6cb62cc040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-18T02:06:47.694 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:47 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: 2024-06-18T02:06:47.693+0000 7f6cb62cc040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-18T02:06:48.323 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:48 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: 2024-06-18T02:06:48.146+0000 7f6cb62cc040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-18T02:06:48.431 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:06:48 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=warn ts=2024-06-18T02:06:48.009Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=5 err="Post \"https://172.21.15.7:8443//api/prometheus_receiver\": dial tcp 172.21.15.7:8443: connect: connection refused" 2024-06-18T02:06:48.590 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:48 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: 2024-06-18T02:06:48.483+0000 7f6cb62cc040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-18T02:06:48.590 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:48 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: 2024-06-18T02:06:48.551+0000 7f6cb62cc040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-18T02:06:48.929 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:06:48 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T02:06:48.669+0000 7fa3d0d0f000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-18T02:06:48.929 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:06:48 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T02:06:48.843+0000 7fa3d0d0f000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-18T02:06:48.929 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:06:48 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T02:06:48.929+0000 7fa3d0d0f000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-18T02:06:49.038 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:48 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: 2024-06-18T02:06:48.707+0000 7f6cb62cc040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-18T02:06:49.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:49 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: 2024-06-18T02:06:49.038+0000 7f6cb62cc040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-18T02:06:49.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:49 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: 2024-06-18T02:06:49.117+0000 7f6cb62cc040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-18T02:06:49.662 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:49 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: 2024-06-18T02:06:49.312+0000 7f6cb62cc040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-18T02:06:49.662 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:49 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: 2024-06-18T02:06:49.464+0000 7f6cb62cc040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-18T02:06:49.662 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:49 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: 2024-06-18T02:06:49.541+0000 7f6cb62cc040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-18T02:06:49.663 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:49 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: 2024-06-18T02:06:49.663+0000 7f6cb62cc040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-18T02:06:49.681 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:06:49 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T02:06:49.255+0000 7fa3d0d0f000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-18T02:06:49.682 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:06:49 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T02:06:49.350+0000 7fa3d0d0f000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-18T02:06:49.682 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:06:49 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T02:06:49.447+0000 7fa3d0d0f000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-18T02:06:50.043 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:49 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: 2024-06-18T02:06:49.725+0000 7f6cb62cc040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-18T02:06:50.166 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:06:49 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T02:06:49.701+0000 7fa3d0d0f000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-18T02:06:50.431 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:06:50 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T02:06:50.166+0000 7fa3d0d0f000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-18T02:06:50.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:50 smithi130 ceph-mon[26123]: Active manager daemon x restarted 2024-06-18T02:06:50.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:50 smithi130 ceph-mon[26123]: Activating manager daemon x 2024-06-18T02:06:50.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:50 smithi130 ceph-mon[26123]: from='mgr.? 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-06-18T02:06:50.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:50 smithi130 ceph-mon[26123]: osdmap e98: 8 total, 8 up, 8 in 2024-06-18T02:06:50.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:50 smithi130 ceph-mon[26123]: from='mgr.? 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-18T02:06:50.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:50 smithi130 ceph-mon[26123]: from='mgr.? 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-06-18T02:06:50.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:50 smithi130 ceph-mon[26123]: from='mgr.? 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-18T02:06:50.544 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: 2024-06-18T02:06:50.292+0000 7f6cb62cc040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-18T02:06:50.544 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: 2024-06-18T02:06:50.459+0000 7f6cb62cc040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-18T02:06:50.544 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: [18/Jun/2024:02:06:50] ENGINE Bus STARTING 2024-06-18T02:06:50.544 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: CherryPy Checker: 2024-06-18T02:06:50.544 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: The Application mounted at '' has an empty config. 2024-06-18T02:06:50.544 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: 2024-06-18T02:06:50.780 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:06:50 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T02:06:50.682+0000 7fa3d0d0f000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-18T02:06:50.780 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:50 smithi007 ceph-mon[25091]: Active manager daemon x restarted 2024-06-18T02:06:50.780 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:50 smithi007 ceph-mon[25091]: Activating manager daemon x 2024-06-18T02:06:50.780 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:50 smithi007 ceph-mon[25091]: from='mgr.? 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-06-18T02:06:50.781 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:50 smithi007 ceph-mon[25091]: osdmap e98: 8 total, 8 up, 8 in 2024-06-18T02:06:50.781 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:50 smithi007 ceph-mon[25091]: from='mgr.? 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-18T02:06:50.781 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:50 smithi007 ceph-mon[25091]: from='mgr.? 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-06-18T02:06:50.781 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:50 smithi007 ceph-mon[25091]: from='mgr.? 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-18T02:06:50.781 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:50 smithi007 ceph-mon[29879]: Active manager daemon x restarted 2024-06-18T02:06:50.781 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:50 smithi007 ceph-mon[29879]: Activating manager daemon x 2024-06-18T02:06:50.781 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:50 smithi007 ceph-mon[29879]: from='mgr.? 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-06-18T02:06:50.781 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:50 smithi007 ceph-mon[29879]: osdmap e98: 8 total, 8 up, 8 in 2024-06-18T02:06:50.781 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:50 smithi007 ceph-mon[29879]: from='mgr.? 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-18T02:06:50.782 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:50 smithi007 ceph-mon[29879]: from='mgr.? 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-06-18T02:06:50.782 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:50 smithi007 ceph-mon[29879]: from='mgr.? 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-18T02:06:51.043 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: [18/Jun/2024:02:06:50] ENGINE Serving on http://:::9283 2024-06-18T02:06:51.043 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: [18/Jun/2024:02:06:50] ENGINE Bus STARTED 2024-06-18T02:06:51.043 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: [18/Jun/2024:02:06:50] ENGINE Bus STOPPING 2024-06-18T02:06:51.093 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:06:50 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T02:06:50.780+0000 7fa3d0d0f000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-18T02:06:51.352 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T02:06:51.093+0000 7fa3d0d0f000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-18T02:06:51.352 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T02:06:51.190+0000 7fa3d0d0f000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-18T02:06:51.407 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:51 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: [18/Jun/2024:02:06:51] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-06-18T02:06:51.407 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:51 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: [18/Jun/2024:02:06:51] ENGINE Bus STOPPED 2024-06-18T02:06:51.407 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:51 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: [18/Jun/2024:02:06:51] ENGINE Bus STARTING 2024-06-18T02:06:51.407 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:51 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: [18/Jun/2024:02:06:51] ENGINE Serving on http://:::9283 2024-06-18T02:06:51.407 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:51 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: [18/Jun/2024:02:06:51] ENGINE Bus STARTED 2024-06-18T02:06:51.619 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[25091]: mgrmap e23: x(active, starting, since 0.0580013s), standbys: y 2024-06-18T02:06:51.619 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[25091]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-18T02:06:51.620 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[25091]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-18T02:06:51.620 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[25091]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-18T02:06:51.620 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[25091]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-06-18T02:06:51.620 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[25091]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-06-18T02:06:51.620 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[25091]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-18T02:06:51.620 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[25091]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-18T02:06:51.620 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[25091]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-18T02:06:51.620 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[25091]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-18T02:06:51.620 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[25091]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-18T02:06:51.620 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[25091]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-18T02:06:51.620 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[25091]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-18T02:06:51.620 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[25091]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-18T02:06:51.620 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[25091]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-18T02:06:51.620 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[25091]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-18T02:06:51.620 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[25091]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-18T02:06:51.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[25091]: Manager daemon x is now available 2024-06-18T02:06:51.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:51.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[25091]: Queued rgw.foo for migration 2024-06-18T02:06:51.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:51.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[25091]: Queued rgw.smpl for migration 2024-06-18T02:06:51.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[25091]: No Migration is needed for rgw spec: {'placement': {'count': 2}, 'service_id': 'foo', 'service_name': 'rgw.foo', 'service_type': 'rgw', 'spec': {'rgw_frontend_port': 8000, 'rgw_realm': 'r', 'rgw_zone': 'z'}} 2024-06-18T02:06:51.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[25091]: No Migration is needed for rgw spec: {'placement': {'count': 2}, 'service_id': 'smpl', 'service_name': 'rgw.smpl', 'service_type': 'rgw'} 2024-06-18T02:06:51.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:51.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:51.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[25091]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi007", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:06:51.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[25091]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi130", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:06:51.622 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[29879]: mgrmap e23: x(active, starting, since 0.0580013s), standbys: y 2024-06-18T02:06:51.622 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[29879]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-18T02:06:51.622 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[29879]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-18T02:06:51.622 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[29879]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-18T02:06:51.622 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[29879]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-06-18T02:06:51.622 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[29879]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-06-18T02:06:51.622 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[29879]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-18T02:06:51.622 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[29879]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-18T02:06:51.623 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[29879]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-18T02:06:51.623 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[29879]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-18T02:06:51.623 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[29879]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-18T02:06:51.623 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[29879]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-18T02:06:51.623 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[29879]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-18T02:06:51.623 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[29879]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-18T02:06:51.623 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[29879]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-18T02:06:51.623 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[29879]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-18T02:06:51.623 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[29879]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-18T02:06:51.623 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[29879]: Manager daemon x is now available 2024-06-18T02:06:51.623 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:51.623 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[29879]: Queued rgw.foo for migration 2024-06-18T02:06:51.623 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:51.623 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[29879]: Queued rgw.smpl for migration 2024-06-18T02:06:51.624 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[29879]: No Migration is needed for rgw spec: {'placement': {'count': 2}, 'service_id': 'foo', 'service_name': 'rgw.foo', 'service_type': 'rgw', 'spec': {'rgw_frontend_port': 8000, 'rgw_realm': 'r', 'rgw_zone': 'z'}} 2024-06-18T02:06:51.624 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[29879]: No Migration is needed for rgw spec: {'placement': {'count': 2}, 'service_id': 'smpl', 'service_name': 'rgw.smpl', 'service_type': 'rgw'} 2024-06-18T02:06:51.624 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:51.624 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:51.624 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[29879]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi007", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:06:51.624 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[29879]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi130", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:06:51.624 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi007", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:06:51.624 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi130", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:06:51.625 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[29879]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:06:51.625 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[29879]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:06:51.625 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[29879]: Updating smithi007:/etc/ceph/ceph.conf 2024-06-18T02:06:51.625 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[29879]: Updating smithi130:/etc/ceph/ceph.conf 2024-06-18T02:06:51.625 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[29879]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:06:51.625 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[29879]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-06-18T02:06:51.626 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-06-18T02:06:51.626 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[29879]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-06-18T02:06:51.626 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-06-18T02:06:51.626 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi007", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:06:51.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi130", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:06:51.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[25091]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:06:51.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[25091]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:06:51.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[25091]: Updating smithi007:/etc/ceph/ceph.conf 2024-06-18T02:06:51.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[25091]: Updating smithi130:/etc/ceph/ceph.conf 2024-06-18T02:06:51.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[25091]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:06:51.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[25091]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-06-18T02:06:51.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-06-18T02:06:51.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[25091]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-06-18T02:06:51.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-06-18T02:06:51.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:51 smithi130 ceph-mon[26123]: mgrmap e23: x(active, starting, since 0.0580013s), standbys: y 2024-06-18T02:06:51.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:51 smithi130 ceph-mon[26123]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-18T02:06:51.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:51 smithi130 ceph-mon[26123]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-18T02:06:51.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:51 smithi130 ceph-mon[26123]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-18T02:06:51.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:51 smithi130 ceph-mon[26123]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-06-18T02:06:51.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:51 smithi130 ceph-mon[26123]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-06-18T02:06:51.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:51 smithi130 ceph-mon[26123]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-18T02:06:51.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:51 smithi130 ceph-mon[26123]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-18T02:06:51.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:51 smithi130 ceph-mon[26123]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-18T02:06:51.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:51 smithi130 ceph-mon[26123]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-18T02:06:51.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:51 smithi130 ceph-mon[26123]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-18T02:06:51.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:51 smithi130 ceph-mon[26123]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-18T02:06:51.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:51 smithi130 ceph-mon[26123]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-18T02:06:51.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:51 smithi130 ceph-mon[26123]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-18T02:06:51.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:51 smithi130 ceph-mon[26123]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-18T02:06:51.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:51 smithi130 ceph-mon[26123]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-18T02:06:51.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:51 smithi130 ceph-mon[26123]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-18T02:06:51.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:51 smithi130 ceph-mon[26123]: Manager daemon x is now available 2024-06-18T02:06:51.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:51 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:51.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:51 smithi130 ceph-mon[26123]: Queued rgw.foo for migration 2024-06-18T02:06:51.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:51 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:51.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:51 smithi130 ceph-mon[26123]: Queued rgw.smpl for migration 2024-06-18T02:06:51.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:51 smithi130 ceph-mon[26123]: No Migration is needed for rgw spec: {'placement': {'count': 2}, 'service_id': 'foo', 'service_name': 'rgw.foo', 'service_type': 'rgw', 'spec': {'rgw_frontend_port': 8000, 'rgw_realm': 'r', 'rgw_zone': 'z'}} 2024-06-18T02:06:51.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:51 smithi130 ceph-mon[26123]: No Migration is needed for rgw spec: {'placement': {'count': 2}, 'service_id': 'smpl', 'service_name': 'rgw.smpl', 'service_type': 'rgw'} 2024-06-18T02:06:51.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:51 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:51.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:51 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:51.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:51 smithi130 ceph-mon[26123]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi007", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:06:51.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:51 smithi130 ceph-mon[26123]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi130", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:06:51.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:51 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi007", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:06:51.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:51 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi130", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:06:51.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:51 smithi130 ceph-mon[26123]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:06:51.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:51 smithi130 ceph-mon[26123]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:06:51.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:51 smithi130 ceph-mon[26123]: Updating smithi007:/etc/ceph/ceph.conf 2024-06-18T02:06:51.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:51 smithi130 ceph-mon[26123]: Updating smithi130:/etc/ceph/ceph.conf 2024-06-18T02:06:51.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:51 smithi130 ceph-mon[26123]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:06:51.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:51 smithi130 ceph-mon[26123]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-06-18T02:06:51.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:51 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-06-18T02:06:51.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:51 smithi130 ceph-mon[26123]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-06-18T02:06:51.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:51 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-06-18T02:06:51.875 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T02:06:51.618+0000 7fa3d0d0f000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-18T02:06:51.875 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T02:06:51.770+0000 7fa3d0d0f000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-18T02:06:52.181 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:06:51 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T02:06:51.875+0000 7fa3d0d0f000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-18T02:06:52.181 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:06:52 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T02:06:52.000+0000 7fa3d0d0f000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-18T02:06:52.182 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:06:52 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T02:06:52.098+0000 7fa3d0d0f000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-18T02:06:53.041 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:52 smithi130 ceph-mon[26123]: Updating smithi007:/var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/config/ceph.conf 2024-06-18T02:06:53.042 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:52 smithi130 ceph-mon[26123]: Updating smithi130:/var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/config/ceph.conf 2024-06-18T02:06:53.042 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:52 smithi130 ceph-mon[26123]: mgrmap e24: x(active, since 1.30135s), standbys: y 2024-06-18T02:06:53.042 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:52 smithi130 ceph-mon[26123]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:06:53.042 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:52 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:53.042 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:52 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:53.042 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:52 smithi130 ceph-mon[26123]: Updating smithi130:/etc/ceph/ceph.client.admin.keyring 2024-06-18T02:06:53.042 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:52 smithi130 ceph-mon[26123]: Updating smithi007:/etc/ceph/ceph.client.admin.keyring 2024-06-18T02:06:53.042 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:52 smithi130 ceph-mon[26123]: Updating smithi130:/var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/config/ceph.client.admin.keyring 2024-06-18T02:06:53.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:52 smithi130 ceph-mon[26123]: Updating smithi007:/var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/config/ceph.client.admin.keyring 2024-06-18T02:06:53.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:52 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:53.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:52 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:53.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:52 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:53.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:52 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:53.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:52 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:53.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:52 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:53.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:52 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:53.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:52 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:53.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:52 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:53.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:52 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:53.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:52 smithi130 ceph-mon[26123]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi007", "caps": []}]: dispatch 2024-06-18T02:06:53.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:52 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi007", "caps": []}]: dispatch 2024-06-18T02:06:53.086 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:06:52 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T02:06:52.709+0000 7fa3d0d0f000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-18T02:06:53.086 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:52 smithi007 ceph-mon[29879]: Updating smithi007:/var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/config/ceph.conf 2024-06-18T02:06:53.087 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:52 smithi007 ceph-mon[29879]: Updating smithi130:/var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/config/ceph.conf 2024-06-18T02:06:53.087 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:52 smithi007 ceph-mon[29879]: mgrmap e24: x(active, since 1.30135s), standbys: y 2024-06-18T02:06:53.087 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:52 smithi007 ceph-mon[29879]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:06:53.087 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:52 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:53.087 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:52 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:53.087 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:52 smithi007 ceph-mon[29879]: Updating smithi130:/etc/ceph/ceph.client.admin.keyring 2024-06-18T02:06:53.087 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:52 smithi007 ceph-mon[29879]: Updating smithi007:/etc/ceph/ceph.client.admin.keyring 2024-06-18T02:06:53.087 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:52 smithi007 ceph-mon[29879]: Updating smithi130:/var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/config/ceph.client.admin.keyring 2024-06-18T02:06:53.087 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:52 smithi007 ceph-mon[29879]: Updating smithi007:/var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/config/ceph.client.admin.keyring 2024-06-18T02:06:53.087 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:52 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:53.087 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:52 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:53.087 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:52 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:53.087 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:52 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:53.088 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:52 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:53.088 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:52 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:53.088 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:52 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:53.088 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:52 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:53.088 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:52 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:53.088 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:52 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:53.088 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:52 smithi007 ceph-mon[29879]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi007", "caps": []}]: dispatch 2024-06-18T02:06:53.088 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:52 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi007", "caps": []}]: dispatch 2024-06-18T02:06:53.088 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:52 smithi007 ceph-mon[25091]: Updating smithi007:/var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/config/ceph.conf 2024-06-18T02:06:53.088 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:52 smithi007 ceph-mon[25091]: Updating smithi130:/var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/config/ceph.conf 2024-06-18T02:06:53.088 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:52 smithi007 ceph-mon[25091]: mgrmap e24: x(active, since 1.30135s), standbys: y 2024-06-18T02:06:53.088 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:52 smithi007 ceph-mon[25091]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:06:53.088 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:52 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:53.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:52 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:53.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:52 smithi007 ceph-mon[25091]: Updating smithi130:/etc/ceph/ceph.client.admin.keyring 2024-06-18T02:06:53.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:52 smithi007 ceph-mon[25091]: Updating smithi007:/etc/ceph/ceph.client.admin.keyring 2024-06-18T02:06:53.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:52 smithi007 ceph-mon[25091]: Updating smithi130:/var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/config/ceph.client.admin.keyring 2024-06-18T02:06:53.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:52 smithi007 ceph-mon[25091]: Updating smithi007:/var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/config/ceph.client.admin.keyring 2024-06-18T02:06:53.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:52 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:53.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:52 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:53.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:52 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:53.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:52 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:53.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:52 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:53.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:52 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:53.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:52 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:53.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:52 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:53.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:52 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:53.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:52 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:53.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:52 smithi007 ceph-mon[25091]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi007", "caps": []}]: dispatch 2024-06-18T02:06:53.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:52 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi007", "caps": []}]: dispatch 2024-06-18T02:06:53.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:53 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:06:53] "GET /metrics HTTP/1.1" 200 35339 "" "Prometheus/2.33.4" 2024-06-18T02:06:53.294 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:53 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: 2024-06-18T02:06:53.204+0000 7f6c135c5640 -1 log_channel(cephadm) log [ERR] : [18/Jun/2024:02:06:53] ENGINE Error in HTTPServer.serve 2024-06-18T02:06:53.294 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:53 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: Traceback (most recent call last): 2024-06-18T02:06:53.294 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:53 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-06-18T02:06:53.294 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:53 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: self._connections.run(self.expiration_interval) 2024-06-18T02:06:53.294 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:53 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-06-18T02:06:53.294 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:53 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: self._run(expiration_interval) 2024-06-18T02:06:53.294 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:53 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-06-18T02:06:53.294 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:53 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: new_conn = self._from_server_socket(self.server.socket) 2024-06-18T02:06:53.294 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:53 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-06-18T02:06:53.294 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:53 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-06-18T02:06:53.294 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:53 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-06-18T02:06:53.294 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:53 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: s = self.context.wrap_socket( 2024-06-18T02:06:53.294 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:53 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-06-18T02:06:53.295 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:53 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: return self.sslsocket_class._create( 2024-06-18T02:06:53.295 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:53 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-06-18T02:06:53.295 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:53 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: self.do_handshake() 2024-06-18T02:06:53.295 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:53 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-06-18T02:06:53.295 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:53 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: self._sslobj.do_handshake() 2024-06-18T02:06:53.295 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:53 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1129) 2024-06-18T02:06:53.295 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:06:53 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: 2024-06-18T02:06:53.431 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:06:53 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T02:06:53.086+0000 7fa3d0d0f000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-18T02:06:53.432 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:06:53 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: [18/Jun/2024:02:06:53] ENGINE Bus STARTING 2024-06-18T02:06:53.432 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:06:53 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: CherryPy Checker: 2024-06-18T02:06:53.432 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:06:53 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: The Application mounted at '' has an empty config. 2024-06-18T02:06:53.432 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:06:53 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: 2024-06-18T02:06:53.432 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:06:53 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: [18/Jun/2024:02:06:53] ENGINE Serving on http://:::9283 2024-06-18T02:06:53.432 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:06:53 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: [18/Jun/2024:02:06:53] ENGINE Bus STARTED 2024-06-18T02:06:53.931 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:06:53 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=error ts=2024-06-18T02:06:53.517Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=7 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.130:8443/api/prometheus_receiver\": dial tcp 172.21.15.130:8443: connect: connection refused; ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://172.21.15.7:8443//api/prometheus_receiver\": dial tcp 172.21.15.7:8443: connect: connection refused" 2024-06-18T02:06:53.932 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:06:53 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=warn ts=2024-06-18T02:06:53.519Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.7:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.7 because it doesn't contain any IP SANs" 2024-06-18T02:06:53.932 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:06:53 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=warn ts=2024-06-18T02:06:53.520Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.130:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.130 because it doesn't contain any IP SANs" 2024-06-18T02:06:53.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:53 smithi007 ceph-mon[25091]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:06:53.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:53 smithi007 ceph-mon[25091]: [18/Jun/2024:02:06:53] ENGINE Bus STARTING 2024-06-18T02:06:53.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:53 smithi007 ceph-mon[25091]: Standby manager daemon y restarted 2024-06-18T02:06:53.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:53 smithi007 ceph-mon[25091]: Standby manager daemon y started 2024-06-18T02:06:53.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:53 smithi007 ceph-mon[25091]: from='mgr.? 172.21.15.7:0/1535931065' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-06-18T02:06:53.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:53 smithi007 ceph-mon[25091]: from='mgr.? 172.21.15.7:0/1535931065' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-18T02:06:53.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:53 smithi007 ceph-mon[25091]: from='mgr.? 172.21.15.7:0/1535931065' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-06-18T02:06:53.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:53 smithi007 ceph-mon[25091]: from='mgr.? 172.21.15.7:0/1535931065' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-18T02:06:53.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:53 smithi007 ceph-mon[25091]: Reconfiguring daemon agent.smithi007 on smithi007 2024-06-18T02:06:53.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:53 smithi007 ceph-mon[25091]: [18/Jun/2024:02:06:53] ENGINE Serving on https://172.21.15.130:7150 2024-06-18T02:06:53.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:53 smithi007 ceph-mon[25091]: [18/Jun/2024:02:06:53] ENGINE Error in HTTPServer.serve 2024-06-18T02:06:53.933 INFO:journalctl@ceph.mon.a.smithi007.stdout: Traceback (most recent call last): 2024-06-18T02:06:53.933 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-06-18T02:06:53.933 INFO:journalctl@ceph.mon.a.smithi007.stdout: self._connections.run(self.expiration_interval) 2024-06-18T02:06:53.933 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-06-18T02:06:53.933 INFO:journalctl@ceph.mon.a.smithi007.stdout: self._run(expiration_interval) 2024-06-18T02:06:53.933 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-06-18T02:06:53.933 INFO:journalctl@ceph.mon.a.smithi007.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-06-18T02:06:53.933 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-06-18T02:06:53.934 INFO:journalctl@ceph.mon.a.smithi007.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-06-18T02:06:53.934 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-06-18T02:06:53.934 INFO:journalctl@ceph.mon.a.smithi007.stdout: s = self.context.wrap_socket( 2024-06-18T02:06:53.934 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-06-18T02:06:53.934 INFO:journalctl@ceph.mon.a.smithi007.stdout: return self.sslsocket_class._create( 2024-06-18T02:06:53.934 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-06-18T02:06:53.934 INFO:journalctl@ceph.mon.a.smithi007.stdout: self.do_handshake() 2024-06-18T02:06:53.934 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-06-18T02:06:53.934 INFO:journalctl@ceph.mon.a.smithi007.stdout: self._sslobj.do_handshake() 2024-06-18T02:06:53.934 INFO:journalctl@ceph.mon.a.smithi007.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1129) 2024-06-18T02:06:53.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:53 smithi007 ceph-mon[25091]: mgrmap e25: x(active, since 2s), standbys: y 2024-06-18T02:06:53.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:53 smithi007 ceph-mon[29879]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:06:53.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:53 smithi007 ceph-mon[29879]: [18/Jun/2024:02:06:53] ENGINE Bus STARTING 2024-06-18T02:06:53.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:53 smithi007 ceph-mon[29879]: Standby manager daemon y restarted 2024-06-18T02:06:53.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:53 smithi007 ceph-mon[29879]: Standby manager daemon y started 2024-06-18T02:06:53.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:53 smithi007 ceph-mon[29879]: from='mgr.? 172.21.15.7:0/1535931065' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-06-18T02:06:53.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:53 smithi007 ceph-mon[29879]: from='mgr.? 172.21.15.7:0/1535931065' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-18T02:06:53.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:53 smithi007 ceph-mon[29879]: from='mgr.? 172.21.15.7:0/1535931065' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-06-18T02:06:53.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:53 smithi007 ceph-mon[29879]: from='mgr.? 172.21.15.7:0/1535931065' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-18T02:06:53.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:53 smithi007 ceph-mon[29879]: Reconfiguring daemon agent.smithi007 on smithi007 2024-06-18T02:06:53.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:53 smithi007 ceph-mon[29879]: [18/Jun/2024:02:06:53] ENGINE Serving on https://172.21.15.130:7150 2024-06-18T02:06:53.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:53 smithi007 ceph-mon[29879]: [18/Jun/2024:02:06:53] ENGINE Error in HTTPServer.serve 2024-06-18T02:06:53.935 INFO:journalctl@ceph.mon.c.smithi007.stdout: Traceback (most recent call last): 2024-06-18T02:06:53.935 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-06-18T02:06:53.935 INFO:journalctl@ceph.mon.c.smithi007.stdout: self._connections.run(self.expiration_interval) 2024-06-18T02:06:53.935 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-06-18T02:06:53.936 INFO:journalctl@ceph.mon.c.smithi007.stdout: self._run(expiration_interval) 2024-06-18T02:06:53.936 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-06-18T02:06:53.936 INFO:journalctl@ceph.mon.c.smithi007.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-06-18T02:06:53.936 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-06-18T02:06:53.936 INFO:journalctl@ceph.mon.c.smithi007.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-06-18T02:06:53.936 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-06-18T02:06:53.936 INFO:journalctl@ceph.mon.c.smithi007.stdout: s = self.context.wrap_socket( 2024-06-18T02:06:53.936 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-06-18T02:06:53.936 INFO:journalctl@ceph.mon.c.smithi007.stdout: return self.sslsocket_class._create( 2024-06-18T02:06:53.936 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-06-18T02:06:53.936 INFO:journalctl@ceph.mon.c.smithi007.stdout: self.do_handshake() 2024-06-18T02:06:53.936 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-06-18T02:06:53.937 INFO:journalctl@ceph.mon.c.smithi007.stdout: self._sslobj.do_handshake() 2024-06-18T02:06:53.937 INFO:journalctl@ceph.mon.c.smithi007.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1129) 2024-06-18T02:06:53.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:53 smithi007 ceph-mon[29879]: mgrmap e25: x(active, since 2s), standbys: y 2024-06-18T02:06:54.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:53 smithi130 ceph-mon[26123]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:06:54.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:53 smithi130 ceph-mon[26123]: [18/Jun/2024:02:06:53] ENGINE Bus STARTING 2024-06-18T02:06:54.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:53 smithi130 ceph-mon[26123]: Standby manager daemon y restarted 2024-06-18T02:06:54.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:53 smithi130 ceph-mon[26123]: Standby manager daemon y started 2024-06-18T02:06:54.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:53 smithi130 ceph-mon[26123]: from='mgr.? 172.21.15.7:0/1535931065' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-06-18T02:06:54.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:53 smithi130 ceph-mon[26123]: from='mgr.? 172.21.15.7:0/1535931065' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-18T02:06:54.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:53 smithi130 ceph-mon[26123]: from='mgr.? 172.21.15.7:0/1535931065' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-06-18T02:06:54.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:53 smithi130 ceph-mon[26123]: from='mgr.? 172.21.15.7:0/1535931065' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-18T02:06:54.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:53 smithi130 ceph-mon[26123]: Reconfiguring daemon agent.smithi007 on smithi007 2024-06-18T02:06:54.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:53 smithi130 ceph-mon[26123]: [18/Jun/2024:02:06:53] ENGINE Serving on https://172.21.15.130:7150 2024-06-18T02:06:54.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:53 smithi130 ceph-mon[26123]: [18/Jun/2024:02:06:53] ENGINE Error in HTTPServer.serve 2024-06-18T02:06:54.044 INFO:journalctl@ceph.mon.b.smithi130.stdout: Traceback (most recent call last): 2024-06-18T02:06:54.044 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-06-18T02:06:54.044 INFO:journalctl@ceph.mon.b.smithi130.stdout: self._connections.run(self.expiration_interval) 2024-06-18T02:06:54.044 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-06-18T02:06:54.044 INFO:journalctl@ceph.mon.b.smithi130.stdout: self._run(expiration_interval) 2024-06-18T02:06:54.044 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-06-18T02:06:54.044 INFO:journalctl@ceph.mon.b.smithi130.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-06-18T02:06:54.045 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-06-18T02:06:54.045 INFO:journalctl@ceph.mon.b.smithi130.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-06-18T02:06:54.045 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-06-18T02:06:54.045 INFO:journalctl@ceph.mon.b.smithi130.stdout: s = self.context.wrap_socket( 2024-06-18T02:06:54.045 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-06-18T02:06:54.045 INFO:journalctl@ceph.mon.b.smithi130.stdout: return self.sslsocket_class._create( 2024-06-18T02:06:54.045 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-06-18T02:06:54.045 INFO:journalctl@ceph.mon.b.smithi130.stdout: self.do_handshake() 2024-06-18T02:06:54.045 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-06-18T02:06:54.045 INFO:journalctl@ceph.mon.b.smithi130.stdout: self._sslobj.do_handshake() 2024-06-18T02:06:54.045 INFO:journalctl@ceph.mon.b.smithi130.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1129) 2024-06-18T02:06:54.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:53 smithi130 ceph-mon[26123]: mgrmap e25: x(active, since 2s), standbys: y 2024-06-18T02:06:54.980 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:54 smithi007 systemd[1]: Stopping Ceph node-exporter.a for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:06:54.981 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:54 smithi007 ceph-mon[25091]: [18/Jun/2024:02:06:53] ENGINE Serving on http://172.21.15.130:8765 2024-06-18T02:06:54.981 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:54 smithi007 ceph-mon[25091]: [18/Jun/2024:02:06:53] ENGINE Bus STARTED 2024-06-18T02:06:54.981 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:54 smithi007 ceph-mon[25091]: Deploying cephadm binary to smithi007 2024-06-18T02:06:54.981 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:54 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:54.981 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:54 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:54.981 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:54 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:54.981 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:54 smithi007 ceph-mon[29879]: [18/Jun/2024:02:06:53] ENGINE Serving on http://172.21.15.130:8765 2024-06-18T02:06:54.981 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:54 smithi007 ceph-mon[29879]: [18/Jun/2024:02:06:53] ENGINE Bus STARTED 2024-06-18T02:06:54.982 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:54 smithi007 ceph-mon[29879]: Deploying cephadm binary to smithi007 2024-06-18T02:06:54.982 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:54 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:54.982 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:54 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:54.982 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:54 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:55.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:54 smithi130 ceph-mon[26123]: [18/Jun/2024:02:06:53] ENGINE Serving on http://172.21.15.130:8765 2024-06-18T02:06:55.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:54 smithi130 ceph-mon[26123]: [18/Jun/2024:02:06:53] ENGINE Bus STARTED 2024-06-18T02:06:55.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:54 smithi130 ceph-mon[26123]: Deploying cephadm binary to smithi007 2024-06-18T02:06:55.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:54 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:55.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:54 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:55.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:54 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:55.279 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:54 smithi007 bash[62852]: Error: no container with name or ID "ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter.a" found: no such container 2024-06-18T02:06:56.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:55 smithi130 ceph-mon[26123]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:06:56.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:55 smithi130 ceph-mon[26123]: Reconfiguring node-exporter.a (dependencies changed)... 2024-06-18T02:06:56.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:55 smithi130 ceph-mon[26123]: Reconfiguring daemon node-exporter.a on smithi007 2024-06-18T02:06:56.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:55 smithi130 ceph-mon[26123]: mgrmap e26: x(active, since 4s), standbys: y 2024-06-18T02:06:56.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:55 smithi007 ceph-mon[25091]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:06:56.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:55 smithi007 ceph-mon[25091]: Reconfiguring node-exporter.a (dependencies changed)... 2024-06-18T02:06:56.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:55 smithi007 ceph-mon[25091]: Reconfiguring daemon node-exporter.a on smithi007 2024-06-18T02:06:56.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:55 smithi007 ceph-mon[25091]: mgrmap e26: x(active, since 4s), standbys: y 2024-06-18T02:06:56.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:55 smithi007 ceph-mon[29879]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:06:56.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:55 smithi007 ceph-mon[29879]: Reconfiguring node-exporter.a (dependencies changed)... 2024-06-18T02:06:56.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:55 smithi007 ceph-mon[29879]: Reconfiguring daemon node-exporter.a on smithi007 2024-06-18T02:06:56.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:55 smithi007 ceph-mon[29879]: mgrmap e26: x(active, since 4s), standbys: y 2024-06-18T02:06:57.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:56 smithi130 ceph-mon[26123]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:06:57.175 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:56 smithi007 ceph-mon[25091]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:06:57.176 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:56 smithi007 ceph-mon[29879]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:06:57.176 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:56 smithi007 podman[62869]: 2024-06-18 02:06:56.754289758 +0000 UTC m=+1.763731569 container died 68ab683466983f7df093c52ea097429680c325a4691345cdea246ff5e889e03b (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-06-18T02:06:57.431 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:57 smithi007 podman[62869]: 2024-06-18 02:06:57.383954611 +0000 UTC m=+2.393396432 container cleanup 68ab683466983f7df093c52ea097429680c325a4691345cdea246ff5e889e03b (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-06-18T02:06:57.431 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:57 smithi007 bash[62869]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a 2024-06-18T02:06:57.848 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:57 smithi007 ceph-mon[25091]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:06:57.848 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:57 smithi007 ceph-mon[29879]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:06:57.848 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:57 smithi007 podman[62967]: 2024-06-18 02:06:57.585402817 +0000 UTC m=+1.260608012 container remove 68ab683466983f7df093c52ea097429680c325a4691345cdea246ff5e889e03b (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-06-18T02:06:57.848 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:57 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@node-exporter.a.service: Main process exited, code=exited, status=143/n/a 2024-06-18T02:06:57.848 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:57 smithi007 bash[62982]: Error: no container with name or ID "ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter.a" found: no such container 2024-06-18T02:06:57.848 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:57 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@node-exporter.a.service: Failed with result 'exit-code'. 2024-06-18T02:06:57.849 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:57 smithi007 systemd[1]: Stopped Ceph node-exporter.a for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:06:57.849 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:57 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@node-exporter.a.service: Consumed 2.723s CPU time. 2024-06-18T02:06:57.849 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:57 smithi007 systemd[1]: Starting Ceph node-exporter.a for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:06:58.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:57 smithi130 ceph-mon[26123]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:06:58.119 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:57 smithi007 podman[63063]: 2024-06-18 02:06:57.751829183 +0000 UTC m=+0.018405774 image pull 1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26 quay.io/prometheus/node-exporter:v1.3.1 2024-06-18T02:06:58.119 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:58 smithi007 podman[63063]: 2024-06-18 02:06:58.028550268 +0000 UTC m=+0.295126851 container create 8128e558f0990350967b5972128368e8bcea326afb063ce8355d3739d046926d (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-06-18T02:06:58.509 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:58 smithi007 podman[63063]: 2024-06-18 02:06:58.230602203 +0000 UTC m=+0.497178795 container init 8128e558f0990350967b5972128368e8bcea326afb063ce8355d3739d046926d (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-06-18T02:06:58.509 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:58 smithi007 podman[63063]: 2024-06-18 02:06:58.233662956 +0000 UTC m=+0.500239550 container start 8128e558f0990350967b5972128368e8bcea326afb063ce8355d3739d046926d (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-06-18T02:06:58.509 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[63089]: ts=2024-06-18T02:06:58.237Z caller=node_exporter.go:182 level=info msg="Starting node_exporter" version="(version=1.3.1, branch=HEAD, revision=a2321e7b940ddcff26873612bccdf7cd4c42b6b6)" 2024-06-18T02:06:58.509 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[63089]: ts=2024-06-18T02:06:58.237Z caller=node_exporter.go:183 level=info msg="Build context" build_context="(go=go1.17.3, user=root@243aafa5525c, date=20211205-11:09:49)" 2024-06-18T02:06:58.510 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[63089]: ts=2024-06-18T02:06:58.237Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+)($|/) 2024-06-18T02:06:58.510 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[63089]: ts=2024-06-18T02:06:58.237Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-06-18T02:06:58.510 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[63089]: ts=2024-06-18T02:06:58.238Z caller=node_exporter.go:108 level=info msg="Enabled collectors" 2024-06-18T02:06:58.510 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[63089]: ts=2024-06-18T02:06:58.238Z caller=node_exporter.go:115 level=info collector=arp 2024-06-18T02:06:58.510 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[63089]: ts=2024-06-18T02:06:58.238Z caller=node_exporter.go:115 level=info collector=bcache 2024-06-18T02:06:58.510 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[63089]: ts=2024-06-18T02:06:58.238Z caller=node_exporter.go:115 level=info collector=bonding 2024-06-18T02:06:58.510 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[63089]: ts=2024-06-18T02:06:58.238Z caller=node_exporter.go:115 level=info collector=btrfs 2024-06-18T02:06:58.510 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[63089]: ts=2024-06-18T02:06:58.238Z caller=node_exporter.go:115 level=info collector=conntrack 2024-06-18T02:06:58.510 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[63089]: ts=2024-06-18T02:06:58.238Z caller=node_exporter.go:115 level=info collector=cpu 2024-06-18T02:06:58.510 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[63089]: ts=2024-06-18T02:06:58.238Z caller=node_exporter.go:115 level=info collector=cpufreq 2024-06-18T02:06:58.510 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[63089]: ts=2024-06-18T02:06:58.238Z caller=node_exporter.go:115 level=info collector=diskstats 2024-06-18T02:06:58.510 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[63089]: ts=2024-06-18T02:06:58.238Z caller=node_exporter.go:115 level=info collector=dmi 2024-06-18T02:06:58.510 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[63089]: ts=2024-06-18T02:06:58.238Z caller=node_exporter.go:115 level=info collector=edac 2024-06-18T02:06:58.511 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[63089]: ts=2024-06-18T02:06:58.238Z caller=node_exporter.go:115 level=info collector=entropy 2024-06-18T02:06:58.511 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[63089]: ts=2024-06-18T02:06:58.238Z caller=node_exporter.go:115 level=info collector=fibrechannel 2024-06-18T02:06:58.511 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[63089]: ts=2024-06-18T02:06:58.238Z caller=node_exporter.go:115 level=info collector=filefd 2024-06-18T02:06:58.511 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[63089]: ts=2024-06-18T02:06:58.238Z caller=node_exporter.go:115 level=info collector=filesystem 2024-06-18T02:06:58.511 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[63089]: ts=2024-06-18T02:06:58.238Z caller=node_exporter.go:115 level=info collector=hwmon 2024-06-18T02:06:58.511 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[63089]: ts=2024-06-18T02:06:58.238Z caller=node_exporter.go:115 level=info collector=infiniband 2024-06-18T02:06:58.511 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[63089]: ts=2024-06-18T02:06:58.238Z caller=node_exporter.go:115 level=info collector=ipvs 2024-06-18T02:06:58.511 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[63089]: ts=2024-06-18T02:06:58.238Z caller=node_exporter.go:115 level=info collector=loadavg 2024-06-18T02:06:58.512 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[63089]: ts=2024-06-18T02:06:58.238Z caller=node_exporter.go:115 level=info collector=mdadm 2024-06-18T02:06:58.512 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[63089]: ts=2024-06-18T02:06:58.238Z caller=node_exporter.go:115 level=info collector=meminfo 2024-06-18T02:06:58.512 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[63089]: ts=2024-06-18T02:06:58.238Z caller=node_exporter.go:115 level=info collector=netclass 2024-06-18T02:06:58.512 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[63089]: ts=2024-06-18T02:06:58.238Z caller=node_exporter.go:115 level=info collector=netdev 2024-06-18T02:06:58.512 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[63089]: ts=2024-06-18T02:06:58.238Z caller=node_exporter.go:115 level=info collector=netstat 2024-06-18T02:06:58.512 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[63089]: ts=2024-06-18T02:06:58.238Z caller=node_exporter.go:115 level=info collector=nfs 2024-06-18T02:06:58.512 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[63089]: ts=2024-06-18T02:06:58.238Z caller=node_exporter.go:115 level=info collector=nfsd 2024-06-18T02:06:58.512 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[63089]: ts=2024-06-18T02:06:58.238Z caller=node_exporter.go:115 level=info collector=nvme 2024-06-18T02:06:58.512 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[63089]: ts=2024-06-18T02:06:58.238Z caller=node_exporter.go:115 level=info collector=os 2024-06-18T02:06:58.512 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[63089]: ts=2024-06-18T02:06:58.238Z caller=node_exporter.go:115 level=info collector=powersupplyclass 2024-06-18T02:06:58.512 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[63089]: ts=2024-06-18T02:06:58.238Z caller=node_exporter.go:115 level=info collector=pressure 2024-06-18T02:06:58.512 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[63089]: ts=2024-06-18T02:06:58.238Z caller=node_exporter.go:115 level=info collector=rapl 2024-06-18T02:06:58.512 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[63089]: ts=2024-06-18T02:06:58.238Z caller=node_exporter.go:115 level=info collector=schedstat 2024-06-18T02:06:58.512 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[63089]: ts=2024-06-18T02:06:58.238Z caller=node_exporter.go:115 level=info collector=sockstat 2024-06-18T02:06:58.512 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[63089]: ts=2024-06-18T02:06:58.238Z caller=node_exporter.go:115 level=info collector=softnet 2024-06-18T02:06:58.512 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[63089]: ts=2024-06-18T02:06:58.238Z caller=node_exporter.go:115 level=info collector=stat 2024-06-18T02:06:58.513 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[63089]: ts=2024-06-18T02:06:58.238Z caller=node_exporter.go:115 level=info collector=tapestats 2024-06-18T02:06:58.513 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[63089]: ts=2024-06-18T02:06:58.238Z caller=node_exporter.go:115 level=info collector=textfile 2024-06-18T02:06:58.513 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[63089]: ts=2024-06-18T02:06:58.238Z caller=node_exporter.go:115 level=info collector=thermal_zone 2024-06-18T02:06:58.513 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[63089]: ts=2024-06-18T02:06:58.238Z caller=node_exporter.go:115 level=info collector=time 2024-06-18T02:06:58.513 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[63089]: ts=2024-06-18T02:06:58.238Z caller=node_exporter.go:115 level=info collector=udp_queues 2024-06-18T02:06:58.513 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[63089]: ts=2024-06-18T02:06:58.238Z caller=node_exporter.go:115 level=info collector=uname 2024-06-18T02:06:58.513 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[63089]: ts=2024-06-18T02:06:58.238Z caller=node_exporter.go:115 level=info collector=vmstat 2024-06-18T02:06:58.513 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[63089]: ts=2024-06-18T02:06:58.238Z caller=node_exporter.go:115 level=info collector=xfs 2024-06-18T02:06:58.513 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[63089]: ts=2024-06-18T02:06:58.238Z caller=node_exporter.go:115 level=info collector=zfs 2024-06-18T02:06:58.513 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[63089]: ts=2024-06-18T02:06:58.238Z caller=node_exporter.go:199 level=info msg="Listening on" address=:9100 2024-06-18T02:06:58.513 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a[63089]: ts=2024-06-18T02:06:58.239Z caller=tls_config.go:195 level=info msg="TLS is disabled." http2=false 2024-06-18T02:06:58.514 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:58 smithi007 bash[63063]: 8128e558f0990350967b5972128368e8bcea326afb063ce8355d3739d046926d 2024-06-18T02:06:58.514 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:06:58 smithi007 systemd[1]: Started Ceph node-exporter.a for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:06:59.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:59 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:59.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:59 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:59.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:59 smithi130 ceph-mon[26123]: Reconfiguring alertmanager.a (dependencies changed)... 2024-06-18T02:06:59.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:59 smithi130 ceph-mon[26123]: Reconfiguring daemon alertmanager.a on smithi007 2024-06-18T02:06:59.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:06:59 smithi130 ceph-mon[26123]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 31 KiB/s rd, 0 B/s wr, 17 op/s 2024-06-18T02:06:59.555 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:59 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:59.555 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:59 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:59.555 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:59 smithi007 ceph-mon[25091]: Reconfiguring alertmanager.a (dependencies changed)... 2024-06-18T02:06:59.556 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:59 smithi007 ceph-mon[25091]: Reconfiguring daemon alertmanager.a on smithi007 2024-06-18T02:06:59.556 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:06:59 smithi007 ceph-mon[25091]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 31 KiB/s rd, 0 B/s wr, 17 op/s 2024-06-18T02:06:59.556 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:59 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:59.556 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:59 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:06:59.556 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:59 smithi007 ceph-mon[29879]: Reconfiguring alertmanager.a (dependencies changed)... 2024-06-18T02:06:59.556 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:59 smithi007 ceph-mon[29879]: Reconfiguring daemon alertmanager.a on smithi007 2024-06-18T02:06:59.556 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:06:59 smithi007 ceph-mon[29879]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 31 KiB/s rd, 0 B/s wr, 17 op/s 2024-06-18T02:07:00.254 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:00 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:07:00] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-06-18T02:07:02.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:01 smithi130 ceph-mon[26123]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 24 KiB/s rd, 0 B/s wr, 13 op/s 2024-06-18T02:07:02.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:01 smithi007 ceph-mon[25091]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 24 KiB/s rd, 0 B/s wr, 13 op/s 2024-06-18T02:07:02.068 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:01 smithi007 ceph-mon[29879]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 24 KiB/s rd, 0 B/s wr, 13 op/s 2024-06-18T02:07:03.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:03 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:07:03] "GET /metrics HTTP/1.1" 200 35339 "" "Prometheus/2.33.4" 2024-06-18T02:07:03.862 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:03 smithi007 ceph-mon[25091]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-06-18T02:07:03.862 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:03 smithi007 ceph-mon[29879]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-06-18T02:07:03.862 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:07:03 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=error ts=2024-06-18T02:07:03.518Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=7 err="ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://172.21.15.130:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.130 because it doesn't contain any IP SANs; ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://172.21.15.7:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.7 because it doesn't contain any IP SANs" 2024-06-18T02:07:03.862 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:07:03 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=warn ts=2024-06-18T02:07:03.520Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.7:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.7 because it doesn't contain any IP SANs" 2024-06-18T02:07:03.862 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:07:03 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=warn ts=2024-06-18T02:07:03.520Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.130:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.130 because it doesn't contain any IP SANs" 2024-06-18T02:07:04.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:03 smithi130 ceph-mon[26123]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-06-18T02:07:04.149 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:07:04 smithi007 systemd[1]: Stopping Ceph alertmanager.a for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:07:04.149 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:07:04 smithi007 bash[63623]: Error: no container with name or ID "ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager.a" found: no such container 2024-06-18T02:07:04.149 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:07:04 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[50551]: level=info ts=2024-06-18T02:07:04.150Z caller=main.go:557 msg="Received SIGTERM, exiting gracefully..." 2024-06-18T02:07:04.431 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:07:04 smithi007 podman[63647]: 2024-06-18 02:07:04.360434358 +0000 UTC m=+0.302673655 container died 8a3093399f5a9b89919a0ec6bbaa9a7c21ca8086f30f9a09247c9900288c6a8a (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-06-18T02:07:04.931 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:07:04 smithi007 podman[63647]: 2024-06-18 02:07:04.835537401 +0000 UTC m=+0.777776694 container cleanup 8a3093399f5a9b89919a0ec6bbaa9a7c21ca8086f30f9a09247c9900288c6a8a (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-06-18T02:07:04.931 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:07:04 smithi007 bash[63647]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a 2024-06-18T02:07:04.931 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:07:04 smithi007 bash[63707]: Error: no container with name or ID "ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager.a" found: no such container 2024-06-18T02:07:05.630 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:07:05 smithi007 podman[63677]: 2024-06-18 02:07:05.530850108 +0000 UTC m=+1.342170629 container remove 8a3093399f5a9b89919a0ec6bbaa9a7c21ca8086f30f9a09247c9900288c6a8a (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-06-18T02:07:05.630 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:07:05 smithi007 podman[63677]: 2024-06-18 02:07:05.631331325 +0000 UTC m=+1.442651846 volume remove 99fd0926cde1826aa322da5c7ed36df621d184cc44eb9f17691b0897167c736c 2024-06-18T02:07:05.887 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:05 smithi007 ceph-mon[25091]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-06-18T02:07:05.887 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:05 smithi007 ceph-mon[29879]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-06-18T02:07:05.887 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:07:05 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@alertmanager.a.service: Deactivated successfully. 2024-06-18T02:07:05.887 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:07:05 smithi007 systemd[1]: Stopped Ceph alertmanager.a for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:07:05.887 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:07:05 smithi007 systemd[1]: Starting Ceph alertmanager.a for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:07:05.887 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:07:05 smithi007 podman[63792]: 2024-06-18 02:07:05.771855581 +0000 UTC m=+0.020525670 image pull ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4 quay.io/prometheus/alertmanager:v0.23.0 2024-06-18T02:07:06.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:05 smithi130 ceph-mon[26123]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-06-18T02:07:06.181 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:07:05 smithi007 podman[63792]: 2024-06-18 02:07:05.894049659 +0000 UTC m=+0.142719793 volume create 3cf3e54fbf1f52194f8d68819be321185ff7dc186406dec6e061b6aaa5399dc4 2024-06-18T02:07:06.182 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:07:05 smithi007 podman[63792]: 2024-06-18 02:07:05.991539021 +0000 UTC m=+0.240209108 container create 5994e8525c64b2f3c089a6ffa1c0f9dec524d3cec2e1fc2ba2dd2d0521ca9db9 (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-06-18T02:07:06.448 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:07:06 smithi007 podman[63792]: 2024-06-18 02:07:06.31916695 +0000 UTC m=+0.567837040 container init 5994e8525c64b2f3c089a6ffa1c0f9dec524d3cec2e1fc2ba2dd2d0521ca9db9 (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-06-18T02:07:06.448 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:07:06 smithi007 podman[63792]: 2024-06-18 02:07:06.322637307 +0000 UTC m=+0.571307395 container start 5994e8525c64b2f3c089a6ffa1c0f9dec524d3cec2e1fc2ba2dd2d0521ca9db9 (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-06-18T02:07:06.448 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:07:06 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[63807]: level=info ts=2024-06-18T02:07:06.333Z caller=main.go:225 msg="Starting Alertmanager" version="(version=0.23.0, branch=HEAD, revision=61046b17771a57cfd4c4a51be370ab930a4d7d54)" 2024-06-18T02:07:06.448 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:07:06 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[63807]: level=info ts=2024-06-18T02:07:06.333Z caller=main.go:226 build_context="(go=go1.16.7, user=root@e21a959be8d2, date=20210825-10:48:55)" 2024-06-18T02:07:06.448 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:07:06 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[63807]: level=info ts=2024-06-18T02:07:06.334Z caller=cluster.go:184 component=cluster msg="setting advertise address explicitly" addr=172.21.15.7 port=9094 2024-06-18T02:07:06.448 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:07:06 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[63807]: level=info ts=2024-06-18T02:07:06.335Z caller=cluster.go:671 component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-06-18T02:07:06.448 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:07:06 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[63807]: level=info ts=2024-06-18T02:07:06.362Z caller=coordinator.go:113 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-06-18T02:07:06.448 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:07:06 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[63807]: level=info ts=2024-06-18T02:07:06.362Z caller=coordinator.go:126 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-06-18T02:07:06.448 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:07:06 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[63807]: level=info ts=2024-06-18T02:07:06.365Z caller=main.go:518 msg=Listening address=:9093 2024-06-18T02:07:06.448 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:07:06 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[63807]: level=info ts=2024-06-18T02:07:06.365Z caller=tls_config.go:191 msg="TLS is disabled." http2=false 2024-06-18T02:07:06.449 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:07:06 smithi007 bash[63792]: 5994e8525c64b2f3c089a6ffa1c0f9dec524d3cec2e1fc2ba2dd2d0521ca9db9 2024-06-18T02:07:06.449 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:07:06 smithi007 systemd[1]: Started Ceph alertmanager.a for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:07:07.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:06 smithi130 ceph-mon[26123]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:07:07.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:06 smithi130 ceph-mon[26123]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:07:07.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:06 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:07.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:06 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:07.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:06 smithi130 ceph-mon[26123]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi007.xvdrwd", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-06-18T02:07:07.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:06 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi007.xvdrwd", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-06-18T02:07:07.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:06 smithi130 ceph-mon[26123]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:07:07.054 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:06 smithi007 ceph-mon[25091]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:07:07.054 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:06 smithi007 ceph-mon[25091]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:07:07.055 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:06 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:07.055 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:06 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:07.055 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:06 smithi007 ceph-mon[25091]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi007.xvdrwd", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-06-18T02:07:07.055 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:06 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi007.xvdrwd", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-06-18T02:07:07.055 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:06 smithi007 ceph-mon[25091]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:07:07.055 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:06 smithi007 ceph-mon[29879]: from='client.14931 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:07:07.055 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:06 smithi007 ceph-mon[29879]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:07:07.055 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:06 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:07.055 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:06 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:07.055 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:06 smithi007 ceph-mon[29879]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi007.xvdrwd", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-06-18T02:07:07.055 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:06 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi007.xvdrwd", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-06-18T02:07:07.055 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:06 smithi007 ceph-mon[29879]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:07:08.037 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:07 smithi007 ceph-mon[25091]: Reconfiguring iscsi.foo.smithi007.xvdrwd (dependencies changed)... 2024-06-18T02:07:08.037 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:07 smithi007 ceph-mon[25091]: Reconfiguring daemon iscsi.foo.smithi007.xvdrwd on smithi007 2024-06-18T02:07:08.037 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:07 smithi007 ceph-mon[25091]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-06-18T02:07:08.038 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:07 smithi007 ceph-mon[29879]: Reconfiguring iscsi.foo.smithi007.xvdrwd (dependencies changed)... 2024-06-18T02:07:08.038 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:07 smithi007 ceph-mon[29879]: Reconfiguring daemon iscsi.foo.smithi007.xvdrwd on smithi007 2024-06-18T02:07:08.038 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:07 smithi007 ceph-mon[29879]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-06-18T02:07:08.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:07 smithi130 ceph-mon[26123]: Reconfiguring iscsi.foo.smithi007.xvdrwd (dependencies changed)... 2024-06-18T02:07:08.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:07 smithi130 ceph-mon[26123]: Reconfiguring daemon iscsi.foo.smithi007.xvdrwd on smithi007 2024-06-18T02:07:08.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:07 smithi130 ceph-mon[26123]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-06-18T02:07:08.646 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:07:08 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[63807]: level=info ts=2024-06-18T02:07:08.336Z caller=cluster.go:696 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000334986s 2024-06-18T02:07:09.768 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: 2024-06-18T02:07:09.497+0000 7f6c47069640 -1 log_channel(cephadm) log [ERR] : cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi007.xvdrwd ... 2024-06-18T02:07:09.768 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: Creating ceph-iscsi config... 2024-06-18T02:07:09.768 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/iscsi-gateway.cfg 2024-06-18T02:07:09.768 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/tcmu-runner-entrypoint.sh 2024-06-18T02:07:09.769 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: Non-zero exit code 1 from systemctl restart ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd 2024-06-18T02:07:09.769 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: systemctl: stderr Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:07:09.769 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: systemctl: stderr See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:07:09.769 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: Traceback (most recent call last): 2024-06-18T02:07:09.769 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-06-18T02:07:09.769 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: return _run_code(code, main_globals, None, 2024-06-18T02:07:09.769 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-06-18T02:07:09.769 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: exec(code, run_globals) 2024-06-18T02:07:09.769 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5618, in 2024-06-18T02:07:09.769 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5606, in main 2024-06-18T02:07:09.769 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3096, in command_deploy_from 2024-06-18T02:07:09.769 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3131, in _common_deploy 2024-06-18T02:07:09.769 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3151, in _deploy_daemon_container 2024-06-18T02:07:09.770 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 1123, in deploy_daemon 2024-06-18T02:07:09.770 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/tmp/tmp3vdsh41i.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-06-18T02:07:09.770 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: RuntimeError: Failed command: systemctl restart ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd: Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:07:09.770 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:07:09.770 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: Traceback (most recent call last): 2024-06-18T02:07:09.770 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-06-18T02:07:09.770 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: self.mgr._daemon_action(daemon_spec, action=action) 2024-06-18T02:07:09.770 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/usr/share/ceph/mgr/cephadm/module.py", line 2456, in _daemon_action 2024-06-18T02:07:09.771 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: return self.wait_async( 2024-06-18T02:07:09.771 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/usr/share/ceph/mgr/cephadm/module.py", line 779, in wait_async 2024-06-18T02:07:09.771 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: return self.event_loop.get_result(coro, timeout) 2024-06-18T02:07:09.771 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-06-18T02:07:09.771 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: return future.result(timeout) 2024-06-18T02:07:09.771 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/lib64/python3.9/concurrent/futures/_base.py", line 446, in result 2024-06-18T02:07:09.771 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: return self.__get_result() 2024-06-18T02:07:09.771 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/lib64/python3.9/concurrent/futures/_base.py", line 391, in __get_result 2024-06-18T02:07:09.771 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: raise self._exception 2024-06-18T02:07:09.771 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1350, in _create_daemon 2024-06-18T02:07:09.771 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: out, err, code = await self._run_cephadm( 2024-06-18T02:07:09.771 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1691, in _run_cephadm 2024-06-18T02:07:09.771 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: raise OrchestratorError( 2024-06-18T02:07:09.771 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi007.xvdrwd ... 2024-06-18T02:07:09.771 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: Creating ceph-iscsi config... 2024-06-18T02:07:09.771 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/iscsi-gateway.cfg 2024-06-18T02:07:09.772 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/tcmu-runner-entrypoint.sh 2024-06-18T02:07:09.772 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: Non-zero exit code 1 from systemctl restart ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd 2024-06-18T02:07:09.772 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: systemctl: stderr Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:07:09.772 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: systemctl: stderr See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:07:09.772 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: Traceback (most recent call last): 2024-06-18T02:07:09.772 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-06-18T02:07:09.772 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: return _run_code(code, main_globals, None, 2024-06-18T02:07:09.772 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-06-18T02:07:09.772 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: exec(code, run_globals) 2024-06-18T02:07:09.772 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5618, in 2024-06-18T02:07:09.772 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5606, in main 2024-06-18T02:07:09.772 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3096, in command_deploy_from 2024-06-18T02:07:09.772 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3131, in _common_deploy 2024-06-18T02:07:09.772 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3151, in _deploy_daemon_container 2024-06-18T02:07:09.772 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 1123, in deploy_daemon 2024-06-18T02:07:09.773 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/tmp/tmp3vdsh41i.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-06-18T02:07:09.773 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: RuntimeError: Failed command: systemctl restart ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd: Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:07:09.773 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:07:10.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-mon[26123]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-06-18T02:07:10.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-mon[26123]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi130", "caps": []}]: dispatch 2024-06-18T02:07:10.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:09 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi130", "caps": []}]: dispatch 2024-06-18T02:07:10.181 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:10 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[25322]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:07:10] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-06-18T02:07:10.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:09 smithi007 ceph-mon[29879]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-06-18T02:07:10.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:09 smithi007 ceph-mon[29879]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi130", "caps": []}]: dispatch 2024-06-18T02:07:10.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:09 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi130", "caps": []}]: dispatch 2024-06-18T02:07:10.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:09 smithi007 ceph-mon[25091]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-06-18T02:07:10.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:09 smithi007 ceph-mon[25091]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi130", "caps": []}]: dispatch 2024-06-18T02:07:10.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:09 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi130", "caps": []}]: dispatch 2024-06-18T02:07:11.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:10 smithi130 ceph-mon[26123]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi007.xvdrwd ... 2024-06-18T02:07:11.043 INFO:journalctl@ceph.mon.b.smithi130.stdout: Creating ceph-iscsi config... 2024-06-18T02:07:11.043 INFO:journalctl@ceph.mon.b.smithi130.stdout: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/iscsi-gateway.cfg 2024-06-18T02:07:11.044 INFO:journalctl@ceph.mon.b.smithi130.stdout: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/tcmu-runner-entrypoint.sh 2024-06-18T02:07:11.044 INFO:journalctl@ceph.mon.b.smithi130.stdout: Non-zero exit code 1 from systemctl restart ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd 2024-06-18T02:07:11.044 INFO:journalctl@ceph.mon.b.smithi130.stdout: systemctl: stderr Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:07:11.044 INFO:journalctl@ceph.mon.b.smithi130.stdout: systemctl: stderr See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:07:11.044 INFO:journalctl@ceph.mon.b.smithi130.stdout: Traceback (most recent call last): 2024-06-18T02:07:11.044 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-06-18T02:07:11.044 INFO:journalctl@ceph.mon.b.smithi130.stdout: return _run_code(code, main_globals, None, 2024-06-18T02:07:11.044 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-06-18T02:07:11.044 INFO:journalctl@ceph.mon.b.smithi130.stdout: exec(code, run_globals) 2024-06-18T02:07:11.044 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5618, in 2024-06-18T02:07:11.044 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5606, in main 2024-06-18T02:07:11.044 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3096, in command_deploy_from 2024-06-18T02:07:11.045 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3131, in _common_deploy 2024-06-18T02:07:11.045 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3151, in _deploy_daemon_container 2024-06-18T02:07:11.045 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 1123, in deploy_daemon 2024-06-18T02:07:11.045 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-06-18T02:07:11.045 INFO:journalctl@ceph.mon.b.smithi130.stdout: RuntimeError: Failed command: systemctl restart ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd: Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:07:11.045 INFO:journalctl@ceph.mon.b.smithi130.stdout: See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:07:11.045 INFO:journalctl@ceph.mon.b.smithi130.stdout: Traceback (most recent call last): 2024-06-18T02:07:11.045 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-06-18T02:07:11.045 INFO:journalctl@ceph.mon.b.smithi130.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-06-18T02:07:11.045 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2456, in _daemon_action 2024-06-18T02:07:11.045 INFO:journalctl@ceph.mon.b.smithi130.stdout: return self.wait_async( 2024-06-18T02:07:11.045 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 779, in wait_async 2024-06-18T02:07:11.045 INFO:journalctl@ceph.mon.b.smithi130.stdout: return self.event_loop.get_result(coro, timeout) 2024-06-18T02:07:11.045 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-06-18T02:07:11.046 INFO:journalctl@ceph.mon.b.smithi130.stdout: return future.result(timeout) 2024-06-18T02:07:11.046 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/lib64/python3.9/concurrent/futures/_base.py", line 446, in result 2024-06-18T02:07:11.046 INFO:journalctl@ceph.mon.b.smithi130.stdout: return self.__get_result() 2024-06-18T02:07:11.046 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/lib64/python3.9/concurrent/futures/_base.py", line 391, in __get_result 2024-06-18T02:07:11.046 INFO:journalctl@ceph.mon.b.smithi130.stdout: raise self._exception 2024-06-18T02:07:11.046 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1350, in _create_daemon 2024-06-18T02:07:11.046 INFO:journalctl@ceph.mon.b.smithi130.stdout: out, err, code = await self._run_cephadm( 2024-06-18T02:07:11.046 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1691, in _run_cephadm 2024-06-18T02:07:11.046 INFO:journalctl@ceph.mon.b.smithi130.stdout: raise OrchestratorError( 2024-06-18T02:07:11.046 INFO:journalctl@ceph.mon.b.smithi130.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi007.xvdrwd ... 2024-06-18T02:07:11.046 INFO:journalctl@ceph.mon.b.smithi130.stdout: Creating ceph-iscsi config... 2024-06-18T02:07:11.046 INFO:journalctl@ceph.mon.b.smithi130.stdout: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/iscsi-gateway.cfg 2024-06-18T02:07:11.047 INFO:journalctl@ceph.mon.b.smithi130.stdout: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/tcmu-runner-entrypoint.sh 2024-06-18T02:07:11.047 INFO:journalctl@ceph.mon.b.smithi130.stdout: Non-zero exit code 1 from systemctl restart ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd 2024-06-18T02:07:11.047 INFO:journalctl@ceph.mon.b.smithi130.stdout: systemctl: stderr Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:07:11.047 INFO:journalctl@ceph.mon.b.smithi130.stdout: systemctl: stderr See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:07:11.047 INFO:journalctl@ceph.mon.b.smithi130.stdout: Traceback (most recent call last): 2024-06-18T02:07:11.047 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-06-18T02:07:11.047 INFO:journalctl@ceph.mon.b.smithi130.stdout: return _run_code(code, main_globals, None, 2024-06-18T02:07:11.047 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-06-18T02:07:11.047 INFO:journalctl@ceph.mon.b.smithi130.stdout: exec(code, run_globals) 2024-06-18T02:07:11.047 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5618, in 2024-06-18T02:07:11.047 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5606, in main 2024-06-18T02:07:11.047 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3096, in command_deploy_from 2024-06-18T02:07:11.047 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3131, in _common_deploy 2024-06-18T02:07:11.047 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3151, in _deploy_daemon_container 2024-06-18T02:07:11.047 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 1123, in deploy_daemon 2024-06-18T02:07:11.048 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-06-18T02:07:11.048 INFO:journalctl@ceph.mon.b.smithi130.stdout: RuntimeError: Failed command: systemctl restart ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd: Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:07:11.048 INFO:journalctl@ceph.mon.b.smithi130.stdout: See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:07:11.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:10 smithi130 ceph-mon[26123]: Reconfiguring daemon agent.smithi130 on smithi130 2024-06-18T02:07:11.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:10 smithi130 ceph-mon[26123]: Deploying cephadm binary to smithi130 2024-06-18T02:07:11.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:10 smithi007 ceph-mon[25091]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi007.xvdrwd ... 2024-06-18T02:07:11.182 INFO:journalctl@ceph.mon.a.smithi007.stdout: Creating ceph-iscsi config... 2024-06-18T02:07:11.182 INFO:journalctl@ceph.mon.a.smithi007.stdout: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/iscsi-gateway.cfg 2024-06-18T02:07:11.182 INFO:journalctl@ceph.mon.a.smithi007.stdout: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/tcmu-runner-entrypoint.sh 2024-06-18T02:07:11.182 INFO:journalctl@ceph.mon.a.smithi007.stdout: Non-zero exit code 1 from systemctl restart ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd 2024-06-18T02:07:11.182 INFO:journalctl@ceph.mon.a.smithi007.stdout: systemctl: stderr Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:07:11.183 INFO:journalctl@ceph.mon.a.smithi007.stdout: systemctl: stderr See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:07:11.183 INFO:journalctl@ceph.mon.a.smithi007.stdout: Traceback (most recent call last): 2024-06-18T02:07:11.183 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-06-18T02:07:11.183 INFO:journalctl@ceph.mon.a.smithi007.stdout: return _run_code(code, main_globals, None, 2024-06-18T02:07:11.183 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-06-18T02:07:11.183 INFO:journalctl@ceph.mon.a.smithi007.stdout: exec(code, run_globals) 2024-06-18T02:07:11.183 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5618, in 2024-06-18T02:07:11.183 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5606, in main 2024-06-18T02:07:11.183 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3096, in command_deploy_from 2024-06-18T02:07:11.183 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3131, in _common_deploy 2024-06-18T02:07:11.184 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3151, in _deploy_daemon_container 2024-06-18T02:07:11.184 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 1123, in deploy_daemon 2024-06-18T02:07:11.184 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-06-18T02:07:11.184 INFO:journalctl@ceph.mon.a.smithi007.stdout: RuntimeError: Failed command: systemctl restart ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd: Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:07:11.184 INFO:journalctl@ceph.mon.a.smithi007.stdout: See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:07:11.184 INFO:journalctl@ceph.mon.a.smithi007.stdout: Traceback (most recent call last): 2024-06-18T02:07:11.184 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-06-18T02:07:11.184 INFO:journalctl@ceph.mon.a.smithi007.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-06-18T02:07:11.184 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2456, in _daemon_action 2024-06-18T02:07:11.184 INFO:journalctl@ceph.mon.a.smithi007.stdout: return self.wait_async( 2024-06-18T02:07:11.184 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 779, in wait_async 2024-06-18T02:07:11.184 INFO:journalctl@ceph.mon.a.smithi007.stdout: return self.event_loop.get_result(coro, timeout) 2024-06-18T02:07:11.184 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-06-18T02:07:11.185 INFO:journalctl@ceph.mon.a.smithi007.stdout: return future.result(timeout) 2024-06-18T02:07:11.185 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib64/python3.9/concurrent/futures/_base.py", line 446, in result 2024-06-18T02:07:11.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:10 smithi007 ceph-mon[29879]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi007.xvdrwd ... 2024-06-18T02:07:11.185 INFO:journalctl@ceph.mon.c.smithi007.stdout: Creating ceph-iscsi config... 2024-06-18T02:07:11.185 INFO:journalctl@ceph.mon.c.smithi007.stdout: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/iscsi-gateway.cfg 2024-06-18T02:07:11.185 INFO:journalctl@ceph.mon.c.smithi007.stdout: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/tcmu-runner-entrypoint.sh 2024-06-18T02:07:11.185 INFO:journalctl@ceph.mon.c.smithi007.stdout: Non-zero exit code 1 from systemctl restart ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd 2024-06-18T02:07:11.185 INFO:journalctl@ceph.mon.c.smithi007.stdout: systemctl: stderr Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:07:11.185 INFO:journalctl@ceph.mon.c.smithi007.stdout: systemctl: stderr See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:07:11.185 INFO:journalctl@ceph.mon.c.smithi007.stdout: Traceback (most recent call last): 2024-06-18T02:07:11.185 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-06-18T02:07:11.186 INFO:journalctl@ceph.mon.c.smithi007.stdout: return _run_code(code, main_globals, None, 2024-06-18T02:07:11.186 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-06-18T02:07:11.186 INFO:journalctl@ceph.mon.c.smithi007.stdout: exec(code, run_globals) 2024-06-18T02:07:11.186 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5618, in 2024-06-18T02:07:11.186 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5606, in main 2024-06-18T02:07:11.186 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3096, in command_deploy_from 2024-06-18T02:07:11.186 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3131, in _common_deploy 2024-06-18T02:07:11.186 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3151, in _deploy_daemon_container 2024-06-18T02:07:11.186 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 1123, in deploy_daemon 2024-06-18T02:07:11.186 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-06-18T02:07:11.186 INFO:journalctl@ceph.mon.c.smithi007.stdout: RuntimeError: Failed command: systemctl restart ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd: Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:07:11.186 INFO:journalctl@ceph.mon.c.smithi007.stdout: See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:07:11.186 INFO:journalctl@ceph.mon.c.smithi007.stdout: Traceback (most recent call last): 2024-06-18T02:07:11.186 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-06-18T02:07:11.187 INFO:journalctl@ceph.mon.c.smithi007.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-06-18T02:07:11.187 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2456, in _daemon_action 2024-06-18T02:07:11.187 INFO:journalctl@ceph.mon.c.smithi007.stdout: return self.wait_async( 2024-06-18T02:07:11.187 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 779, in wait_async 2024-06-18T02:07:11.187 INFO:journalctl@ceph.mon.c.smithi007.stdout: return self.event_loop.get_result(coro, timeout) 2024-06-18T02:07:11.187 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-06-18T02:07:11.187 INFO:journalctl@ceph.mon.c.smithi007.stdout: return future.result(timeout) 2024-06-18T02:07:11.187 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/lib64/python3.9/concurrent/futures/_base.py", line 446, in result 2024-06-18T02:07:11.187 INFO:journalctl@ceph.mon.a.smithi007.stdout: return self.__get_result() 2024-06-18T02:07:11.187 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib64/python3.9/concurrent/futures/_base.py", line 391, in __get_result 2024-06-18T02:07:11.187 INFO:journalctl@ceph.mon.a.smithi007.stdout: raise self._exception 2024-06-18T02:07:11.187 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1350, in _create_daemon 2024-06-18T02:07:11.188 INFO:journalctl@ceph.mon.a.smithi007.stdout: out, err, code = await self._run_cephadm( 2024-06-18T02:07:11.188 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1691, in _run_cephadm 2024-06-18T02:07:11.188 INFO:journalctl@ceph.mon.a.smithi007.stdout: raise OrchestratorError( 2024-06-18T02:07:11.188 INFO:journalctl@ceph.mon.a.smithi007.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi007.xvdrwd ... 2024-06-18T02:07:11.188 INFO:journalctl@ceph.mon.a.smithi007.stdout: Creating ceph-iscsi config... 2024-06-18T02:07:11.188 INFO:journalctl@ceph.mon.a.smithi007.stdout: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/iscsi-gateway.cfg 2024-06-18T02:07:11.188 INFO:journalctl@ceph.mon.a.smithi007.stdout: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/tcmu-runner-entrypoint.sh 2024-06-18T02:07:11.188 INFO:journalctl@ceph.mon.a.smithi007.stdout: Non-zero exit code 1 from systemctl restart ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd 2024-06-18T02:07:11.188 INFO:journalctl@ceph.mon.a.smithi007.stdout: systemctl: stderr Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:07:11.188 INFO:journalctl@ceph.mon.a.smithi007.stdout: systemctl: stderr See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:07:11.188 INFO:journalctl@ceph.mon.a.smithi007.stdout: Traceback (most recent call last): 2024-06-18T02:07:11.188 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-06-18T02:07:11.188 INFO:journalctl@ceph.mon.a.smithi007.stdout: return _run_code(code, main_globals, None, 2024-06-18T02:07:11.188 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-06-18T02:07:11.189 INFO:journalctl@ceph.mon.a.smithi007.stdout: exec(code, run_globals) 2024-06-18T02:07:11.189 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5618, in 2024-06-18T02:07:11.189 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5606, in main 2024-06-18T02:07:11.189 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3096, in command_deploy_from 2024-06-18T02:07:11.189 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3131, in _common_deploy 2024-06-18T02:07:11.189 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3151, in _deploy_daemon_container 2024-06-18T02:07:11.189 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 1123, in deploy_daemon 2024-06-18T02:07:11.189 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-06-18T02:07:11.189 INFO:journalctl@ceph.mon.a.smithi007.stdout: RuntimeError: Failed command: systemctl restart ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd: Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:07:11.189 INFO:journalctl@ceph.mon.a.smithi007.stdout: See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:07:11.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:10 smithi007 ceph-mon[25091]: Reconfiguring daemon agent.smithi130 on smithi130 2024-06-18T02:07:11.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:10 smithi007 ceph-mon[25091]: Deploying cephadm binary to smithi130 2024-06-18T02:07:11.190 INFO:journalctl@ceph.mon.c.smithi007.stdout: return self.__get_result() 2024-06-18T02:07:11.190 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/lib64/python3.9/concurrent/futures/_base.py", line 391, in __get_result 2024-06-18T02:07:11.190 INFO:journalctl@ceph.mon.c.smithi007.stdout: raise self._exception 2024-06-18T02:07:11.190 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1350, in _create_daemon 2024-06-18T02:07:11.190 INFO:journalctl@ceph.mon.c.smithi007.stdout: out, err, code = await self._run_cephadm( 2024-06-18T02:07:11.190 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1691, in _run_cephadm 2024-06-18T02:07:11.190 INFO:journalctl@ceph.mon.c.smithi007.stdout: raise OrchestratorError( 2024-06-18T02:07:11.190 INFO:journalctl@ceph.mon.c.smithi007.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi007.xvdrwd ... 2024-06-18T02:07:11.190 INFO:journalctl@ceph.mon.c.smithi007.stdout: Creating ceph-iscsi config... 2024-06-18T02:07:11.190 INFO:journalctl@ceph.mon.c.smithi007.stdout: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/iscsi-gateway.cfg 2024-06-18T02:07:11.190 INFO:journalctl@ceph.mon.c.smithi007.stdout: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/tcmu-runner-entrypoint.sh 2024-06-18T02:07:11.190 INFO:journalctl@ceph.mon.c.smithi007.stdout: Non-zero exit code 1 from systemctl restart ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd 2024-06-18T02:07:11.190 INFO:journalctl@ceph.mon.c.smithi007.stdout: systemctl: stderr Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:07:11.191 INFO:journalctl@ceph.mon.c.smithi007.stdout: systemctl: stderr See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:07:11.191 INFO:journalctl@ceph.mon.c.smithi007.stdout: Traceback (most recent call last): 2024-06-18T02:07:11.191 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-06-18T02:07:11.191 INFO:journalctl@ceph.mon.c.smithi007.stdout: return _run_code(code, main_globals, None, 2024-06-18T02:07:11.191 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-06-18T02:07:11.191 INFO:journalctl@ceph.mon.c.smithi007.stdout: exec(code, run_globals) 2024-06-18T02:07:11.191 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5618, in 2024-06-18T02:07:11.191 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5606, in main 2024-06-18T02:07:11.191 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3096, in command_deploy_from 2024-06-18T02:07:11.191 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3131, in _common_deploy 2024-06-18T02:07:11.191 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3151, in _deploy_daemon_container 2024-06-18T02:07:11.191 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 1123, in deploy_daemon 2024-06-18T02:07:11.192 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-06-18T02:07:11.192 INFO:journalctl@ceph.mon.c.smithi007.stdout: RuntimeError: Failed command: systemctl restart ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd: Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:07:11.192 INFO:journalctl@ceph.mon.c.smithi007.stdout: See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:07:11.192 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:10 smithi007 ceph-mon[29879]: Reconfiguring daemon agent.smithi130 on smithi130 2024-06-18T02:07:11.192 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:10 smithi007 ceph-mon[29879]: Deploying cephadm binary to smithi130 2024-06-18T02:07:12.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:11 smithi130 ceph-mon[26123]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:07:12.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:11 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:12.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:11 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:12.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:11 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:12.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:11 smithi007 ceph-mon[25091]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:07:12.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:11 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:12.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:11 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:12.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:11 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:12.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:11 smithi007 ceph-mon[29879]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:07:12.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:11 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:12.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:11 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:12.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:11 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:12.778 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:12 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[45479]: ts=2024-06-18T02:07:12.314Z caller=manager.go:609 level=warn component="rule manager" group=pools msg="Evaluating rule failed" rule="alert: CephPoolGrowthWarning\nexpr: (predict_linear(ceph_pool_percent_used[2d], 3600 * 24 * 5) * on(pool_id) group_right()\n ceph_pool_metadata) >= 95\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.9.2\n severity: warning\n type: ceph_default\nannotations:\n description: |\n Pool '{{ $labels.name }}' will be full in less than 5 days assuming the average fill-up rate of the past 48 hours.\n summary: Pool growth rate may soon exceed it's capacity\n" err="found duplicate series for the match group {pool_id=\"1\"} on the left hand-side of the operation: [{instance=\"172.21.15.7:9283\", job=\"ceph\", pool_id=\"1\"}, {instance=\"172.21.15.130:9283\", job=\"ceph\", pool_id=\"1\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-06-18T02:07:13.042 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:12 smithi130 ceph-mon[26123]: Reconfiguring prometheus.a (dependencies changed)... 2024-06-18T02:07:13.042 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:12 smithi130 ceph-mon[26123]: Reconfiguring daemon prometheus.a on smithi130 2024-06-18T02:07:13.181 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:12 smithi007 ceph-mon[29879]: Reconfiguring prometheus.a (dependencies changed)... 2024-06-18T02:07:13.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:12 smithi007 ceph-mon[29879]: Reconfiguring daemon prometheus.a on smithi130 2024-06-18T02:07:13.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:12 smithi007 ceph-mon[25091]: Reconfiguring prometheus.a (dependencies changed)... 2024-06-18T02:07:13.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:12 smithi007 ceph-mon[25091]: Reconfiguring daemon prometheus.a on smithi130 2024-06-18T02:07:13.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:13 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:07:13] "GET /metrics HTTP/1.1" 200 38143 "" "Prometheus/2.33.4" 2024-06-18T02:07:14.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:13 smithi130 ceph-mon[26123]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-06-18T02:07:14.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:13 smithi007 ceph-mon[25091]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-06-18T02:07:14.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:13 smithi007 ceph-mon[29879]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-06-18T02:07:14.763 INFO:teuthology.orchestra.run.smithi007.stdout:true 2024-06-18T02:07:15.456 INFO:teuthology.orchestra.run.smithi007.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-18T02:07:15.457 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi007 smithi007 starting - - - - 2024-06-18T02:07:15.457 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi130 smithi130 starting - - - - 2024-06-18T02:07:15.457 INFO:teuthology.orchestra.run.smithi007.stdout:alertmanager.a smithi007 *:9093,9094 starting - - - - 2024-06-18T02:07:15.457 INFO:teuthology.orchestra.run.smithi007.stdout:grafana.a smithi130 *:3000 running (4m) 48s ago 4m 55.4M - 8.3.5 dad864ee21e9 b39a3781d434 2024-06-18T02:07:15.457 INFO:teuthology.orchestra.run.smithi007.stdout:iscsi.foo.smithi007.xvdrwd smithi007 running (3m) 36s ago 3m 48.7M - 3.5 e1d6a67b021e da0b75a0afdc 2024-06-18T02:07:15.457 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.x smithi130 *:8443,9283 starting - - - - 2024-06-18T02:07:15.457 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.y smithi007 *:9283 running (11m) 36s ago 11m 466M - 17.2.0 e1d6a67b021e 78a1afd0bddd 2024-06-18T02:07:15.457 INFO:teuthology.orchestra.run.smithi007.stdout:mon.a smithi007 running (11m) 36s ago 11m 53.3M 2048M 17.2.0 e1d6a67b021e 147f3ea02ae3 2024-06-18T02:07:15.457 INFO:teuthology.orchestra.run.smithi007.stdout:mon.b smithi130 running (9m) 48s ago 9m 41.2M 2048M 17.2.0 e1d6a67b021e a0b38a9a595f 2024-06-18T02:07:15.457 INFO:teuthology.orchestra.run.smithi007.stdout:mon.c smithi007 running (10m) 36s ago 10m 40.4M 2048M 17.2.0 e1d6a67b021e 1d1e2628656b 2024-06-18T02:07:15.457 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.a smithi007 *:9100 starting - - - - 2024-06-18T02:07:15.458 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.b smithi130 *:9100 running (5m) 48s ago 5m 16.0M - 1dbe0e931976 02601fb28ea2 2024-06-18T02:07:15.458 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0 smithi007 running (9m) 36s ago 9m 52.9M 4096M 17.2.0 e1d6a67b021e 1ef6e23afd55 2024-06-18T02:07:15.458 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1 smithi007 running (8m) 36s ago 8m 53.6M 4096M 17.2.0 e1d6a67b021e a967706523cb 2024-06-18T02:07:15.458 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2 smithi007 running (8m) 36s ago 8m 47.8M 4096M 17.2.0 e1d6a67b021e 2c1b76bd0876 2024-06-18T02:07:15.458 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3 smithi007 running (8m) 36s ago 8m 51.7M 4096M 17.2.0 e1d6a67b021e 8b91b2a07564 2024-06-18T02:07:15.458 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4 smithi130 running (7m) 48s ago 7m 53.7M 4096M 17.2.0 e1d6a67b021e c428dccffdf0 2024-06-18T02:07:15.458 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5 smithi130 running (7m) 48s ago 7m 52.5M 4096M 17.2.0 e1d6a67b021e f645d7f12378 2024-06-18T02:07:15.458 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6 smithi130 running (6m) 48s ago 6m 47.9M 4096M 17.2.0 e1d6a67b021e c7af86c14959 2024-06-18T02:07:15.458 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7 smithi130 running (6m) 48s ago 6m 51.4M 4096M 17.2.0 e1d6a67b021e 3688af8b2c46 2024-06-18T02:07:15.458 INFO:teuthology.orchestra.run.smithi007.stdout:prometheus.a smithi130 *:9095 running (4m) 48s ago 5m 68.0M - 514e6a882f6e 5b12ac431abe 2024-06-18T02:07:15.458 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi007.dvbvbk smithi007 *:8000 running (4m) 36s ago 4m 73.3M - 17.2.0 e1d6a67b021e 1344b55b763c 2024-06-18T02:07:15.458 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi130.aakmof smithi130 *:8000 running (4m) 48s ago 4m 71.4M - 17.2.0 e1d6a67b021e e257e3230c6c 2024-06-18T02:07:15.458 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi007.hgrnmk smithi007 *:80 running (3m) 36s ago 3m 71.9M - 17.2.0 e1d6a67b021e 2173947bc4d6 2024-06-18T02:07:15.459 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi130.wwebfk smithi130 *:80 running (3m) 48s ago 3m 73.2M - 17.2.0 e1d6a67b021e 8662706b2231 2024-06-18T02:07:15.875 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:07:15.875 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": { 2024-06-18T02:07:15.875 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-06-18T02:07:15.875 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:07:15.875 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": { 2024-06-18T02:07:15.875 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 1, 2024-06-18T02:07:15.875 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 1 2024-06-18T02:07:15.875 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:07:15.876 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": { 2024-06-18T02:07:15.876 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-06-18T02:07:15.876 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:07:15.876 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": {}, 2024-06-18T02:07:15.876 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw": { 2024-06-18T02:07:15.876 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-06-18T02:07:15.876 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:07:15.876 INFO:teuthology.orchestra.run.smithi007.stdout: "overall": { 2024-06-18T02:07:15.876 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 16, 2024-06-18T02:07:15.876 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 1 2024-06-18T02:07:15.876 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-06-18T02:07:15.877 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:07:16.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:15 smithi130 ceph-mon[26123]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-06-18T02:07:16.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:15 smithi130 ceph-mon[26123]: from='client.25117 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:07:16.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:15 smithi130 ceph-mon[26123]: from='client.25123 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:07:16.108 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:15 smithi007 ceph-mon[25091]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-06-18T02:07:16.108 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:15 smithi007 ceph-mon[25091]: from='client.25117 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:07:16.108 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:15 smithi007 ceph-mon[25091]: from='client.25123 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:07:16.108 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:15 smithi007 ceph-mon[29879]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-06-18T02:07:16.109 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:15 smithi007 ceph-mon[29879]: from='client.25117 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:07:16.109 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:15 smithi007 ceph-mon[29879]: from='client.25123 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:07:16.227 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:07:16.227 INFO:teuthology.orchestra.run.smithi007.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00", 2024-06-18T02:07:16.227 INFO:teuthology.orchestra.run.smithi007.stdout: "in_progress": true, 2024-06-18T02:07:16.227 INFO:teuthology.orchestra.run.smithi007.stdout: "which": "Upgrading all daemon types on all hosts", 2024-06-18T02:07:16.228 INFO:teuthology.orchestra.run.smithi007.stdout: "services_complete": [], 2024-06-18T02:07:16.228 INFO:teuthology.orchestra.run.smithi007.stdout: "progress": "", 2024-06-18T02:07:16.228 INFO:teuthology.orchestra.run.smithi007.stdout: "message": "", 2024-06-18T02:07:16.228 INFO:teuthology.orchestra.run.smithi007.stdout: "is_paused": false 2024-06-18T02:07:16.228 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:07:16.427 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:07:16 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[63807]: level=info ts=2024-06-18T02:07:16.339Z caller=cluster.go:688 component=cluster msg="gossip settled; proceeding" elapsed=10.003534487s 2024-06-18T02:07:16.661 INFO:teuthology.orchestra.run.smithi007.stdout:HEALTH_OK 2024-06-18T02:07:16.965 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:16 smithi007 ceph-mon[25091]: from='client.25129 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:07:16.965 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:16 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/4082526338' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:07:16.966 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:16 smithi007 ceph-mon[25091]: from='client.25141 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:07:16.966 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:16 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/615920431' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:07:16.966 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:16 smithi007 ceph-mon[29879]: from='client.25129 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:07:16.966 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:16 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/4082526338' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:07:16.966 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:16 smithi007 ceph-mon[29879]: from='client.25141 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:07:16.966 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:16 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/615920431' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:07:17.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:16 smithi130 ceph-mon[26123]: from='client.25129 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:07:17.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:16 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/4082526338' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:07:17.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:16 smithi130 ceph-mon[26123]: from='client.25141 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:07:17.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:16 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/615920431' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:07:18.037 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:17 smithi007 ceph-mon[25091]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-06-18T02:07:18.037 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:17 smithi007 ceph-mon[29879]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-06-18T02:07:18.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:17 smithi130 ceph-mon[26123]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-06-18T02:07:18.934 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:18 smithi130 systemd[1]: Stopping Ceph prometheus.a for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:07:19.543 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:19 smithi130 bash[54422]: Error: no container with name or ID "ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus.a" found: no such container 2024-06-18T02:07:19.544 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:19 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[45479]: ts=2024-06-18T02:07:19.359Z caller=main.go:775 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-06-18T02:07:19.544 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:19 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[45479]: ts=2024-06-18T02:07:19.359Z caller=main.go:798 level=info msg="Stopping scrape discovery manager..." 2024-06-18T02:07:19.544 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:19 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[45479]: ts=2024-06-18T02:07:19.359Z caller=main.go:812 level=info msg="Stopping notify discovery manager..." 2024-06-18T02:07:19.544 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:19 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[45479]: ts=2024-06-18T02:07:19.359Z caller=main.go:834 level=info msg="Stopping scrape manager..." 2024-06-18T02:07:19.544 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:19 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[45479]: ts=2024-06-18T02:07:19.359Z caller=main.go:794 level=info msg="Scrape discovery manager stopped" 2024-06-18T02:07:19.544 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:19 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[45479]: ts=2024-06-18T02:07:19.360Z caller=manager.go:945 level=info component="rule manager" msg="Stopping rule manager..." 2024-06-18T02:07:19.544 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:19 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[45479]: ts=2024-06-18T02:07:19.360Z caller=main.go:828 level=info msg="Scrape manager stopped" 2024-06-18T02:07:19.544 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:19 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[45479]: ts=2024-06-18T02:07:19.360Z caller=manager.go:955 level=info component="rule manager" msg="Rule manager stopped" 2024-06-18T02:07:19.544 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:19 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[45479]: ts=2024-06-18T02:07:19.360Z caller=notifier.go:600 level=info component=notifier msg="Stopping notification manager..." 2024-06-18T02:07:19.544 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:19 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[45479]: ts=2024-06-18T02:07:19.360Z caller=main.go:1054 level=info msg="Notifier manager stopped" 2024-06-18T02:07:19.544 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:19 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[45479]: ts=2024-06-18T02:07:19.359Z caller=main.go:808 level=info msg="Notify discovery manager stopped" 2024-06-18T02:07:19.544 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:19 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[45479]: ts=2024-06-18T02:07:19.360Z caller=main.go:1066 level=info msg="See you next time!" 2024-06-18T02:07:19.544 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:19 smithi130 podman[54456]: 2024-06-18 02:07:19.370592833 +0000 UTC m=+0.115281016 container died 5b12ac431abe416e33ce133eb664b37ad1ba430038cffa488bf2807a1793beb1 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-06-18T02:07:19.951 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:19 smithi130 ceph-mon[26123]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-06-18T02:07:19.951 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:19 smithi130 podman[54456]: 2024-06-18 02:07:19.70915883 +0000 UTC m=+0.453847010 container cleanup 5b12ac431abe416e33ce133eb664b37ad1ba430038cffa488bf2807a1793beb1 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-06-18T02:07:19.951 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:19 smithi130 bash[54456]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a 2024-06-18T02:07:20.093 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:19 smithi007 ceph-mon[25091]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-06-18T02:07:20.093 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:19 smithi007 ceph-mon[29879]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-06-18T02:07:20.231 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:19 smithi130 podman[54483]: 2024-06-18 02:07:19.952461501 +0000 UTC m=+0.582652943 container remove 5b12ac431abe416e33ce133eb664b37ad1ba430038cffa488bf2807a1793beb1 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-06-18T02:07:20.231 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:19 smithi130 bash[54519]: Error: no container with name or ID "ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus.a" found: no such container 2024-06-18T02:07:20.231 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:19 smithi130 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@prometheus.a.service: Deactivated successfully. 2024-06-18T02:07:20.231 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:19 smithi130 systemd[1]: Stopped Ceph prometheus.a for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:07:20.231 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:19 smithi130 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@prometheus.a.service: Consumed 1.372s CPU time. 2024-06-18T02:07:20.232 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:19 smithi130 systemd[1]: Starting Ceph prometheus.a for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:07:21.142 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:20 smithi130 podman[54622]: 2024-06-18 02:07:20.764858732 +0000 UTC m=+0.019735198 image pull 514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d quay.io/prometheus/prometheus:v2.33.4 2024-06-18T02:07:21.142 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:20 smithi130 podman[54622]: 2024-06-18 02:07:20.891142579 +0000 UTC m=+0.146019043 container create eba01af28dcabfaefaa8a3fe462b22626d89b80f0432576d05906d4bb5aa8f7e (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-06-18T02:07:21.142 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:21 smithi130 podman[54622]: 2024-06-18 02:07:21.143673884 +0000 UTC m=+0.398550349 container init eba01af28dcabfaefaa8a3fe462b22626d89b80f0432576d05906d4bb5aa8f7e (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-06-18T02:07:21.417 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:21 smithi130 podman[54622]: 2024-06-18 02:07:21.147389801 +0000 UTC m=+0.402266273 container start eba01af28dcabfaefaa8a3fe462b22626d89b80f0432576d05906d4bb5aa8f7e (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-06-18T02:07:21.417 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:21 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[54666]: ts=2024-06-18T02:07:21.171Z caller=main.go:475 level=info msg="No time or size retention was set so using the default time retention" duration=15d 2024-06-18T02:07:21.417 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:21 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[54666]: ts=2024-06-18T02:07:21.171Z caller=main.go:512 level=info msg="Starting Prometheus" version="(version=2.33.4, branch=HEAD, revision=83032011a5d3e6102624fe58241a374a7201fee8)" 2024-06-18T02:07:21.417 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:21 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[54666]: ts=2024-06-18T02:07:21.171Z caller=main.go:517 level=info build_context="(go=go1.17.7, user=root@d13bf69e7be8, date=20220222-16:51:28)" 2024-06-18T02:07:21.417 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:21 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[54666]: ts=2024-06-18T02:07:21.171Z caller=main.go:518 level=info host_details="(Linux 5.14.0-460.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024 x86_64 smithi130 (none))" 2024-06-18T02:07:21.417 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:21 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[54666]: ts=2024-06-18T02:07:21.171Z caller=main.go:519 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-06-18T02:07:21.417 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:21 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[54666]: ts=2024-06-18T02:07:21.172Z caller=main.go:520 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-06-18T02:07:21.418 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:21 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[54666]: ts=2024-06-18T02:07:21.173Z caller=web.go:570 level=info component=web msg="Start listening for connections" address=:9095 2024-06-18T02:07:21.418 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:21 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[54666]: ts=2024-06-18T02:07:21.173Z caller=main.go:923 level=info msg="Starting TSDB ..." 2024-06-18T02:07:21.418 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:21 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[54666]: ts=2024-06-18T02:07:21.174Z caller=tls_config.go:195 level=info component=web msg="TLS is disabled." http2=false 2024-06-18T02:07:21.418 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:21 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[54666]: ts=2024-06-18T02:07:21.176Z caller=head.go:493 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-06-18T02:07:21.418 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:21 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[54666]: ts=2024-06-18T02:07:21.176Z caller=head.go:527 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.598µs 2024-06-18T02:07:21.418 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:21 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[54666]: ts=2024-06-18T02:07:21.176Z caller=head.go:533 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-06-18T02:07:21.418 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:21 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[54666]: ts=2024-06-18T02:07:21.177Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=2 2024-06-18T02:07:21.418 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:21 smithi130 bash[54622]: eba01af28dcabfaefaa8a3fe462b22626d89b80f0432576d05906d4bb5aa8f7e 2024-06-18T02:07:21.418 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:21 smithi130 systemd[1]: Started Ceph prometheus.a for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:07:21.688 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:21 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[54666]: ts=2024-06-18T02:07:21.625Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=2 2024-06-18T02:07:21.688 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:21 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[54666]: ts=2024-06-18T02:07:21.625Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=2 maxSegment=2 2024-06-18T02:07:21.688 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:21 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[54666]: ts=2024-06-18T02:07:21.626Z caller=head.go:610 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=29.72µs wal_replay_duration=449.41517ms total_replay_duration=449.45876ms 2024-06-18T02:07:21.688 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:21 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[54666]: ts=2024-06-18T02:07:21.628Z caller=main.go:944 level=info fs_type=XFS_SUPER_MAGIC 2024-06-18T02:07:21.688 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:21 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[54666]: ts=2024-06-18T02:07:21.628Z caller=main.go:947 level=info msg="TSDB started" 2024-06-18T02:07:21.688 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:21 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[54666]: ts=2024-06-18T02:07:21.628Z caller=main.go:1128 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-06-18T02:07:21.689 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:21 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[54666]: ts=2024-06-18T02:07:21.650Z caller=main.go:1165 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=22.007054ms db_storage=774ns remote_storage=1.602µs web_handler=377ns query_engine=596ns scrape=430.694µs scrape_sd=109.517µs notify=10.945µs notify_sd=9.3µs rules=21.050061ms 2024-06-18T02:07:21.689 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:21 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[54666]: ts=2024-06-18T02:07:21.650Z caller=main.go:896 level=info msg="Server is ready to receive web requests." 2024-06-18T02:07:22.032 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:21 smithi130 ceph-mon[26123]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-06-18T02:07:22.032 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:21 smithi130 ceph-mon[26123]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:07:22.032 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:21 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/3891824285' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-18T02:07:22.032 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:21 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:22.032 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:21 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:22.032 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:21 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/506576380' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/1809748982"}]: dispatch 2024-06-18T02:07:22.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:21 smithi007 ceph-mon[25091]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-06-18T02:07:22.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:21 smithi007 ceph-mon[25091]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:07:22.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:21 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/3891824285' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-18T02:07:22.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:21 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:22.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:21 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:22.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:21 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/506576380' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/1809748982"}]: dispatch 2024-06-18T02:07:22.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:21 smithi007 ceph-mon[29879]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-06-18T02:07:22.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:21 smithi007 ceph-mon[29879]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:07:22.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:21 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/3891824285' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-18T02:07:22.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:21 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:22.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:21 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:22.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:21 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/506576380' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/1809748982"}]: dispatch 2024-06-18T02:07:23.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:22 smithi130 ceph-mon[26123]: Reconfiguring node-exporter.b (dependencies changed)... 2024-06-18T02:07:23.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:22 smithi130 ceph-mon[26123]: Reconfiguring daemon node-exporter.b on smithi130 2024-06-18T02:07:23.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:22 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/506576380' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/1809748982"}]': finished 2024-06-18T02:07:23.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:22 smithi130 ceph-mon[26123]: osdmap e99: 8 total, 8 up, 8 in 2024-06-18T02:07:23.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:22 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/2657719434' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/640466922"}]: dispatch 2024-06-18T02:07:23.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:22 smithi130 ceph-mon[26123]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/640466922"}]: dispatch 2024-06-18T02:07:23.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:22 smithi007 ceph-mon[25091]: Reconfiguring node-exporter.b (dependencies changed)... 2024-06-18T02:07:23.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:22 smithi007 ceph-mon[25091]: Reconfiguring daemon node-exporter.b on smithi130 2024-06-18T02:07:23.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:22 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/506576380' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/1809748982"}]': finished 2024-06-18T02:07:23.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:22 smithi007 ceph-mon[25091]: osdmap e99: 8 total, 8 up, 8 in 2024-06-18T02:07:23.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:22 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/2657719434' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/640466922"}]: dispatch 2024-06-18T02:07:23.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:22 smithi007 ceph-mon[25091]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/640466922"}]: dispatch 2024-06-18T02:07:23.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:22 smithi007 ceph-mon[29879]: Reconfiguring node-exporter.b (dependencies changed)... 2024-06-18T02:07:23.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:22 smithi007 ceph-mon[29879]: Reconfiguring daemon node-exporter.b on smithi130 2024-06-18T02:07:23.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:22 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/506576380' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/1809748982"}]': finished 2024-06-18T02:07:23.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:22 smithi007 ceph-mon[29879]: osdmap e99: 8 total, 8 up, 8 in 2024-06-18T02:07:23.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:22 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/2657719434' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/640466922"}]: dispatch 2024-06-18T02:07:23.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:22 smithi007 ceph-mon[29879]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/640466922"}]: dispatch 2024-06-18T02:07:23.415 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:23 smithi130 systemd[1]: Stopping Ceph node-exporter.b for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:07:23.415 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:23 smithi130 bash[55007]: Error: no container with name or ID "ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter.b" found: no such container 2024-06-18T02:07:24.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:23 smithi007 ceph-mon[25091]: pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 102 B/s rd, 0 op/s 2024-06-18T02:07:24.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:23 smithi007 ceph-mon[25091]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/640466922"}]': finished 2024-06-18T02:07:24.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:23 smithi007 ceph-mon[25091]: osdmap e100: 8 total, 8 up, 8 in 2024-06-18T02:07:24.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:23 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/2636704799' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6801/644881545"}]: dispatch 2024-06-18T02:07:24.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:23 smithi007 ceph-mon[25091]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6801/644881545"}]: dispatch 2024-06-18T02:07:24.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:23 smithi007 ceph-mon[29879]: pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 102 B/s rd, 0 op/s 2024-06-18T02:07:24.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:23 smithi007 ceph-mon[29879]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/640466922"}]': finished 2024-06-18T02:07:24.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:23 smithi007 ceph-mon[29879]: osdmap e100: 8 total, 8 up, 8 in 2024-06-18T02:07:24.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:23 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/2636704799' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6801/644881545"}]: dispatch 2024-06-18T02:07:24.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:23 smithi007 ceph-mon[29879]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6801/644881545"}]: dispatch 2024-06-18T02:07:24.221 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:23 smithi130 podman[55029]: 2024-06-18 02:07:23.990311868 +0000 UTC m=+0.763684004 container died 02601fb28ea2a255fc8df25ee2591541f44c91199fa5ce93e81b5c6ad5490aff (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-06-18T02:07:24.222 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:23 smithi130 ceph-mon[26123]: pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 102 B/s rd, 0 op/s 2024-06-18T02:07:24.222 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:23 smithi130 ceph-mon[26123]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/640466922"}]': finished 2024-06-18T02:07:24.222 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:23 smithi130 ceph-mon[26123]: osdmap e100: 8 total, 8 up, 8 in 2024-06-18T02:07:24.222 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:23 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/2636704799' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6801/644881545"}]: dispatch 2024-06-18T02:07:24.222 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:23 smithi130 ceph-mon[26123]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6801/644881545"}]: dispatch 2024-06-18T02:07:24.543 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:24 smithi130 podman[55029]: 2024-06-18 02:07:24.396895029 +0000 UTC m=+1.170267165 container cleanup 02601fb28ea2a255fc8df25ee2591541f44c91199fa5ce93e81b5c6ad5490aff (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-06-18T02:07:24.543 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:24 smithi130 bash[55029]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b 2024-06-18T02:07:24.543 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:24 smithi130 bash[55112]: Error: no container with name or ID "ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter.b" found: no such container 2024-06-18T02:07:25.010 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:24 smithi130 podman[55082]: 2024-06-18 02:07:24.623746631 +0000 UTC m=+0.634548274 container remove 02601fb28ea2a255fc8df25ee2591541f44c91199fa5ce93e81b5c6ad5490aff (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-06-18T02:07:25.010 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:24 smithi130 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@node-exporter.b.service: Main process exited, code=exited, status=143/n/a 2024-06-18T02:07:25.010 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:24 smithi130 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@node-exporter.b.service: Failed with result 'exit-code'. 2024-06-18T02:07:25.010 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:24 smithi130 systemd[1]: Stopped Ceph node-exporter.b for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:07:25.011 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:24 smithi130 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@node-exporter.b.service: Consumed 2.761s CPU time. 2024-06-18T02:07:25.011 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:24 smithi130 systemd[1]: Starting Ceph node-exporter.b for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:07:25.599 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:25 smithi130 ceph-mon[26123]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6801/644881545"}]': finished 2024-06-18T02:07:25.599 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:25 smithi130 ceph-mon[26123]: osdmap e101: 8 total, 8 up, 8 in 2024-06-18T02:07:25.599 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:25 smithi130 ceph-mon[26123]: pgmap v23: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-06-18T02:07:25.599 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:25 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/1578354721' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/1915617152"}]: dispatch 2024-06-18T02:07:25.599 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:25 smithi130 podman[55248]: 2024-06-18 02:07:25.392513337 +0000 UTC m=+0.018797196 image pull 1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26 quay.io/prometheus/node-exporter:v1.3.1 2024-06-18T02:07:25.599 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:25 smithi130 podman[55248]: 2024-06-18 02:07:25.520215157 +0000 UTC m=+0.146499000 container create bab93b43cf16c67e0d51cd4b318d5c663ef64e31afb4174201d2415c529abad5 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-06-18T02:07:25.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:25 smithi007 ceph-mon[25091]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6801/644881545"}]': finished 2024-06-18T02:07:25.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:25 smithi007 ceph-mon[25091]: osdmap e101: 8 total, 8 up, 8 in 2024-06-18T02:07:25.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:25 smithi007 ceph-mon[25091]: pgmap v23: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-06-18T02:07:25.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:25 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/1578354721' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/1915617152"}]: dispatch 2024-06-18T02:07:25.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:25 smithi007 ceph-mon[29879]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6801/644881545"}]': finished 2024-06-18T02:07:25.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:25 smithi007 ceph-mon[29879]: osdmap e101: 8 total, 8 up, 8 in 2024-06-18T02:07:25.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:25 smithi007 ceph-mon[29879]: pgmap v23: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-06-18T02:07:25.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:25 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/1578354721' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/1915617152"}]: dispatch 2024-06-18T02:07:26.044 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:25 smithi130 podman[55248]: 2024-06-18 02:07:25.663876589 +0000 UTC m=+0.290160448 container init bab93b43cf16c67e0d51cd4b318d5c663ef64e31afb4174201d2415c529abad5 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-06-18T02:07:26.044 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:25 smithi130 podman[55248]: 2024-06-18 02:07:25.666938069 +0000 UTC m=+0.293221921 container start bab93b43cf16c67e0d51cd4b318d5c663ef64e31afb4174201d2415c529abad5 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-06-18T02:07:26.044 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[55291]: ts=2024-06-18T02:07:25.670Z caller=node_exporter.go:182 level=info msg="Starting node_exporter" version="(version=1.3.1, branch=HEAD, revision=a2321e7b940ddcff26873612bccdf7cd4c42b6b6)" 2024-06-18T02:07:26.044 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[55291]: ts=2024-06-18T02:07:25.670Z caller=node_exporter.go:183 level=info msg="Build context" build_context="(go=go1.17.3, user=root@243aafa5525c, date=20211205-11:09:49)" 2024-06-18T02:07:26.044 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[55291]: ts=2024-06-18T02:07:25.671Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+)($|/) 2024-06-18T02:07:26.044 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[55291]: ts=2024-06-18T02:07:25.671Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-06-18T02:07:26.044 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[55291]: ts=2024-06-18T02:07:25.671Z caller=node_exporter.go:108 level=info msg="Enabled collectors" 2024-06-18T02:07:26.044 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[55291]: ts=2024-06-18T02:07:25.671Z caller=node_exporter.go:115 level=info collector=arp 2024-06-18T02:07:26.044 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[55291]: ts=2024-06-18T02:07:25.671Z caller=node_exporter.go:115 level=info collector=bcache 2024-06-18T02:07:26.044 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[55291]: ts=2024-06-18T02:07:25.671Z caller=node_exporter.go:115 level=info collector=bonding 2024-06-18T02:07:26.044 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[55291]: ts=2024-06-18T02:07:25.671Z caller=node_exporter.go:115 level=info collector=btrfs 2024-06-18T02:07:26.045 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[55291]: ts=2024-06-18T02:07:25.671Z caller=node_exporter.go:115 level=info collector=conntrack 2024-06-18T02:07:26.045 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[55291]: ts=2024-06-18T02:07:25.671Z caller=node_exporter.go:115 level=info collector=cpu 2024-06-18T02:07:26.045 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[55291]: ts=2024-06-18T02:07:25.671Z caller=node_exporter.go:115 level=info collector=cpufreq 2024-06-18T02:07:26.045 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[55291]: ts=2024-06-18T02:07:25.671Z caller=node_exporter.go:115 level=info collector=diskstats 2024-06-18T02:07:26.045 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[55291]: ts=2024-06-18T02:07:25.671Z caller=node_exporter.go:115 level=info collector=dmi 2024-06-18T02:07:26.045 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[55291]: ts=2024-06-18T02:07:25.671Z caller=node_exporter.go:115 level=info collector=edac 2024-06-18T02:07:26.045 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[55291]: ts=2024-06-18T02:07:25.671Z caller=node_exporter.go:115 level=info collector=entropy 2024-06-18T02:07:26.045 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[55291]: ts=2024-06-18T02:07:25.671Z caller=node_exporter.go:115 level=info collector=fibrechannel 2024-06-18T02:07:26.046 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[55291]: ts=2024-06-18T02:07:25.671Z caller=node_exporter.go:115 level=info collector=filefd 2024-06-18T02:07:26.046 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[55291]: ts=2024-06-18T02:07:25.671Z caller=node_exporter.go:115 level=info collector=filesystem 2024-06-18T02:07:26.046 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[55291]: ts=2024-06-18T02:07:25.671Z caller=node_exporter.go:115 level=info collector=hwmon 2024-06-18T02:07:26.046 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[55291]: ts=2024-06-18T02:07:25.671Z caller=node_exporter.go:115 level=info collector=infiniband 2024-06-18T02:07:26.046 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[55291]: ts=2024-06-18T02:07:25.671Z caller=node_exporter.go:115 level=info collector=ipvs 2024-06-18T02:07:26.046 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[55291]: ts=2024-06-18T02:07:25.671Z caller=node_exporter.go:115 level=info collector=loadavg 2024-06-18T02:07:26.046 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[55291]: ts=2024-06-18T02:07:25.671Z caller=node_exporter.go:115 level=info collector=mdadm 2024-06-18T02:07:26.046 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[55291]: ts=2024-06-18T02:07:25.671Z caller=node_exporter.go:115 level=info collector=meminfo 2024-06-18T02:07:26.046 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[55291]: ts=2024-06-18T02:07:25.671Z caller=node_exporter.go:115 level=info collector=netclass 2024-06-18T02:07:26.046 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[55291]: ts=2024-06-18T02:07:25.671Z caller=node_exporter.go:115 level=info collector=netdev 2024-06-18T02:07:26.046 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[55291]: ts=2024-06-18T02:07:25.671Z caller=node_exporter.go:115 level=info collector=netstat 2024-06-18T02:07:26.046 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[55291]: ts=2024-06-18T02:07:25.671Z caller=node_exporter.go:115 level=info collector=nfs 2024-06-18T02:07:26.046 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[55291]: ts=2024-06-18T02:07:25.671Z caller=node_exporter.go:115 level=info collector=nfsd 2024-06-18T02:07:26.046 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[55291]: ts=2024-06-18T02:07:25.671Z caller=node_exporter.go:115 level=info collector=nvme 2024-06-18T02:07:26.047 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[55291]: ts=2024-06-18T02:07:25.671Z caller=node_exporter.go:115 level=info collector=os 2024-06-18T02:07:26.047 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[55291]: ts=2024-06-18T02:07:25.671Z caller=node_exporter.go:115 level=info collector=powersupplyclass 2024-06-18T02:07:26.047 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[55291]: ts=2024-06-18T02:07:25.671Z caller=node_exporter.go:115 level=info collector=pressure 2024-06-18T02:07:26.047 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[55291]: ts=2024-06-18T02:07:25.671Z caller=node_exporter.go:115 level=info collector=rapl 2024-06-18T02:07:26.047 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[55291]: ts=2024-06-18T02:07:25.671Z caller=node_exporter.go:115 level=info collector=schedstat 2024-06-18T02:07:26.047 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[55291]: ts=2024-06-18T02:07:25.671Z caller=node_exporter.go:115 level=info collector=sockstat 2024-06-18T02:07:26.047 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[55291]: ts=2024-06-18T02:07:25.671Z caller=node_exporter.go:115 level=info collector=softnet 2024-06-18T02:07:26.047 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[55291]: ts=2024-06-18T02:07:25.671Z caller=node_exporter.go:115 level=info collector=stat 2024-06-18T02:07:26.047 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[55291]: ts=2024-06-18T02:07:25.671Z caller=node_exporter.go:115 level=info collector=tapestats 2024-06-18T02:07:26.047 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[55291]: ts=2024-06-18T02:07:25.671Z caller=node_exporter.go:115 level=info collector=textfile 2024-06-18T02:07:26.047 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[55291]: ts=2024-06-18T02:07:25.671Z caller=node_exporter.go:115 level=info collector=thermal_zone 2024-06-18T02:07:26.047 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[55291]: ts=2024-06-18T02:07:25.671Z caller=node_exporter.go:115 level=info collector=time 2024-06-18T02:07:26.047 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[55291]: ts=2024-06-18T02:07:25.671Z caller=node_exporter.go:115 level=info collector=udp_queues 2024-06-18T02:07:26.047 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[55291]: ts=2024-06-18T02:07:25.671Z caller=node_exporter.go:115 level=info collector=uname 2024-06-18T02:07:26.048 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[55291]: ts=2024-06-18T02:07:25.671Z caller=node_exporter.go:115 level=info collector=vmstat 2024-06-18T02:07:26.048 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[55291]: ts=2024-06-18T02:07:25.671Z caller=node_exporter.go:115 level=info collector=xfs 2024-06-18T02:07:26.048 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[55291]: ts=2024-06-18T02:07:25.671Z caller=node_exporter.go:115 level=info collector=zfs 2024-06-18T02:07:26.048 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[55291]: ts=2024-06-18T02:07:25.671Z caller=node_exporter.go:199 level=info msg="Listening on" address=:9100 2024-06-18T02:07:26.048 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:25 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b[55291]: ts=2024-06-18T02:07:25.672Z caller=tls_config.go:195 level=info msg="TLS is disabled." http2=false 2024-06-18T02:07:26.048 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:25 smithi130 bash[55248]: bab93b43cf16c67e0d51cd4b318d5c663ef64e31afb4174201d2415c529abad5 2024-06-18T02:07:26.048 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:07:25 smithi130 systemd[1]: Started Ceph node-exporter.b for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:07:26.583 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:26 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/1578354721' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/1915617152"}]': finished 2024-06-18T02:07:26.583 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:26 smithi130 ceph-mon[26123]: osdmap e102: 8 total, 8 up, 8 in 2024-06-18T02:07:26.584 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:26 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/427641668' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6800/644881545"}]: dispatch 2024-06-18T02:07:26.584 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:26 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:26.584 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:26 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:26.584 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:26 smithi130 ceph-mon[26123]: Reconfiguring grafana.a (dependencies changed)... 2024-06-18T02:07:26.584 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:26 smithi130 ceph-mon[26123]: Regenerating cephadm self-signed grafana TLS certificates 2024-06-18T02:07:26.584 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:26 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:26.584 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:26 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:26.584 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:26 smithi130 ceph-mon[26123]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-06-18T02:07:26.584 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:26 smithi130 ceph-mon[26123]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-06-18T02:07:26.584 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:26 smithi130 ceph-mon[26123]: Reconfiguring daemon grafana.a on smithi130 2024-06-18T02:07:26.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:26 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/1578354721' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/1915617152"}]': finished 2024-06-18T02:07:26.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:26 smithi007 ceph-mon[25091]: osdmap e102: 8 total, 8 up, 8 in 2024-06-18T02:07:26.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:26 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/427641668' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6800/644881545"}]: dispatch 2024-06-18T02:07:26.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:26 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:26.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:26 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:26.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:26 smithi007 ceph-mon[25091]: Reconfiguring grafana.a (dependencies changed)... 2024-06-18T02:07:26.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:26 smithi007 ceph-mon[25091]: Regenerating cephadm self-signed grafana TLS certificates 2024-06-18T02:07:26.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:26 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:26.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:26 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:26.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:26 smithi007 ceph-mon[25091]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-06-18T02:07:26.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:26 smithi007 ceph-mon[25091]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-06-18T02:07:26.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:26 smithi007 ceph-mon[25091]: Reconfiguring daemon grafana.a on smithi130 2024-06-18T02:07:26.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:26 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/1578354721' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/1915617152"}]': finished 2024-06-18T02:07:26.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:26 smithi007 ceph-mon[29879]: osdmap e102: 8 total, 8 up, 8 in 2024-06-18T02:07:26.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:26 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/427641668' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6800/644881545"}]: dispatch 2024-06-18T02:07:26.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:26 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:26.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:26 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:26.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:26 smithi007 ceph-mon[29879]: Reconfiguring grafana.a (dependencies changed)... 2024-06-18T02:07:26.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:26 smithi007 ceph-mon[29879]: Regenerating cephadm self-signed grafana TLS certificates 2024-06-18T02:07:26.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:26 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:26.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:26 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:26.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:26 smithi007 ceph-mon[29879]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-06-18T02:07:26.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:26 smithi007 ceph-mon[29879]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-06-18T02:07:26.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:26 smithi007 ceph-mon[29879]: Reconfiguring daemon grafana.a on smithi130 2024-06-18T02:07:27.581 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:27 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/427641668' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6800/644881545"}]': finished 2024-06-18T02:07:27.581 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:27 smithi130 ceph-mon[26123]: osdmap e103: 8 total, 8 up, 8 in 2024-06-18T02:07:27.581 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:27 smithi130 ceph-mon[26123]: pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:07:27.581 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:27 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/1774046609' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/3007699255"}]: dispatch 2024-06-18T02:07:27.581 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:27 smithi130 ceph-mon[26123]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/3007699255"}]: dispatch 2024-06-18T02:07:27.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:27 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/427641668' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6800/644881545"}]': finished 2024-06-18T02:07:27.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:27 smithi007 ceph-mon[25091]: osdmap e103: 8 total, 8 up, 8 in 2024-06-18T02:07:27.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:27 smithi007 ceph-mon[25091]: pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:07:27.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:27 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/1774046609' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/3007699255"}]: dispatch 2024-06-18T02:07:27.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:27 smithi007 ceph-mon[25091]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/3007699255"}]: dispatch 2024-06-18T02:07:27.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:27 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/427641668' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6800/644881545"}]': finished 2024-06-18T02:07:27.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:27 smithi007 ceph-mon[29879]: osdmap e103: 8 total, 8 up, 8 in 2024-06-18T02:07:27.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:27 smithi007 ceph-mon[29879]: pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:07:27.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:27 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/1774046609' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/3007699255"}]: dispatch 2024-06-18T02:07:27.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:27 smithi007 ceph-mon[29879]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/3007699255"}]: dispatch 2024-06-18T02:07:28.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:27 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:07:27] "GET /metrics HTTP/1.1" 200 38142 "" "Prometheus/2.33.4" 2024-06-18T02:07:28.644 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:28 smithi130 ceph-mon[26123]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/3007699255"}]': finished 2024-06-18T02:07:28.644 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:28 smithi130 ceph-mon[26123]: osdmap e104: 8 total, 8 up, 8 in 2024-06-18T02:07:28.644 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:28 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/3324989771' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/3866859053"}]: dispatch 2024-06-18T02:07:28.644 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:28 smithi130 ceph-mon[26123]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/3866859053"}]: dispatch 2024-06-18T02:07:28.681 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:28 smithi007 ceph-mon[29879]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/3007699255"}]': finished 2024-06-18T02:07:28.681 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:28 smithi007 ceph-mon[29879]: osdmap e104: 8 total, 8 up, 8 in 2024-06-18T02:07:28.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:28 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/3324989771' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/3866859053"}]: dispatch 2024-06-18T02:07:28.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:28 smithi007 ceph-mon[29879]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/3866859053"}]: dispatch 2024-06-18T02:07:28.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:28 smithi007 ceph-mon[25091]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/3007699255"}]': finished 2024-06-18T02:07:28.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:28 smithi007 ceph-mon[25091]: osdmap e104: 8 total, 8 up, 8 in 2024-06-18T02:07:28.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:28 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/3324989771' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/3866859053"}]: dispatch 2024-06-18T02:07:28.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:28 smithi007 ceph-mon[25091]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/3866859053"}]: dispatch 2024-06-18T02:07:29.043 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:28 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[54666]: ts=2024-06-18T02:07:28.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.7\", device_class=\"ssd\", hostname=\"smithi007\", instance=\"172.21.15.130:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.7\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"cd9a3408-2d15-11ef-bc9d-c7b262605968\", cluster_addr=\"172.21.15.7\", device_class=\"ssd\", hostname=\"smithi007\", instance=\"smithi130:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.7\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-06-18T02:07:29.044 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:07:28 smithi130 systemd[1]: Stopping Ceph grafana.a for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:07:29.044 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:07:28 smithi130 bash[55461]: Error: no container with name or ID "ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana.a" found: no such container 2024-06-18T02:07:29.044 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:07:28 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[44491]: t=2024-06-18T02:07:28+0000 lvl=info msg="Shutdown started" logger=server reason="System signal: terminated" 2024-06-18T02:07:29.044 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:07:28 smithi130 podman[55473]: 2024-06-18 02:07:28.893028275 +0000 UTC m=+0.152985537 container died b39a3781d434ca132a78e13692408fa56c2196f07cb4005bbb14901d022b7929 (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a, description=Ceph Grafana Container, name=ubi8, io.buildah.version=1.24.2, summary=Grafana Container configured for Ceph mgr/dashboard integration, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.openshift.expose-services=, vcs-type=git, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, version=8.5, build-date=2022-03-28T10:36:18.413762, release=236.1648460182, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, vendor=Red Hat, Inc., io.k8s.display-name=Red Hat Universal Base Image 8, maintainer=Paul Cuzner , architecture=x86_64, com.redhat.component=ubi8-container, distribution-scope=public, io.openshift.tags=base rhel8) 2024-06-18T02:07:29.507 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:29 smithi130 ceph-mon[26123]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/3866859053"}]': finished 2024-06-18T02:07:29.508 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:29 smithi130 ceph-mon[26123]: osdmap e105: 8 total, 8 up, 8 in 2024-06-18T02:07:29.508 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:29 smithi130 ceph-mon[26123]: pgmap v29: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:07:29.508 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:07:29 smithi130 podman[55473]: 2024-06-18 02:07:29.332482844 +0000 UTC m=+0.592440102 container cleanup b39a3781d434ca132a78e13692408fa56c2196f07cb4005bbb14901d022b7929 (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a, summary=Grafana Container configured for Ceph mgr/dashboard integration, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.buildah.version=1.24.2, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, name=ubi8, io.k8s.display-name=Red Hat Universal Base Image 8, io.openshift.expose-services=, distribution-scope=public, io.openshift.tags=base rhel8, vcs-type=git, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, vendor=Red Hat, Inc., build-date=2022-03-28T10:36:18.413762, com.redhat.component=ubi8-container, maintainer=Paul Cuzner , architecture=x86_64, version=8.5, description=Ceph Grafana Container, release=236.1648460182) 2024-06-18T02:07:29.508 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:07:29 smithi130 bash[55473]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a 2024-06-18T02:07:29.681 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:29 smithi007 ceph-mon[29879]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/3866859053"}]': finished 2024-06-18T02:07:29.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:29 smithi007 ceph-mon[29879]: osdmap e105: 8 total, 8 up, 8 in 2024-06-18T02:07:29.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:29 smithi007 ceph-mon[29879]: pgmap v29: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:07:29.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:29 smithi007 ceph-mon[25091]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/3866859053"}]': finished 2024-06-18T02:07:29.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:29 smithi007 ceph-mon[25091]: osdmap e105: 8 total, 8 up, 8 in 2024-06-18T02:07:29.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:29 smithi007 ceph-mon[25091]: pgmap v29: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:07:29.777 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:07:29 smithi130 podman[55488]: 2024-06-18 02:07:29.509117013 +0000 UTC m=+0.612141515 container remove b39a3781d434ca132a78e13692408fa56c2196f07cb4005bbb14901d022b7929 (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, architecture=x86_64, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, vcs-type=git, io.buildah.version=1.24.2, name=ubi8, com.redhat.component=ubi8-container, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, summary=Grafana Container configured for Ceph mgr/dashboard integration, io.openshift.tags=base rhel8, vendor=Red Hat, Inc., description=Ceph Grafana Container, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.k8s.display-name=Red Hat Universal Base Image 8, maintainer=Paul Cuzner , url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, build-date=2022-03-28T10:36:18.413762, distribution-scope=public, release=236.1648460182, io.openshift.expose-services=, version=8.5) 2024-06-18T02:07:29.777 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:07:29 smithi130 bash[55501]: Error: no container with name or ID "ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana.a" found: no such container 2024-06-18T02:07:29.777 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:07:29 smithi130 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@grafana.a.service: Deactivated successfully. 2024-06-18T02:07:29.777 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:07:29 smithi130 systemd[1]: Stopped Ceph grafana.a for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:07:29.777 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:07:29 smithi130 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@grafana.a.service: Consumed 2.518s CPU time. 2024-06-18T02:07:29.777 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:07:29 smithi130 systemd[1]: Starting Ceph grafana.a for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:07:30.033 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:07:29 smithi130 podman[55563]: 2024-06-18 02:07:29.680529626 +0000 UTC m=+0.016873780 image pull dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01 quay.io/ceph/ceph-grafana:8.3.5 2024-06-18T02:07:30.033 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:07:29 smithi130 podman[55563]: 2024-06-18 02:07:29.785050841 +0000 UTC m=+0.121395026 container create 70ba81d97c8e90c3868d027746ef3dd8099fd81eb528839065e8b8163d29bc9b (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a, version=8.5, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.k8s.display-name=Red Hat Universal Base Image 8, distribution-scope=public, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., release=236.1648460182, architecture=x86_64, vendor=Red Hat, Inc., io.openshift.tags=base rhel8, io.openshift.expose-services=, vcs-type=git, io.buildah.version=1.24.2, summary=Grafana Container configured for Ceph mgr/dashboard integration, com.redhat.component=ubi8-container, description=Ceph Grafana Container, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, maintainer=Paul Cuzner , com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, build-date=2022-03-28T10:36:18.413762, name=ubi8) 2024-06-18T02:07:30.033 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:07:30 smithi130 podman[55563]: 2024-06-18 02:07:30.004061975 +0000 UTC m=+0.340406119 container init 70ba81d97c8e90c3868d027746ef3dd8099fd81eb528839065e8b8163d29bc9b (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a, distribution-scope=public, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, architecture=x86_64, name=ubi8, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, maintainer=Paul Cuzner , summary=Grafana Container configured for Ceph mgr/dashboard integration, version=8.5, build-date=2022-03-28T10:36:18.413762, io.openshift.expose-services=, com.redhat.component=ubi8-container, vendor=Red Hat, Inc., io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.k8s.display-name=Red Hat Universal Base Image 8, vcs-type=git, io.buildah.version=1.24.2, description=Ceph Grafana Container, io.openshift.tags=base rhel8, release=236.1648460182) 2024-06-18T02:07:30.033 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:07:30 smithi130 podman[55563]: 2024-06-18 02:07:30.006903701 +0000 UTC m=+0.343247852 container start 70ba81d97c8e90c3868d027746ef3dd8099fd81eb528839065e8b8163d29bc9b (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a, description=Ceph Grafana Container, release=236.1648460182, vendor=Red Hat, Inc., io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, vcs-type=git, com.redhat.component=ubi8-container, io.k8s.display-name=Red Hat Universal Base Image 8, io.openshift.expose-services=, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, build-date=2022-03-28T10:36:18.413762, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, version=8.5, name=ubi8, summary=Grafana Container configured for Ceph mgr/dashboard integration, distribution-scope=public, io.openshift.tags=base rhel8, maintainer=Paul Cuzner , architecture=x86_64, io.buildah.version=1.24.2) 2024-06-18T02:07:30.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:30 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: [18/Jun/2024:02:07:30] ENGINE Bus STOPPING 2024-06-18T02:07:30.294 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:07:30 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[55577]: t=2024-06-18T02:07:30+0000 lvl=info msg="The state of unified alerting is still not defined. The decision will be made during as we run the database migrations" logger=settings 2024-06-18T02:07:30.294 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:07:30 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[55577]: t=2024-06-18T02:07:30+0000 lvl=warn msg="falling back to legacy setting of 'min_interval_seconds'; please use the configuration option in the `unified_alerting` section if Grafana 8 alerts are enabled." logger=settings 2024-06-18T02:07:30.294 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:07:30 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[55577]: t=2024-06-18T02:07:30+0000 lvl=info msg="Config loaded from" logger=settings file=/usr/share/grafana/conf/defaults.ini 2024-06-18T02:07:30.294 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:07:30 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[55577]: t=2024-06-18T02:07:30+0000 lvl=info msg="Config loaded from" logger=settings file=/etc/grafana/grafana.ini 2024-06-18T02:07:30.294 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:07:30 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[55577]: t=2024-06-18T02:07:30+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_DATA=/var/lib/grafana" 2024-06-18T02:07:30.294 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:07:30 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[55577]: t=2024-06-18T02:07:30+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_LOGS=/var/log/grafana" 2024-06-18T02:07:30.294 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:07:30 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[55577]: t=2024-06-18T02:07:30+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2024-06-18T02:07:30.294 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:07:30 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[55577]: t=2024-06-18T02:07:30+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2024-06-18T02:07:30.294 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:07:30 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[55577]: t=2024-06-18T02:07:30+0000 lvl=info msg="Path Home" logger=settings path=/usr/share/grafana 2024-06-18T02:07:30.294 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:07:30 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[55577]: t=2024-06-18T02:07:30+0000 lvl=info msg="Path Data" logger=settings path=/var/lib/grafana 2024-06-18T02:07:30.295 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:07:30 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[55577]: t=2024-06-18T02:07:30+0000 lvl=info msg="Path Logs" logger=settings path=/var/log/grafana 2024-06-18T02:07:30.295 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:07:30 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[55577]: t=2024-06-18T02:07:30+0000 lvl=info msg="Path Plugins" logger=settings path=/var/lib/grafana/plugins 2024-06-18T02:07:30.295 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:07:30 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[55577]: t=2024-06-18T02:07:30+0000 lvl=info msg="Path Provisioning" logger=settings path=/etc/grafana/provisioning 2024-06-18T02:07:30.295 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:07:30 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[55577]: t=2024-06-18T02:07:30+0000 lvl=info msg="App mode production" logger=settings 2024-06-18T02:07:30.295 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:07:30 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[55577]: t=2024-06-18T02:07:30+0000 lvl=info msg="Connecting to DB" logger=sqlstore dbtype=sqlite3 2024-06-18T02:07:30.295 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:07:30 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[55577]: t=2024-06-18T02:07:30+0000 lvl=warn msg="SQLite database file has broader permissions than it should" logger=sqlstore path=/var/lib/grafana/grafana.db mode=-rw-r--r-- expected=-rw-r----- 2024-06-18T02:07:30.295 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:07:30 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[55577]: t=2024-06-18T02:07:30+0000 lvl=info msg="Starting DB migrations" logger=migrator 2024-06-18T02:07:30.295 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:07:30 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[55577]: t=2024-06-18T02:07:30+0000 lvl=info msg="migrations completed" logger=migrator performed=0 skipped=377 duration=577.012µs 2024-06-18T02:07:30.295 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:07:30 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[55577]: t=2024-06-18T02:07:30+0000 lvl=info msg="Created default organization" logger=sqlstore 2024-06-18T02:07:30.295 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:07:30 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[55577]: t=2024-06-18T02:07:30+0000 lvl=info msg="Initialising plugins" logger=plugin.manager 2024-06-18T02:07:30.295 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:07:30 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[55577]: t=2024-06-18T02:07:30+0000 lvl=info msg="Plugin registered" logger=plugin.manager pluginId=input 2024-06-18T02:07:30.295 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:07:30 smithi130 bash[55563]: 70ba81d97c8e90c3868d027746ef3dd8099fd81eb528839065e8b8163d29bc9b 2024-06-18T02:07:30.295 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:07:30 smithi130 systemd[1]: Started Ceph grafana.a for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:07:30.296 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:07:30 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[55577]: t=2024-06-18T02:07:30+0000 lvl=info msg="Plugin registered" logger=plugin.manager pluginId=vonage-status-panel 2024-06-18T02:07:30.296 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:07:30 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[55577]: t=2024-06-18T02:07:30+0000 lvl=info msg="Plugin registered" logger=plugin.manager pluginId=grafana-piechart-panel 2024-06-18T02:07:30.296 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:07:30 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[55577]: t=2024-06-18T02:07:30+0000 lvl=info msg="Live Push Gateway initialization" logger=live.push_http 2024-06-18T02:07:30.296 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:07:30 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[55577]: t=2024-06-18T02:07:30+0000 lvl=info msg="deleted datasource based on configuration" logger=provisioning.datasources name=Dashboard1 2024-06-18T02:07:30.296 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:07:30 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[55577]: t=2024-06-18T02:07:30+0000 lvl=info msg="inserting datasource from configuration " logger=provisioning.datasources name=Dashboard1 uid=P43CA22E17D0F9596 2024-06-18T02:07:30.296 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:07:30 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[55577]: t=2024-06-18T02:07:30+0000 lvl=info msg="inserting datasource from configuration " logger=provisioning.datasources name=Loki uid=P8E80F9AEF21F6940 2024-06-18T02:07:30.296 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:07:30 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[55577]: t=2024-06-18T02:07:30+0000 lvl=info msg="warming cache for startup" logger=ngalert 2024-06-18T02:07:30.296 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:07:30 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[55577]: t=2024-06-18T02:07:30+0000 lvl=info msg="starting MultiOrg Alertmanager" logger=ngalert.multiorg.alertmanager 2024-06-18T02:07:30.296 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:07:30 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[55577]: t=2024-06-18T02:07:30+0000 lvl=info msg="HTTP Server Listen" logger=http.server address=[::]:3000 protocol=https subUrl= socket= 2024-06-18T02:07:30.793 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:30 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: [18/Jun/2024:02:07:30] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-06-18T02:07:30.794 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:30 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: [18/Jun/2024:02:07:30] ENGINE Bus STOPPED 2024-06-18T02:07:30.794 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:30 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: [18/Jun/2024:02:07:30] ENGINE Bus STARTING 2024-06-18T02:07:30.794 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:30 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: [18/Jun/2024:02:07:30] ENGINE Serving on http://:::9283 2024-06-18T02:07:30.794 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:30 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: [18/Jun/2024:02:07:30] ENGINE Bus STARTED 2024-06-18T02:07:30.794 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:30 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: [18/Jun/2024:02:07:30] ENGINE Bus STOPPING 2024-06-18T02:07:31.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:31 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:31.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:31 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:31.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:31 smithi007 ceph-mon[25091]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-06-18T02:07:31.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:31 smithi007 ceph-mon[25091]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-06-18T02:07:31.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:31 smithi007 ceph-mon[25091]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi007.front.sepia.ceph.com:9093"}]: dispatch 2024-06-18T02:07:31.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:31 smithi007 ceph-mon[25091]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi007.front.sepia.ceph.com:9093"}]: dispatch 2024-06-18T02:07:31.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:31 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:31.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:31 smithi007 ceph-mon[25091]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-06-18T02:07:31.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:31 smithi007 ceph-mon[25091]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-06-18T02:07:31.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:31 smithi007 ceph-mon[25091]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi130.front.sepia.ceph.com:9095"}]: dispatch 2024-06-18T02:07:31.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:31 smithi007 ceph-mon[25091]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi130.front.sepia.ceph.com:9095"}]: dispatch 2024-06-18T02:07:31.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:31 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:31.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:31 smithi007 ceph-mon[25091]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-06-18T02:07:31.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:31 smithi007 ceph-mon[25091]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-06-18T02:07:31.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:31 smithi007 ceph-mon[25091]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi130.front.sepia.ceph.com:3000"}]: dispatch 2024-06-18T02:07:31.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:31 smithi007 ceph-mon[25091]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi130.front.sepia.ceph.com:3000"}]: dispatch 2024-06-18T02:07:31.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:31 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:31.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:31 smithi007 ceph-mon[25091]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:07:31.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:31 smithi007 ceph-mon[25091]: Upgrade: Need to upgrade myself (mgr.x) 2024-06-18T02:07:31.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:31 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:31.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:31 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:31.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:31 smithi007 ceph-mon[29879]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-06-18T02:07:31.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:31 smithi007 ceph-mon[29879]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-06-18T02:07:31.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:31 smithi007 ceph-mon[29879]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi007.front.sepia.ceph.com:9093"}]: dispatch 2024-06-18T02:07:31.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:31 smithi007 ceph-mon[29879]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi007.front.sepia.ceph.com:9093"}]: dispatch 2024-06-18T02:07:31.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:31 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:31.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:31 smithi007 ceph-mon[29879]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-06-18T02:07:31.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:31 smithi007 ceph-mon[29879]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-06-18T02:07:31.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:31 smithi007 ceph-mon[29879]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi130.front.sepia.ceph.com:9095"}]: dispatch 2024-06-18T02:07:31.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:31 smithi007 ceph-mon[29879]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi130.front.sepia.ceph.com:9095"}]: dispatch 2024-06-18T02:07:31.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:31 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:31.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:31 smithi007 ceph-mon[29879]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-06-18T02:07:31.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:31 smithi007 ceph-mon[29879]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-06-18T02:07:31.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:31 smithi007 ceph-mon[29879]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi130.front.sepia.ceph.com:3000"}]: dispatch 2024-06-18T02:07:31.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:31 smithi007 ceph-mon[29879]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi130.front.sepia.ceph.com:3000"}]: dispatch 2024-06-18T02:07:31.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:31 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:31.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:31 smithi007 ceph-mon[29879]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:07:31.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:31 smithi007 ceph-mon[29879]: Upgrade: Need to upgrade myself (mgr.x) 2024-06-18T02:07:31.227 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:30 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: [18/Jun/2024:02:07:30] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-06-18T02:07:31.227 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:30 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: [18/Jun/2024:02:07:30] ENGINE Bus STOPPED 2024-06-18T02:07:31.227 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:30 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: [18/Jun/2024:02:07:30] ENGINE Bus STARTING 2024-06-18T02:07:31.228 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:31 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: [18/Jun/2024:02:07:31] ENGINE Serving on http://:::9283 2024-06-18T02:07:31.228 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:31 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: [18/Jun/2024:02:07:31] ENGINE Bus STARTED 2024-06-18T02:07:31.228 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:31 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: [18/Jun/2024:02:07:31] ENGINE Bus STOPPING 2024-06-18T02:07:31.228 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:31 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:31.228 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:31 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:31.228 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:31 smithi130 ceph-mon[26123]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-06-18T02:07:31.228 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:31 smithi130 ceph-mon[26123]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-06-18T02:07:31.229 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:31 smithi130 ceph-mon[26123]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi007.front.sepia.ceph.com:9093"}]: dispatch 2024-06-18T02:07:31.229 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:31 smithi130 ceph-mon[26123]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi007.front.sepia.ceph.com:9093"}]: dispatch 2024-06-18T02:07:31.229 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:31 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:31.229 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:31 smithi130 ceph-mon[26123]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-06-18T02:07:31.229 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:31 smithi130 ceph-mon[26123]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-06-18T02:07:31.229 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:31 smithi130 ceph-mon[26123]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi130.front.sepia.ceph.com:9095"}]: dispatch 2024-06-18T02:07:31.229 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:31 smithi130 ceph-mon[26123]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi130.front.sepia.ceph.com:9095"}]: dispatch 2024-06-18T02:07:31.229 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:31 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:31.229 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:31 smithi130 ceph-mon[26123]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-06-18T02:07:31.229 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:31 smithi130 ceph-mon[26123]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-06-18T02:07:31.230 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:31 smithi130 ceph-mon[26123]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi130.front.sepia.ceph.com:3000"}]: dispatch 2024-06-18T02:07:31.230 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:31 smithi130 ceph-mon[26123]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi130.front.sepia.ceph.com:3000"}]: dispatch 2024-06-18T02:07:31.230 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:31 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:31.230 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:31 smithi130 ceph-mon[26123]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:07:31.230 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:31 smithi130 ceph-mon[26123]: Upgrade: Need to upgrade myself (mgr.x) 2024-06-18T02:07:32.043 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:31 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: [18/Jun/2024:02:07:31] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-06-18T02:07:32.044 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:31 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: [18/Jun/2024:02:07:31] ENGINE Bus STOPPED 2024-06-18T02:07:32.044 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:31 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: [18/Jun/2024:02:07:31] ENGINE Bus STARTING 2024-06-18T02:07:32.044 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:31 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: [18/Jun/2024:02:07:31] ENGINE Serving on http://:::9283 2024-06-18T02:07:32.044 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:31 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: [18/Jun/2024:02:07:31] ENGINE Bus STARTED 2024-06-18T02:07:32.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:32 smithi007 ceph-mon[25091]: pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 977 B/s rd, 0 op/s 2024-06-18T02:07:32.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:32 smithi007 ceph-mon[25091]: from='client.25064 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:07:32.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:32 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:32.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:32 smithi007 ceph-mon[25091]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-18T02:07:32.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:32 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-18T02:07:32.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:32 smithi007 ceph-mon[25091]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-18T02:07:32.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:32 smithi007 ceph-mon[25091]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:07:32.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:32 smithi007 ceph-mon[29879]: pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 977 B/s rd, 0 op/s 2024-06-18T02:07:32.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:32 smithi007 ceph-mon[29879]: from='client.25064 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:07:32.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:32 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:32.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:32 smithi007 ceph-mon[29879]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-18T02:07:32.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:32 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-18T02:07:32.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:32 smithi007 ceph-mon[29879]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-18T02:07:32.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:32 smithi007 ceph-mon[29879]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:07:32.448 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:32 smithi130 ceph-mon[26123]: pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 977 B/s rd, 0 op/s 2024-06-18T02:07:32.448 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:32 smithi130 ceph-mon[26123]: from='client.25064 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:07:32.448 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:32 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:32.449 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:32 smithi130 ceph-mon[26123]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-18T02:07:32.449 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:32 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-18T02:07:32.449 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:32 smithi130 ceph-mon[26123]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-18T02:07:32.449 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:32 smithi130 ceph-mon[26123]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:07:33.235 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:33 smithi007 ceph-mon[25091]: Upgrade: Updating mgr.y 2024-06-18T02:07:33.235 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:33 smithi007 ceph-mon[25091]: Deploying daemon mgr.y on smithi007 2024-06-18T02:07:33.235 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:33 smithi007 ceph-mon[29879]: Upgrade: Updating mgr.y 2024-06-18T02:07:33.235 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:33 smithi007 ceph-mon[29879]: Deploying daemon mgr.y on smithi007 2024-06-18T02:07:33.464 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:33 smithi130 ceph-mon[26123]: Upgrade: Updating mgr.y 2024-06-18T02:07:33.464 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:33 smithi130 ceph-mon[26123]: Deploying daemon mgr.y on smithi007 2024-06-18T02:07:33.581 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:33 smithi007 systemd[1]: Stopping Ceph mgr.y for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:07:33.793 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:33 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[54666]: ts=2024-06-18T02:07:33.505Z caller=manager.go:609 level=warn component="rule manager" group=nodes msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on(instance) group_left(nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi007\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"cd9a3408-2d15-11ef-bc9d-c7b262605968\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-06-18T02:07:34.162 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:34 smithi007 podman[65596]: 2024-06-18 02:07:34.02847761 +0000 UTC m=+0.612148103 container cleanup 78a1afd0bdddabfc4ec47e114b59291b01d01d7e1f7993a7bc296c29c00ced51 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y, GIT_CLEAN=True, distribution-scope=public, architecture=x86_64, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, com.redhat.component=centos-stream-container, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, version=8, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, ceph=True, CEPH_POINT_RELEASE=-17.2.0, vcs-type=git, io.openshift.tags=base centos centos-stream, maintainer=Guillaume Abrioux , name=centos-stream, release=754, RELEASE=HEAD, io.k8s.display-name=CentOS Stream 8, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, GIT_BRANCH=HEAD, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.openshift.expose-services=, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.buildah.version=1.19.8, build-date=2022-05-03T08:36:31.336870, GIT_REPO=https://github.com/ceph/ceph-container.git, vendor=Red Hat, Inc., GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac) 2024-06-18T02:07:34.163 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:34 smithi007 bash[65596]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y 2024-06-18T02:07:34.384 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:34 smithi130 ceph-mon[26123]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-06-18T02:07:34.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:34 smithi007 ceph-mon[25091]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-06-18T02:07:34.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:34 smithi007 ceph-mon[29879]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-06-18T02:07:34.432 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:34 smithi007 podman[65625]: 2024-06-18 02:07:34.205615657 +0000 UTC m=+0.615416348 container remove 78a1afd0bdddabfc4ec47e114b59291b01d01d7e1f7993a7bc296c29c00ced51 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, distribution-scope=public, RELEASE=HEAD, release=754, GIT_REPO=https://github.com/ceph/ceph-container.git, build-date=2022-05-03T08:36:31.336870, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, architecture=x86_64, version=8, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.k8s.display-name=CentOS Stream 8, name=centos-stream, ceph=True, GIT_CLEAN=True, vcs-type=git, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, vendor=Red Hat, Inc., io.buildah.version=1.19.8, io.openshift.tags=base centos centos-stream, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, CEPH_POINT_RELEASE=-17.2.0, io.openshift.expose-services=, com.redhat.component=centos-stream-container, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754) 2024-06-18T02:07:34.432 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:34 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-06-18T02:07:34.931 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:34 smithi007 podman[65643]: 2024-06-18 02:07:34.63378868 +0000 UTC m=+0.581478520 container died 6bf71a4db638cf49b1072a379b5624518bb990e6ff737418be3ac50b21f8cfe6 (image=quay.ceph.io/ceph-ci/ceph@sha256:64b08d1c422bf6aa753839cabed8a69924a54ceb6ef0660c2e561d19ca874314, name=condescending_khorana, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-3781e3a, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240612, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-06-18T02:07:35.366 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:35 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mgr.y.service: Failed with result 'exit-code'. 2024-06-18T02:07:35.366 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:35 smithi007 systemd[1]: Stopped Ceph mgr.y for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:07:35.366 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:35 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mgr.y.service: Consumed 1min 13.827s CPU time. 2024-06-18T02:07:35.681 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:35 smithi007 systemd[1]: Starting Ceph mgr.y for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:07:36.023 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:35 smithi007 podman[65869]: 2024-06-18 02:07:35.594386611 +0000 UTC m=+0.098132050 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:07:36.279 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:36 smithi007 ceph-mon[25091]: pgmap v32: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:07:36.279 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:36 smithi007 ceph-mon[25091]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:07:36.279 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:36 smithi007 podman[65869]: 2024-06-18 02:07:36.02509716 +0000 UTC m=+0.528842627 container create 820dafc9907dac934f2369c23610ae81366eb82608be1a408b5eb4c33864fae1 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-3781e3a, ceph=True, org.label-schema.build-date=20240612) 2024-06-18T02:07:36.279 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:36 smithi007 ceph-mon[29879]: pgmap v32: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:07:36.280 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:36 smithi007 ceph-mon[29879]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:07:36.528 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:36 smithi130 ceph-mon[26123]: pgmap v32: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:07:36.528 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:36 smithi130 ceph-mon[26123]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:07:36.657 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:36 smithi007 podman[65869]: 2024-06-18 02:07:36.360695074 +0000 UTC m=+0.864440514 container init 820dafc9907dac934f2369c23610ae81366eb82608be1a408b5eb4c33864fae1 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-3781e3a, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240612, org.label-schema.license=GPLv2) 2024-06-18T02:07:36.658 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:36 smithi007 podman[65869]: 2024-06-18 02:07:36.363969067 +0000 UTC m=+0.867714505 container start 820dafc9907dac934f2369c23610ae81366eb82608be1a408b5eb4c33864fae1 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-3781e3a, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240612, org.label-schema.vendor=CentOS) 2024-06-18T02:07:36.658 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:36 smithi007 ceph-mgr[65903]: -- 172.21.15.7:0/1573524811 <== mon.0 v2:172.21.15.7:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c90f3a30e0 con 0x55c90f380800 2024-06-18T02:07:36.658 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:36 smithi007 bash[65869]: 820dafc9907dac934f2369c23610ae81366eb82608be1a408b5eb4c33864fae1 2024-06-18T02:07:36.658 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:36 smithi007 systemd[1]: Started Ceph mgr.y for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:07:36.658 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:36 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:07:36.500+0000 7fbdec769040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-18T02:07:36.931 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:36 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:07:36.702+0000 7fbdec769040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-18T02:07:36.932 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:36 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:07:36.778+0000 7fbdec769040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-18T02:07:37.431 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:37 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:07:37.046+0000 7fbdec769040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-18T02:07:37.431 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:37 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:07:37.131+0000 7fbdec769040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-18T02:07:37.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:37 smithi130 ceph-mon[26123]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 555 B/s rd, 0 op/s 2024-06-18T02:07:37.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:37 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:37.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:37 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:37.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:37 smithi130 ceph-mon[26123]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi007", "caps": []}]: dispatch 2024-06-18T02:07:37.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:37 smithi130 ceph-mon[26123]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi130", "caps": []}]: dispatch 2024-06-18T02:07:37.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:37 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi007", "caps": []}]: dispatch 2024-06-18T02:07:37.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:37 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi130", "caps": []}]: dispatch 2024-06-18T02:07:37.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:37 smithi130 ceph-mon[26123]: Deploying daemon agent.smithi007 on smithi007 2024-06-18T02:07:37.825 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:37 smithi007 ceph-mon[25091]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 555 B/s rd, 0 op/s 2024-06-18T02:07:37.826 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:37 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:37.826 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:37 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:37.826 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:37 smithi007 ceph-mon[25091]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi007", "caps": []}]: dispatch 2024-06-18T02:07:37.826 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:37 smithi007 ceph-mon[25091]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi130", "caps": []}]: dispatch 2024-06-18T02:07:37.826 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:37 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi007", "caps": []}]: dispatch 2024-06-18T02:07:37.826 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:37 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi130", "caps": []}]: dispatch 2024-06-18T02:07:37.826 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:37 smithi007 ceph-mon[25091]: Deploying daemon agent.smithi007 on smithi007 2024-06-18T02:07:37.826 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:37 smithi007 ceph-mon[29879]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 555 B/s rd, 0 op/s 2024-06-18T02:07:37.826 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:37 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:37.826 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:37 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:37.826 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:37 smithi007 ceph-mon[29879]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi007", "caps": []}]: dispatch 2024-06-18T02:07:37.826 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:37 smithi007 ceph-mon[29879]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi130", "caps": []}]: dispatch 2024-06-18T02:07:37.827 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:37 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi007", "caps": []}]: dispatch 2024-06-18T02:07:37.827 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:37 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi130", "caps": []}]: dispatch 2024-06-18T02:07:37.827 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:37 smithi007 ceph-mon[29879]: Deploying daemon agent.smithi007 on smithi007 2024-06-18T02:07:38.151 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:37 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:07:37] "GET /metrics HTTP/1.1" 200 38138 "" "Prometheus/2.33.4" 2024-06-18T02:07:38.523 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:38 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:07:38.238+0000 7fbdec769040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-18T02:07:38.524 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:38 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:07:38.385+0000 7fbdec769040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-18T02:07:38.524 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:38 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:07:38.449+0000 7fbdec769040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-18T02:07:38.778 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:38 smithi007 ceph-mon[25091]: Deploying daemon agent.smithi130 on smithi130 2024-06-18T02:07:38.779 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:38 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:38.779 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:38 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:07:38.701+0000 7fbdec769040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-18T02:07:38.779 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:38 smithi007 ceph-mon[29879]: Deploying daemon agent.smithi130 on smithi130 2024-06-18T02:07:38.779 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:38 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:38.872 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:38 smithi130 ceph-mon[26123]: Deploying daemon agent.smithi130 on smithi130 2024-06-18T02:07:38.873 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:38 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:38.873 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:38 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[54666]: ts=2024-06-18T02:07:38.659Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.7\", device_class=\"ssd\", hostname=\"smithi007\", instance=\"172.21.15.130:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.7\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"cd9a3408-2d15-11ef-bc9d-c7b262605968\", cluster_addr=\"172.21.15.7\", device_class=\"ssd\", hostname=\"smithi007\", instance=\"smithi130:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.7\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-06-18T02:07:39.094 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:38 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:07:38.778+0000 7fbdec769040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-18T02:07:39.094 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:38 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:07:38.852+0000 7fbdec769040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-18T02:07:39.095 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:39 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:07:39.017+0000 7fbdec769040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-18T02:07:39.655 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:39 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:07:39.567+0000 7fbdec769040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-18T02:07:39.916 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:39 smithi007 ceph-mon[25091]: pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1001 B/s rd, 0 op/s 2024-06-18T02:07:39.917 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:39 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:39.917 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:39 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:39.917 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:39 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:39.917 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:39 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:39.917 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:39 smithi007 ceph-mon[25091]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:07:39.917 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:39 smithi007 ceph-mon[25091]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:07:39.917 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:39 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:39.917 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:39 smithi007 ceph-mon[25091]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:07:39.918 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:39 smithi007 ceph-mon[25091]: Reconfiguring iscsi.foo.smithi007.xvdrwd (dependencies changed)... 2024-06-18T02:07:39.918 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:39 smithi007 ceph-mon[25091]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi007.xvdrwd", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-06-18T02:07:39.918 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:39 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi007.xvdrwd", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-06-18T02:07:39.918 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:39 smithi007 ceph-mon[25091]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:07:39.918 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:39 smithi007 ceph-mon[25091]: Reconfiguring daemon iscsi.foo.smithi007.xvdrwd on smithi007 2024-06-18T02:07:39.918 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:39 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:39.919 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:39 smithi007 ceph-mon[29879]: pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1001 B/s rd, 0 op/s 2024-06-18T02:07:39.919 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:39 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:39.919 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:39 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:39.919 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:39 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:39.919 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:39 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:39.919 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:39 smithi007 ceph-mon[29879]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:07:39.919 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:39 smithi007 ceph-mon[29879]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:07:39.920 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:39 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:39.920 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:39 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:07:39.920 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:39 smithi007 ceph-mon[29879]: Reconfiguring iscsi.foo.smithi007.xvdrwd (dependencies changed)... 2024-06-18T02:07:39.920 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:39 smithi007 ceph-mon[29879]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi007.xvdrwd", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-06-18T02:07:39.920 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:39 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi007.xvdrwd", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-06-18T02:07:39.920 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:39 smithi007 ceph-mon[29879]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:07:39.920 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:39 smithi007 ceph-mon[29879]: Reconfiguring daemon iscsi.foo.smithi007.xvdrwd on smithi007 2024-06-18T02:07:39.920 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:39 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:40.035 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:39 smithi130 ceph-mon[26123]: pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1001 B/s rd, 0 op/s 2024-06-18T02:07:40.036 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:39 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:40.036 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:39 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:40.036 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:39 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:40.036 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:39 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:40.036 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:39 smithi130 ceph-mon[26123]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:07:40.036 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:39 smithi130 ceph-mon[26123]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:07:40.036 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:39 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:40.036 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:39 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:07:40.036 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:39 smithi130 ceph-mon[26123]: Reconfiguring iscsi.foo.smithi007.xvdrwd (dependencies changed)... 2024-06-18T02:07:40.037 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:39 smithi130 ceph-mon[26123]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi007.xvdrwd", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-06-18T02:07:40.037 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:39 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi007.xvdrwd", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-06-18T02:07:40.037 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:39 smithi130 ceph-mon[26123]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:07:40.037 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:39 smithi130 ceph-mon[26123]: Reconfiguring daemon iscsi.foo.smithi007.xvdrwd on smithi007 2024-06-18T02:07:40.037 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:39 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:40.181 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:39 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:07:39.916+0000 7fbdec769040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-18T02:07:40.181 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:39 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:07:39.992+0000 7fbdec769040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-18T02:07:40.182 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:40 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:07:40.166+0000 7fbdec769040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-18T02:07:40.575 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:40 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:07:40.506+0000 7fbdec769040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-18T02:07:40.899 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:40 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:07:40.575+0000 7fbdec769040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-18T02:07:40.899 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:40 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:07:40.777+0000 7fbdec769040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-18T02:07:41.164 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:40 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:07:40.941+0000 7fbdec769040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-18T02:07:41.164 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:41 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:07:41.010+0000 7fbdec769040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-18T02:07:41.164 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:41 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:07:41.100+0000 7fbdec769040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-18T02:07:41.164 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:41 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:07:41.164+0000 7fbdec769040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-18T02:07:41.769 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:41 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:07:41.754+0000 7fbdec769040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-18T02:07:42.037 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:41 smithi007 ceph-mon[25091]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:07:42.038 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:41 smithi007 ceph-mon[25091]: from='client.25064 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:07:42.038 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:41 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:07:41.930+0000 7fbdec769040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-18T02:07:42.038 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:41 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: [18/Jun/2024:02:07:41] ENGINE Bus STARTING 2024-06-18T02:07:42.038 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:41 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: CherryPy Checker: 2024-06-18T02:07:42.038 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:41 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: The Application mounted at '' has an empty config. 2024-06-18T02:07:42.038 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:41 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:07:42.038 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:42 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: [18/Jun/2024:02:07:42] ENGINE Serving on http://:::9283 2024-06-18T02:07:42.039 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:42 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: [18/Jun/2024:02:07:42] ENGINE Bus STARTED 2024-06-18T02:07:42.039 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:41 smithi007 ceph-mon[29879]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:07:42.039 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:41 smithi007 ceph-mon[29879]: from='client.25064 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:07:42.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:41 smithi130 ceph-mon[26123]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:07:42.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:41 smithi130 ceph-mon[26123]: from='client.25064 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:07:43.110 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:42 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:43.111 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:42 smithi130 ceph-mon[26123]: Standby manager daemon y restarted 2024-06-18T02:07:43.111 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:42 smithi130 ceph-mon[26123]: Standby manager daemon y started 2024-06-18T02:07:43.111 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:42 smithi130 ceph-mon[26123]: from='mgr.? 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-06-18T02:07:43.111 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:42 smithi130 ceph-mon[26123]: from='mgr.? 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-18T02:07:43.111 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:42 smithi130 ceph-mon[26123]: from='mgr.? 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-06-18T02:07:43.111 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:42 smithi130 ceph-mon[26123]: from='mgr.? 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-18T02:07:43.163 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:42 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:43.163 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:42 smithi007 ceph-mon[25091]: Standby manager daemon y restarted 2024-06-18T02:07:43.164 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:42 smithi007 ceph-mon[25091]: Standby manager daemon y started 2024-06-18T02:07:43.164 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:42 smithi007 ceph-mon[25091]: from='mgr.? 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-06-18T02:07:43.164 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:42 smithi007 ceph-mon[25091]: from='mgr.? 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-18T02:07:43.164 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:42 smithi007 ceph-mon[25091]: from='mgr.? 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-06-18T02:07:43.164 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:42 smithi007 ceph-mon[25091]: from='mgr.? 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-18T02:07:43.164 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:42 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' 2024-06-18T02:07:43.164 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:42 smithi007 ceph-mon[29879]: Standby manager daemon y restarted 2024-06-18T02:07:43.164 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:42 smithi007 ceph-mon[29879]: Standby manager daemon y started 2024-06-18T02:07:43.164 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:42 smithi007 ceph-mon[29879]: from='mgr.? 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-06-18T02:07:43.164 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:42 smithi007 ceph-mon[29879]: from='mgr.? 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-18T02:07:43.164 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:42 smithi007 ceph-mon[29879]: from='mgr.? 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-06-18T02:07:43.165 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:42 smithi007 ceph-mon[29879]: from='mgr.? 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-18T02:07:43.793 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:43 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[54666]: ts=2024-06-18T02:07:43.505Z caller=manager.go:609 level=warn component="rule manager" group=nodes msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on(instance) group_left(nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi007\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"cd9a3408-2d15-11ef-bc9d-c7b262605968\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-06-18T02:07:44.100 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:43 smithi007 ceph-mon[25091]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:07:44.101 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:43 smithi007 ceph-mon[25091]: mgrmap e27: x(active, since 52s), standbys: y 2024-06-18T02:07:44.101 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:43 smithi007 ceph-mon[29879]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:07:44.101 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:43 smithi007 ceph-mon[29879]: mgrmap e27: x(active, since 52s), standbys: y 2024-06-18T02:07:44.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:43 smithi130 ceph-mon[26123]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:07:44.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:43 smithi130 ceph-mon[26123]: mgrmap e27: x(active, since 52s), standbys: y 2024-06-18T02:07:44.793 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: 2024-06-18T02:07:44.396+0000 7f6c47069640 -1 log_channel(cephadm) log [ERR] : cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi007.xvdrwd ... 2024-06-18T02:07:44.794 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: Creating ceph-iscsi config... 2024-06-18T02:07:44.794 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/iscsi-gateway.cfg 2024-06-18T02:07:44.794 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/tcmu-runner-entrypoint.sh 2024-06-18T02:07:44.794 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: Non-zero exit code 1 from systemctl restart ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd 2024-06-18T02:07:44.794 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: systemctl: stderr Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:07:44.794 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: systemctl: stderr See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:07:44.794 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: Traceback (most recent call last): 2024-06-18T02:07:44.794 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-06-18T02:07:44.794 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: return _run_code(code, main_globals, None, 2024-06-18T02:07:44.794 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-06-18T02:07:44.795 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: exec(code, run_globals) 2024-06-18T02:07:44.795 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5618, in 2024-06-18T02:07:44.795 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5606, in main 2024-06-18T02:07:44.795 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3096, in command_deploy_from 2024-06-18T02:07:44.795 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3131, in _common_deploy 2024-06-18T02:07:44.795 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3151, in _deploy_daemon_container 2024-06-18T02:07:44.795 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 1123, in deploy_daemon 2024-06-18T02:07:44.795 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/tmp/tmp3vdsh41i.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-06-18T02:07:44.795 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: RuntimeError: Failed command: systemctl restart ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd: Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:07:44.795 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:07:44.796 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: Traceback (most recent call last): 2024-06-18T02:07:44.796 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-06-18T02:07:44.796 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: self.mgr._daemon_action(daemon_spec, action=action) 2024-06-18T02:07:44.796 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/usr/share/ceph/mgr/cephadm/module.py", line 2456, in _daemon_action 2024-06-18T02:07:44.796 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: return self.wait_async( 2024-06-18T02:07:44.796 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/usr/share/ceph/mgr/cephadm/module.py", line 779, in wait_async 2024-06-18T02:07:44.796 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: return self.event_loop.get_result(coro, timeout) 2024-06-18T02:07:44.796 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-06-18T02:07:44.796 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: return future.result(timeout) 2024-06-18T02:07:44.797 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/lib64/python3.9/concurrent/futures/_base.py", line 446, in result 2024-06-18T02:07:44.797 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: return self.__get_result() 2024-06-18T02:07:44.797 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/lib64/python3.9/concurrent/futures/_base.py", line 391, in __get_result 2024-06-18T02:07:44.797 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: raise self._exception 2024-06-18T02:07:44.797 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1350, in _create_daemon 2024-06-18T02:07:44.797 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: out, err, code = await self._run_cephadm( 2024-06-18T02:07:44.797 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1691, in _run_cephadm 2024-06-18T02:07:44.797 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: raise OrchestratorError( 2024-06-18T02:07:44.797 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi007.xvdrwd ... 2024-06-18T02:07:44.797 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: Creating ceph-iscsi config... 2024-06-18T02:07:44.797 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/iscsi-gateway.cfg 2024-06-18T02:07:44.797 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/tcmu-runner-entrypoint.sh 2024-06-18T02:07:44.797 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: Non-zero exit code 1 from systemctl restart ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd 2024-06-18T02:07:44.797 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: systemctl: stderr Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:07:44.798 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: systemctl: stderr See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:07:44.798 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: Traceback (most recent call last): 2024-06-18T02:07:44.798 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-06-18T02:07:44.798 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: return _run_code(code, main_globals, None, 2024-06-18T02:07:44.798 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-06-18T02:07:44.798 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: exec(code, run_globals) 2024-06-18T02:07:44.798 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5618, in 2024-06-18T02:07:44.798 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5606, in main 2024-06-18T02:07:44.798 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3096, in command_deploy_from 2024-06-18T02:07:44.798 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3131, in _common_deploy 2024-06-18T02:07:44.799 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3151, in _deploy_daemon_container 2024-06-18T02:07:44.799 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 1123, in deploy_daemon 2024-06-18T02:07:44.799 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: File "/tmp/tmp3vdsh41i.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-06-18T02:07:44.799 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: RuntimeError: Failed command: systemctl restart ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd: Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:07:44.799 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:07:44.931 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:44 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: [18/Jun/2024:02:07:44] ENGINE Bus STOPPING 2024-06-18T02:07:44.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:44 smithi007 ceph-mon[25091]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:07:44.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:44 smithi007 ceph-mon[25091]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-06-18T02:07:44.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:44 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-06-18T02:07:44.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:44 smithi007 ceph-mon[25091]: osdmap e106: 8 total, 8 up, 8 in 2024-06-18T02:07:44.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:44 smithi007 ceph-mon[25091]: Standby manager daemon x started 2024-06-18T02:07:44.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:44 smithi007 ceph-mon[29879]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:07:44.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:44 smithi007 ceph-mon[29879]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-06-18T02:07:44.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:44 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-06-18T02:07:44.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:44 smithi007 ceph-mon[29879]: osdmap e106: 8 total, 8 up, 8 in 2024-06-18T02:07:44.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:44 smithi007 ceph-mon[29879]: Standby manager daemon x started 2024-06-18T02:07:45.154 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-mon[26123]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:07:45.154 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-mon[26123]: from='mgr.24986 172.21.15.130:0/3144585836' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-06-18T02:07:45.154 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-06-18T02:07:45.154 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-mon[26123]: osdmap e106: 8 total, 8 up, 8 in 2024-06-18T02:07:45.154 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-mon[26123]: Standby manager daemon x started 2024-06-18T02:07:45.154 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: 2024-06-18T02:07:44.835+0000 7f6cb125d640 -1 mgr handle_mgr_map I was active but no longer am 2024-06-18T02:07:45.155 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: ignoring --setuser ceph since I am not root 2024-06-18T02:07:45.155 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: ignoring --setgroup ceph since I am not root 2024-06-18T02:07:45.155 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:44 smithi130 ceph-mgr[51920]: -- 172.21.15.130:0/1609735516 <== mon.2 v2:172.21.15.130:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5654461c30e0 con 0x5654461a1000 2024-06-18T02:07:45.155 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:45 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: 2024-06-18T02:07:45.002+0000 7ffabced6040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-18T02:07:45.155 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:45 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: 2024-06-18T02:07:45.154+0000 7ffabced6040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-18T02:07:45.430 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:45 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: [18/Jun/2024:02:07:45] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-06-18T02:07:45.430 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:45 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: [18/Jun/2024:02:07:45] ENGINE Bus STOPPED 2024-06-18T02:07:45.430 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:45 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: [18/Jun/2024:02:07:45] ENGINE Bus STARTING 2024-06-18T02:07:45.430 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:45 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: [18/Jun/2024:02:07:45] ENGINE Serving on http://:::9283 2024-06-18T02:07:45.430 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:45 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: [18/Jun/2024:02:07:45] ENGINE Bus STARTED 2024-06-18T02:07:45.474 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:45 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: 2024-06-18T02:07:45.229+0000 7ffabced6040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-18T02:07:45.793 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:45 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: 2024-06-18T02:07:45.475+0000 7ffabced6040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-18T02:07:45.793 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:45 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: 2024-06-18T02:07:45.538+0000 7ffabced6040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-18T02:07:46.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:45 smithi007 ceph-mon[25091]: from='mgr.24986 ' entity='mgr.x' cmd='[{"prefix": "mgr fail", "who": "x"}]': finished 2024-06-18T02:07:46.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:45 smithi007 ceph-mon[25091]: mgrmap e28: y(active, starting, since 0.388682s), standbys: x 2024-06-18T02:07:46.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:45 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-18T02:07:46.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:45 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-18T02:07:46.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:45 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-18T02:07:46.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:45 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-06-18T02:07:46.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:45 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-06-18T02:07:46.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:45 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-18T02:07:46.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:45 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-18T02:07:46.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:45 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-18T02:07:46.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:45 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-18T02:07:46.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:45 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-18T02:07:46.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:45 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-18T02:07:46.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:45 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-18T02:07:46.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:45 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-18T02:07:46.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:45 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-18T02:07:46.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:45 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-18T02:07:46.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:45 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-18T02:07:46.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:45 smithi007 ceph-mon[25091]: Manager daemon y is now available 2024-06-18T02:07:46.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:45 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:46.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:45 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi007", "caps": []}]: dispatch 2024-06-18T02:07:46.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:45 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi130", "caps": []}]: dispatch 2024-06-18T02:07:46.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:45 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:07:46.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:45 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-06-18T02:07:46.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:45 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-06-18T02:07:46.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:45 smithi007 ceph-mon[29879]: from='mgr.24986 ' entity='mgr.x' cmd='[{"prefix": "mgr fail", "who": "x"}]': finished 2024-06-18T02:07:46.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:45 smithi007 ceph-mon[29879]: mgrmap e28: y(active, starting, since 0.388682s), standbys: x 2024-06-18T02:07:46.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:45 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-18T02:07:46.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:45 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-18T02:07:46.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:45 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-18T02:07:46.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:45 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-06-18T02:07:46.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:45 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-06-18T02:07:46.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:45 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-18T02:07:46.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:45 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-18T02:07:46.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:45 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-18T02:07:46.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:45 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-18T02:07:46.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:45 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-18T02:07:46.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:45 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-18T02:07:46.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:45 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-18T02:07:46.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:45 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-18T02:07:46.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:45 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-18T02:07:46.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:45 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-18T02:07:46.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:45 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-18T02:07:46.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:45 smithi007 ceph-mon[29879]: Manager daemon y is now available 2024-06-18T02:07:46.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:45 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:46.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:45 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi007", "caps": []}]: dispatch 2024-06-18T02:07:46.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:45 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi130", "caps": []}]: dispatch 2024-06-18T02:07:46.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:45 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:07:46.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:45 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-06-18T02:07:46.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:45 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-06-18T02:07:46.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:45 smithi130 ceph-mon[26123]: from='mgr.24986 ' entity='mgr.x' cmd='[{"prefix": "mgr fail", "who": "x"}]': finished 2024-06-18T02:07:46.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:45 smithi130 ceph-mon[26123]: mgrmap e28: y(active, starting, since 0.388682s), standbys: x 2024-06-18T02:07:46.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:45 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-18T02:07:46.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:45 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-18T02:07:46.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:45 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-18T02:07:46.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:45 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-06-18T02:07:46.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:45 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-06-18T02:07:46.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:45 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-18T02:07:46.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:45 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-18T02:07:46.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:45 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-18T02:07:46.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:45 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-18T02:07:46.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:45 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-18T02:07:46.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:45 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-18T02:07:46.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:45 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-18T02:07:46.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:45 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-18T02:07:46.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:45 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-18T02:07:46.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:45 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-18T02:07:46.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:45 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-18T02:07:46.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:45 smithi130 ceph-mon[26123]: Manager daemon y is now available 2024-06-18T02:07:46.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:45 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:46.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:45 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi007", "caps": []}]: dispatch 2024-06-18T02:07:46.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:45 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi130", "caps": []}]: dispatch 2024-06-18T02:07:46.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:45 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:07:46.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:45 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-06-18T02:07:46.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:45 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-06-18T02:07:46.793 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:46 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: 2024-06-18T02:07:46.487+0000 7ffabced6040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-18T02:07:46.793 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:46 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: 2024-06-18T02:07:46.604+0000 7ffabced6040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-18T02:07:46.793 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:46 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: 2024-06-18T02:07:46.663+0000 7ffabced6040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-18T02:07:47.071 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:46 smithi007 ceph-mon[25091]: mgrmap e29: y(active, since 1.40765s), standbys: x 2024-06-18T02:07:47.071 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:46 smithi007 ceph-mon[25091]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:07:47.071 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:46 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi130", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:07:47.071 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:46 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi007", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:07:47.071 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:46 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:07:47.072 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:46 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:07:47.072 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:46 smithi007 ceph-mon[29879]: mgrmap e29: y(active, since 1.40765s), standbys: x 2024-06-18T02:07:47.072 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:46 smithi007 ceph-mon[29879]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:07:47.072 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:46 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi130", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:07:47.072 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:46 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi007", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:07:47.072 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:46 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:07:47.072 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:46 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:07:47.138 INFO:teuthology.orchestra.run.smithi007.stdout:true 2024-06-18T02:07:47.190 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:46 smithi130 ceph-mon[26123]: mgrmap e29: y(active, since 1.40765s), standbys: x 2024-06-18T02:07:47.190 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:46 smithi130 ceph-mon[26123]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:07:47.190 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:46 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi130", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:07:47.190 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:46 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi007", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:07:47.190 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:46 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:07:47.190 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:46 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:07:47.191 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:46 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: 2024-06-18T02:07:46.889+0000 7ffabced6040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-18T02:07:47.191 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:46 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: 2024-06-18T02:07:46.956+0000 7ffabced6040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-18T02:07:47.191 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:47 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: 2024-06-18T02:07:47.029+0000 7ffabced6040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-18T02:07:47.191 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:47 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: 2024-06-18T02:07:47.190+0000 7ffabced6040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-18T02:07:47.432 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:47 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:07:47.079+0000 7fbd43255640 -1 log_channel(cephadm) log [ERR] : [18/Jun/2024:02:07:47] ENGINE Error in HTTPServer.serve 2024-06-18T02:07:47.432 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:47 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: Traceback (most recent call last): 2024-06-18T02:07:47.432 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:47 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-06-18T02:07:47.433 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:47 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: self._connections.run(self.expiration_interval) 2024-06-18T02:07:47.433 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:47 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-06-18T02:07:47.433 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:47 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: self._run(expiration_interval) 2024-06-18T02:07:47.433 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:47 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-06-18T02:07:47.433 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:47 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: new_conn = self._from_server_socket(self.server.socket) 2024-06-18T02:07:47.433 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:47 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-06-18T02:07:47.433 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:47 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-06-18T02:07:47.433 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:47 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-06-18T02:07:47.433 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:47 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: s = self.context.wrap_socket( 2024-06-18T02:07:47.434 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:47 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-06-18T02:07:47.434 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:47 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: return self.sslsocket_class._create( 2024-06-18T02:07:47.434 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:47 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-06-18T02:07:47.434 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:47 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: self.do_handshake() 2024-06-18T02:07:47.434 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:47 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-06-18T02:07:47.434 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:47 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: self._sslobj.do_handshake() 2024-06-18T02:07:47.434 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:47 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1129) 2024-06-18T02:07:47.434 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:07:47 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:07:48.010 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:47 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: 2024-06-18T02:07:47.656+0000 7ffabced6040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-18T02:07:48.010 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:48 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: 2024-06-18T02:07:48.010+0000 7ffabced6040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-18T02:07:48.010 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:47 smithi130 ceph-mon[26123]: Updating smithi007:/etc/ceph/ceph.conf 2024-06-18T02:07:48.010 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:47 smithi130 ceph-mon[26123]: Updating smithi130:/etc/ceph/ceph.conf 2024-06-18T02:07:48.011 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:47 smithi130 ceph-mon[26123]: [18/Jun/2024:02:07:46] ENGINE Bus STARTING 2024-06-18T02:07:48.011 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:47 smithi130 ceph-mon[26123]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:07:48.011 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:47 smithi130 ceph-mon[26123]: mgrmap e30: y(active, since 2s), standbys: x 2024-06-18T02:07:48.011 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:47 smithi130 ceph-mon[26123]: [18/Jun/2024:02:07:46] ENGINE Serving on http://172.21.15.7:8765 2024-06-18T02:07:48.011 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:47 smithi130 ceph-mon[26123]: [18/Jun/2024:02:07:47] ENGINE Serving on https://172.21.15.7:7150 2024-06-18T02:07:48.011 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:47 smithi130 ceph-mon[26123]: [18/Jun/2024:02:07:47] ENGINE Bus STARTED 2024-06-18T02:07:48.012 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:47 smithi130 ceph-mon[26123]: [18/Jun/2024:02:07:47] ENGINE Error in HTTPServer.serve 2024-06-18T02:07:48.012 INFO:journalctl@ceph.mon.b.smithi130.stdout: Traceback (most recent call last): 2024-06-18T02:07:48.012 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-06-18T02:07:48.012 INFO:journalctl@ceph.mon.b.smithi130.stdout: self._connections.run(self.expiration_interval) 2024-06-18T02:07:48.012 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-06-18T02:07:48.012 INFO:journalctl@ceph.mon.b.smithi130.stdout: self._run(expiration_interval) 2024-06-18T02:07:48.012 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-06-18T02:07:48.013 INFO:journalctl@ceph.mon.b.smithi130.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-06-18T02:07:48.013 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-06-18T02:07:48.013 INFO:journalctl@ceph.mon.b.smithi130.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-06-18T02:07:48.013 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-06-18T02:07:48.013 INFO:journalctl@ceph.mon.b.smithi130.stdout: s = self.context.wrap_socket( 2024-06-18T02:07:48.014 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-06-18T02:07:48.014 INFO:journalctl@ceph.mon.b.smithi130.stdout: return self.sslsocket_class._create( 2024-06-18T02:07:48.014 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-06-18T02:07:48.014 INFO:journalctl@ceph.mon.b.smithi130.stdout: self.do_handshake() 2024-06-18T02:07:48.014 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-06-18T02:07:48.014 INFO:journalctl@ceph.mon.b.smithi130.stdout: self._sslobj.do_handshake() 2024-06-18T02:07:48.014 INFO:journalctl@ceph.mon.b.smithi130.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1129) 2024-06-18T02:07:48.015 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:47 smithi130 ceph-mon[26123]: from='client.25243 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:07:48.015 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:47 smithi130 ceph-mon[26123]: Updating smithi007:/var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/config/ceph.conf 2024-06-18T02:07:48.015 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:47 smithi130 ceph-mon[26123]: Updating smithi130:/var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/config/ceph.conf 2024-06-18T02:07:48.117 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:47 smithi007 ceph-mon[25091]: Updating smithi007:/etc/ceph/ceph.conf 2024-06-18T02:07:48.117 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:47 smithi007 ceph-mon[25091]: Updating smithi130:/etc/ceph/ceph.conf 2024-06-18T02:07:48.117 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:47 smithi007 ceph-mon[25091]: [18/Jun/2024:02:07:46] ENGINE Bus STARTING 2024-06-18T02:07:48.117 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:47 smithi007 ceph-mon[25091]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:07:48.117 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:47 smithi007 ceph-mon[25091]: mgrmap e30: y(active, since 2s), standbys: x 2024-06-18T02:07:48.117 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:47 smithi007 ceph-mon[25091]: [18/Jun/2024:02:07:46] ENGINE Serving on http://172.21.15.7:8765 2024-06-18T02:07:48.117 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:47 smithi007 ceph-mon[25091]: [18/Jun/2024:02:07:47] ENGINE Serving on https://172.21.15.7:7150 2024-06-18T02:07:48.117 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:47 smithi007 ceph-mon[25091]: [18/Jun/2024:02:07:47] ENGINE Bus STARTED 2024-06-18T02:07:48.117 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:47 smithi007 ceph-mon[25091]: [18/Jun/2024:02:07:47] ENGINE Error in HTTPServer.serve 2024-06-18T02:07:48.117 INFO:journalctl@ceph.mon.a.smithi007.stdout: Traceback (most recent call last): 2024-06-18T02:07:48.117 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-06-18T02:07:48.118 INFO:journalctl@ceph.mon.a.smithi007.stdout: self._connections.run(self.expiration_interval) 2024-06-18T02:07:48.118 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-06-18T02:07:48.118 INFO:journalctl@ceph.mon.a.smithi007.stdout: self._run(expiration_interval) 2024-06-18T02:07:48.118 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-06-18T02:07:48.118 INFO:journalctl@ceph.mon.a.smithi007.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-06-18T02:07:48.118 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-06-18T02:07:48.118 INFO:journalctl@ceph.mon.a.smithi007.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-06-18T02:07:48.118 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-06-18T02:07:48.118 INFO:journalctl@ceph.mon.a.smithi007.stdout: s = self.context.wrap_socket( 2024-06-18T02:07:48.118 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-06-18T02:07:48.118 INFO:journalctl@ceph.mon.a.smithi007.stdout: return self.sslsocket_class._create( 2024-06-18T02:07:48.118 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-06-18T02:07:48.118 INFO:journalctl@ceph.mon.a.smithi007.stdout: self.do_handshake() 2024-06-18T02:07:48.119 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-06-18T02:07:48.119 INFO:journalctl@ceph.mon.a.smithi007.stdout: self._sslobj.do_handshake() 2024-06-18T02:07:48.119 INFO:journalctl@ceph.mon.a.smithi007.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1129) 2024-06-18T02:07:48.119 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:47 smithi007 ceph-mon[25091]: from='client.25243 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:07:48.119 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:47 smithi007 ceph-mon[25091]: Updating smithi007:/var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/config/ceph.conf 2024-06-18T02:07:48.119 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:47 smithi007 ceph-mon[25091]: Updating smithi130:/var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/config/ceph.conf 2024-06-18T02:07:48.119 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:47 smithi007 ceph-mon[29879]: Updating smithi007:/etc/ceph/ceph.conf 2024-06-18T02:07:48.119 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:47 smithi007 ceph-mon[29879]: Updating smithi130:/etc/ceph/ceph.conf 2024-06-18T02:07:48.119 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:47 smithi007 ceph-mon[29879]: [18/Jun/2024:02:07:46] ENGINE Bus STARTING 2024-06-18T02:07:48.119 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:47 smithi007 ceph-mon[29879]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:07:48.119 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:47 smithi007 ceph-mon[29879]: mgrmap e30: y(active, since 2s), standbys: x 2024-06-18T02:07:48.119 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:47 smithi007 ceph-mon[29879]: [18/Jun/2024:02:07:46] ENGINE Serving on http://172.21.15.7:8765 2024-06-18T02:07:48.120 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:47 smithi007 ceph-mon[29879]: [18/Jun/2024:02:07:47] ENGINE Serving on https://172.21.15.7:7150 2024-06-18T02:07:48.120 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:47 smithi007 ceph-mon[29879]: [18/Jun/2024:02:07:47] ENGINE Bus STARTED 2024-06-18T02:07:48.120 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:47 smithi007 ceph-mon[29879]: [18/Jun/2024:02:07:47] ENGINE Error in HTTPServer.serve 2024-06-18T02:07:48.120 INFO:journalctl@ceph.mon.c.smithi007.stdout: Traceback (most recent call last): 2024-06-18T02:07:48.120 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-06-18T02:07:48.120 INFO:journalctl@ceph.mon.c.smithi007.stdout: self._connections.run(self.expiration_interval) 2024-06-18T02:07:48.120 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-06-18T02:07:48.120 INFO:journalctl@ceph.mon.c.smithi007.stdout: self._run(expiration_interval) 2024-06-18T02:07:48.120 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-06-18T02:07:48.120 INFO:journalctl@ceph.mon.c.smithi007.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-06-18T02:07:48.120 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-06-18T02:07:48.120 INFO:journalctl@ceph.mon.c.smithi007.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-06-18T02:07:48.120 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-06-18T02:07:48.120 INFO:journalctl@ceph.mon.c.smithi007.stdout: s = self.context.wrap_socket( 2024-06-18T02:07:48.120 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-06-18T02:07:48.121 INFO:journalctl@ceph.mon.c.smithi007.stdout: return self.sslsocket_class._create( 2024-06-18T02:07:48.121 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-06-18T02:07:48.121 INFO:journalctl@ceph.mon.c.smithi007.stdout: self.do_handshake() 2024-06-18T02:07:48.121 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-06-18T02:07:48.121 INFO:journalctl@ceph.mon.c.smithi007.stdout: self._sslobj.do_handshake() 2024-06-18T02:07:48.121 INFO:journalctl@ceph.mon.c.smithi007.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1129) 2024-06-18T02:07:48.121 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:47 smithi007 ceph-mon[29879]: from='client.25243 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:07:48.121 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:47 smithi007 ceph-mon[29879]: Updating smithi007:/var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/config/ceph.conf 2024-06-18T02:07:48.121 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:47 smithi007 ceph-mon[29879]: Updating smithi130:/var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/config/ceph.conf 2024-06-18T02:07:48.170 INFO:teuthology.orchestra.run.smithi007.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-18T02:07:48.170 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi007 smithi007 starting - - - - 2024-06-18T02:07:48.170 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi130 smithi130 starting - - - - 2024-06-18T02:07:48.170 INFO:teuthology.orchestra.run.smithi007.stdout:alertmanager.a smithi007 *:9093,9094 starting - - - - 2024-06-18T02:07:48.170 INFO:teuthology.orchestra.run.smithi007.stdout:grafana.a smithi130 *:3000 starting - - - - 2024-06-18T02:07:48.170 INFO:teuthology.orchestra.run.smithi007.stdout:iscsi.foo.smithi007.xvdrwd smithi007 running (4m) 69s ago 4m 48.7M - 3.5 e1d6a67b021e da0b75a0afdc 2024-06-18T02:07:48.170 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.x smithi130 *:8443,9283 starting - - - - 2024-06-18T02:07:48.171 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.y smithi007 *:8443,9283,8765 starting - - - - 2024-06-18T02:07:48.171 INFO:teuthology.orchestra.run.smithi007.stdout:mon.a smithi007 running (12m) 69s ago 12m 53.3M 2048M 17.2.0 e1d6a67b021e 147f3ea02ae3 2024-06-18T02:07:48.171 INFO:teuthology.orchestra.run.smithi007.stdout:mon.b smithi130 running (10m) 81s ago 10m 41.2M 2048M 17.2.0 e1d6a67b021e a0b38a9a595f 2024-06-18T02:07:48.171 INFO:teuthology.orchestra.run.smithi007.stdout:mon.c smithi007 running (10m) 69s ago 10m 40.4M 2048M 17.2.0 e1d6a67b021e 1d1e2628656b 2024-06-18T02:07:48.171 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.a smithi007 *:9100 starting - - - - 2024-06-18T02:07:48.171 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.b smithi130 *:9100 starting - - - - 2024-06-18T02:07:48.171 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0 smithi007 running (9m) 69s ago 9m 52.9M 4096M 17.2.0 e1d6a67b021e 1ef6e23afd55 2024-06-18T02:07:48.171 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1 smithi007 running (9m) 69s ago 9m 53.6M 4096M 17.2.0 e1d6a67b021e a967706523cb 2024-06-18T02:07:48.171 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2 smithi007 running (9m) 69s ago 9m 47.8M 4096M 17.2.0 e1d6a67b021e 2c1b76bd0876 2024-06-18T02:07:48.171 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3 smithi007 running (8m) 69s ago 8m 51.7M 4096M 17.2.0 e1d6a67b021e 8b91b2a07564 2024-06-18T02:07:48.171 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4 smithi130 running (8m) 81s ago 8m 53.7M 4096M 17.2.0 e1d6a67b021e c428dccffdf0 2024-06-18T02:07:48.171 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5 smithi130 running (7m) 81s ago 7m 52.5M 4096M 17.2.0 e1d6a67b021e f645d7f12378 2024-06-18T02:07:48.171 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6 smithi130 running (7m) 81s ago 7m 47.9M 4096M 17.2.0 e1d6a67b021e c7af86c14959 2024-06-18T02:07:48.171 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7 smithi130 running (7m) 81s ago 7m 51.4M 4096M 17.2.0 e1d6a67b021e 3688af8b2c46 2024-06-18T02:07:48.172 INFO:teuthology.orchestra.run.smithi007.stdout:prometheus.a smithi130 *:9095 starting - - - - 2024-06-18T02:07:48.172 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi007.dvbvbk smithi007 *:8000 running (4m) 69s ago 4m 73.3M - 17.2.0 e1d6a67b021e 1344b55b763c 2024-06-18T02:07:48.172 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi130.aakmof smithi130 *:8000 running (4m) 81s ago 4m 71.4M - 17.2.0 e1d6a67b021e e257e3230c6c 2024-06-18T02:07:48.172 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi007.hgrnmk smithi007 *:80 running (4m) 69s ago 4m 71.9M - 17.2.0 e1d6a67b021e 2173947bc4d6 2024-06-18T02:07:48.172 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi130.wwebfk smithi130 *:80 running (4m) 81s ago 4m 73.2M - 17.2.0 e1d6a67b021e 8662706b2231 2024-06-18T02:07:48.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:48 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: 2024-06-18T02:07:48.080+0000 7ffabced6040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-18T02:07:48.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:48 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: 2024-06-18T02:07:48.246+0000 7ffabced6040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-18T02:07:48.624 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:07:48.624 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": { 2024-06-18T02:07:48.624 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-06-18T02:07:48.624 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:07:48.625 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": { 2024-06-18T02:07:48.625 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 2 2024-06-18T02:07:48.625 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:07:48.625 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": { 2024-06-18T02:07:48.625 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-06-18T02:07:48.625 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:07:48.625 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": {}, 2024-06-18T02:07:48.625 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw": { 2024-06-18T02:07:48.625 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-06-18T02:07:48.626 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:07:48.626 INFO:teuthology.orchestra.run.smithi007.stdout: "overall": { 2024-06-18T02:07:48.626 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 15, 2024-06-18T02:07:48.626 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 2 2024-06-18T02:07:48.626 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-06-18T02:07:48.626 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:07:48.661 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:48 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: 2024-06-18T02:07:48.580+0000 7ffabced6040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-18T02:07:48.975 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:48 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: 2024-06-18T02:07:48.661+0000 7ffabced6040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-18T02:07:48.976 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:48 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: 2024-06-18T02:07:48.887+0000 7ffabced6040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-18T02:07:49.171 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:07:49.171 INFO:teuthology.orchestra.run.smithi007.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00", 2024-06-18T02:07:49.171 INFO:teuthology.orchestra.run.smithi007.stdout: "in_progress": true, 2024-06-18T02:07:49.171 INFO:teuthology.orchestra.run.smithi007.stdout: "which": "Upgrading all daemon types on all hosts", 2024-06-18T02:07:49.171 INFO:teuthology.orchestra.run.smithi007.stdout: "services_complete": [], 2024-06-18T02:07:49.171 INFO:teuthology.orchestra.run.smithi007.stdout: "progress": "", 2024-06-18T02:07:49.171 INFO:teuthology.orchestra.run.smithi007.stdout: "message": "", 2024-06-18T02:07:49.171 INFO:teuthology.orchestra.run.smithi007.stdout: "is_paused": false 2024-06-18T02:07:49.172 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:07:49.229 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:49 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: 2024-06-18T02:07:49.058+0000 7ffabced6040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-18T02:07:49.229 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:49 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: 2024-06-18T02:07:49.127+0000 7ffabced6040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-18T02:07:49.229 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:49 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: 2024-06-18T02:07:49.215+0000 7ffabced6040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-18T02:07:49.229 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:49 smithi130 ceph-mon[26123]: Updating smithi007:/etc/ceph/ceph.client.admin.keyring 2024-06-18T02:07:49.230 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:49 smithi130 ceph-mon[26123]: Updating smithi130:/etc/ceph/ceph.client.admin.keyring 2024-06-18T02:07:49.230 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:49 smithi130 ceph-mon[26123]: from='client.25148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:07:49.230 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:49 smithi130 ceph-mon[26123]: Updating smithi130:/var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/config/ceph.client.admin.keyring 2024-06-18T02:07:49.230 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:49 smithi130 ceph-mon[26123]: Updating smithi007:/var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/config/ceph.client.admin.keyring 2024-06-18T02:07:49.230 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:49 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:49.230 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:49 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:49.230 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:49 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:49.230 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:49 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:49.230 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:49 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:49.230 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:49 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:49.231 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:49 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:07:49.231 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:49 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:49.231 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:49 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:49.231 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:49 smithi130 ceph-mon[26123]: from='client.25154 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:07:49.231 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:49 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi007", "caps": []}]: dispatch 2024-06-18T02:07:49.231 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:49 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:49.231 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:49 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:49.231 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:49 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/1563522386' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:07:49.231 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:49 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:49.231 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:49 smithi130 ceph-mon[26123]: mgrmap e31: y(active, since 4s), standbys: x 2024-06-18T02:07:49.231 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:49 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:49.267 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:49 smithi007 ceph-mon[29879]: Updating smithi007:/etc/ceph/ceph.client.admin.keyring 2024-06-18T02:07:49.267 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:49 smithi007 ceph-mon[29879]: Updating smithi130:/etc/ceph/ceph.client.admin.keyring 2024-06-18T02:07:49.268 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:49 smithi007 ceph-mon[29879]: from='client.25148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:07:49.268 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:49 smithi007 ceph-mon[29879]: Updating smithi130:/var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/config/ceph.client.admin.keyring 2024-06-18T02:07:49.268 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:49 smithi007 ceph-mon[29879]: Updating smithi007:/var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/config/ceph.client.admin.keyring 2024-06-18T02:07:49.268 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:49 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:49.268 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:49 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:49.268 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:49 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:49.268 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:49 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:49.268 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:49 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:49.268 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:49 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:49.268 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:49 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:07:49.268 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:49 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:49.268 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:49 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:49.268 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:49 smithi007 ceph-mon[29879]: from='client.25154 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:07:49.268 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:49 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi007", "caps": []}]: dispatch 2024-06-18T02:07:49.269 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:49 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:49.269 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:49 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:49.269 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:49 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/1563522386' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:07:49.269 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:49 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:49.269 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:49 smithi007 ceph-mon[29879]: mgrmap e31: y(active, since 4s), standbys: x 2024-06-18T02:07:49.269 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:49 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:49.269 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:49 smithi007 ceph-mon[25091]: Updating smithi007:/etc/ceph/ceph.client.admin.keyring 2024-06-18T02:07:49.269 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:49 smithi007 ceph-mon[25091]: Updating smithi130:/etc/ceph/ceph.client.admin.keyring 2024-06-18T02:07:49.269 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:49 smithi007 ceph-mon[25091]: from='client.25148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:07:49.269 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:49 smithi007 ceph-mon[25091]: Updating smithi130:/var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/config/ceph.client.admin.keyring 2024-06-18T02:07:49.270 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:49 smithi007 ceph-mon[25091]: Updating smithi007:/var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/config/ceph.client.admin.keyring 2024-06-18T02:07:49.270 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:49 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:49.270 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:49 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:49.270 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:49 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:49.270 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:49 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:49.270 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:49 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:49.270 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:49 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:49.270 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:49 smithi007 ceph-mon[25091]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:07:49.270 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:49 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:49.270 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:49 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:49.270 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:49 smithi007 ceph-mon[25091]: from='client.25154 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:07:49.270 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:49 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi007", "caps": []}]: dispatch 2024-06-18T02:07:49.270 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:49 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:49.270 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:49 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:49.270 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:49 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/1563522386' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:07:49.271 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:49 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:49.271 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:49 smithi007 ceph-mon[25091]: mgrmap e31: y(active, since 4s), standbys: x 2024-06-18T02:07:49.271 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:49 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:49.543 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:49 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: 2024-06-18T02:07:49.291+0000 7ffabced6040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-18T02:07:49.619 INFO:teuthology.orchestra.run.smithi007.stdout:HEALTH_OK 2024-06-18T02:07:50.126 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:49 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: 2024-06-18T02:07:49.905+0000 7ffabced6040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-18T02:07:50.126 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: 2024-06-18T02:07:50.080+0000 7ffabced6040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-18T02:07:50.126 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: [18/Jun/2024:02:07:50] ENGINE Bus STARTING 2024-06-18T02:07:50.126 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: CherryPy Checker: 2024-06-18T02:07:50.127 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: The Application mounted at '' has an empty config. 2024-06-18T02:07:50.127 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: 2024-06-18T02:07:50.127 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:50 smithi130 ceph-mon[26123]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:07:50.127 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:50 smithi130 ceph-mon[26123]: Deploying daemon agent.smithi007 on smithi007 2024-06-18T02:07:50.127 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:50 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:50.127 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:50 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:50.127 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:50 smithi130 ceph-mon[26123]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:07:50.127 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:50 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:50.127 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:50 smithi130 ceph-mon[26123]: from='client.25270 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:07:50.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:50 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:50.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:50 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:50.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:50 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:50.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:50 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/2360116615' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:07:50.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:50 smithi130 ceph-mon[26123]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-06-18T02:07:50.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:50 smithi007 ceph-mon[25091]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:07:50.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:50 smithi007 ceph-mon[25091]: Deploying daemon agent.smithi007 on smithi007 2024-06-18T02:07:50.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:50 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:50.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:50 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:50.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:50 smithi007 ceph-mon[25091]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:07:50.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:50 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:50.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:50 smithi007 ceph-mon[25091]: from='client.25270 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:07:50.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:50 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:50.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:50 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:50.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:50 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:50.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:50 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/2360116615' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:07:50.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:50 smithi007 ceph-mon[25091]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-06-18T02:07:50.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:50 smithi007 ceph-mon[29879]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:07:50.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:50 smithi007 ceph-mon[29879]: Deploying daemon agent.smithi007 on smithi007 2024-06-18T02:07:50.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:50 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:50.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:50 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:50.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:50 smithi007 ceph-mon[29879]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:07:50.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:50 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:50.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:50 smithi007 ceph-mon[29879]: from='client.25270 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:07:50.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:50 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:50.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:50 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:50.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:50 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:50.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:50 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/2360116615' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:07:50.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:50 smithi007 ceph-mon[29879]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-06-18T02:07:50.543 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: [18/Jun/2024:02:07:50] ENGINE Serving on http://:::9283 2024-06-18T02:07:50.543 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:07:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[51916]: [18/Jun/2024:02:07:50] ENGINE Bus STARTED 2024-06-18T02:07:51.120 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:51 smithi130 ceph-mon[26123]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:07:51.121 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:51 smithi130 ceph-mon[26123]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:07:51.121 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:51 smithi130 ceph-mon[26123]: Standby manager daemon x restarted 2024-06-18T02:07:51.121 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:51 smithi130 ceph-mon[26123]: Standby manager daemon x started 2024-06-18T02:07:51.121 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:51 smithi130 ceph-mon[26123]: from='mgr.? 172.21.15.130:0/1369006995' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-06-18T02:07:51.121 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:51 smithi130 ceph-mon[26123]: from='mgr.? 172.21.15.130:0/1369006995' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-18T02:07:51.121 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:51 smithi130 ceph-mon[26123]: from='mgr.? 172.21.15.130:0/1369006995' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-06-18T02:07:51.121 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:51 smithi130 ceph-mon[26123]: from='mgr.? 172.21.15.130:0/1369006995' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-18T02:07:51.121 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:51 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:51.121 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:51 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:51.121 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:51 smithi130 ceph-mon[26123]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:07:51.121 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:51 smithi130 ceph-mon[26123]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:07:51.121 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:51 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:51.122 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:51 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:51.122 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:51 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:51.122 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:51 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:51.338 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:51 smithi007 ceph-mon[29879]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:07:51.339 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:51 smithi007 ceph-mon[29879]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:07:51.339 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:51 smithi007 ceph-mon[29879]: Standby manager daemon x restarted 2024-06-18T02:07:51.339 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:51 smithi007 ceph-mon[29879]: Standby manager daemon x started 2024-06-18T02:07:51.339 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:51 smithi007 ceph-mon[29879]: from='mgr.? 172.21.15.130:0/1369006995' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-06-18T02:07:51.339 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:51 smithi007 ceph-mon[29879]: from='mgr.? 172.21.15.130:0/1369006995' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-18T02:07:51.339 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:51 smithi007 ceph-mon[29879]: from='mgr.? 172.21.15.130:0/1369006995' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-06-18T02:07:51.339 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:51 smithi007 ceph-mon[29879]: from='mgr.? 172.21.15.130:0/1369006995' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-18T02:07:51.339 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:51 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:51.339 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:51 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:51.339 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:51 smithi007 ceph-mon[29879]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:07:51.339 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:51 smithi007 ceph-mon[29879]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:07:51.339 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:51 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:51.339 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:51 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:51.340 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:51 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:51.340 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:51 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:51.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:51 smithi007 ceph-mon[25091]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:07:51.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:51 smithi007 ceph-mon[25091]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:07:51.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:51 smithi007 ceph-mon[25091]: Standby manager daemon x restarted 2024-06-18T02:07:51.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:51 smithi007 ceph-mon[25091]: Standby manager daemon x started 2024-06-18T02:07:51.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:51 smithi007 ceph-mon[25091]: from='mgr.? 172.21.15.130:0/1369006995' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-06-18T02:07:51.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:51 smithi007 ceph-mon[25091]: from='mgr.? 172.21.15.130:0/1369006995' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-18T02:07:51.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:51 smithi007 ceph-mon[25091]: from='mgr.? 172.21.15.130:0/1369006995' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-06-18T02:07:51.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:51 smithi007 ceph-mon[25091]: from='mgr.? 172.21.15.130:0/1369006995' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-18T02:07:51.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:51 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:51.341 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:51 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:51.341 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:51 smithi007 ceph-mon[25091]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:07:51.341 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:51 smithi007 ceph-mon[25091]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:07:51.341 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:51 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:51.341 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:51 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:51.341 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:51 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:51.341 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:51 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:52.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:52 smithi130 ceph-mon[26123]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:07:52.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:52 smithi130 ceph-mon[26123]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:07:52.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:52 smithi130 ceph-mon[26123]: mgrmap e32: y(active, since 6s), standbys: x 2024-06-18T02:07:52.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:52 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:52.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:52 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:52.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:52 smithi130 ceph-mon[26123]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 124 KiB/s rd, 0 B/s wr, 69 op/s 2024-06-18T02:07:52.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:52 smithi130 ceph-mon[26123]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 124 KiB/s rd, 0 B/s wr, 69 op/s 2024-06-18T02:07:52.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:52 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:52.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:52 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:52.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:52 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:52.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:52 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:52.342 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:52 smithi007 ceph-mon[25091]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:07:52.343 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:52 smithi007 ceph-mon[25091]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:07:52.343 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:52 smithi007 ceph-mon[25091]: mgrmap e32: y(active, since 6s), standbys: x 2024-06-18T02:07:52.343 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:52 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:52.343 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:52 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:52.343 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:52 smithi007 ceph-mon[25091]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 124 KiB/s rd, 0 B/s wr, 69 op/s 2024-06-18T02:07:52.343 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:52 smithi007 ceph-mon[25091]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 124 KiB/s rd, 0 B/s wr, 69 op/s 2024-06-18T02:07:52.343 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:52 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:52.343 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:52 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:52.343 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:52 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:52.343 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:52 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:52.343 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:52 smithi007 ceph-mon[29879]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:07:52.344 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:52 smithi007 ceph-mon[29879]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:07:52.344 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:52 smithi007 ceph-mon[29879]: mgrmap e32: y(active, since 6s), standbys: x 2024-06-18T02:07:52.344 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:52 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:52.344 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:52 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:52.344 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:52 smithi007 ceph-mon[29879]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 124 KiB/s rd, 0 B/s wr, 69 op/s 2024-06-18T02:07:52.344 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:52 smithi007 ceph-mon[29879]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 124 KiB/s rd, 0 B/s wr, 69 op/s 2024-06-18T02:07:52.344 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:52 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:52.344 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:52 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:52.344 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:52 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:52.344 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:52 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:53.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:53 smithi007 ceph-mon[25091]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 151 KiB/s rd, 0 B/s wr, 84 op/s 2024-06-18T02:07:53.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:53 smithi007 ceph-mon[25091]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 151 KiB/s rd, 0 B/s wr, 84 op/s 2024-06-18T02:07:53.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:53 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:53.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:53 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:53.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:53 smithi007 ceph-mon[29879]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 151 KiB/s rd, 0 B/s wr, 84 op/s 2024-06-18T02:07:53.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:53 smithi007 ceph-mon[29879]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 151 KiB/s rd, 0 B/s wr, 84 op/s 2024-06-18T02:07:53.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:53 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:53.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:53 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:53.504 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:53 smithi130 ceph-mon[26123]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 151 KiB/s rd, 0 B/s wr, 84 op/s 2024-06-18T02:07:53.504 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:53 smithi130 ceph-mon[26123]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 151 KiB/s rd, 0 B/s wr, 84 op/s 2024-06-18T02:07:53.504 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:53 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:53.504 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:53 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:53.793 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:53 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[54666]: ts=2024-06-18T02:07:53.505Z caller=manager.go:609 level=warn component="rule manager" group=nodes msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on(instance) group_left(nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi007\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"cd9a3408-2d15-11ef-bc9d-c7b262605968\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-06-18T02:07:54.449 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:54 smithi130 ceph-mon[26123]: Reconfiguring prometheus.a (dependencies changed)... 2024-06-18T02:07:54.449 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:54 smithi130 ceph-mon[26123]: Reconfiguring daemon prometheus.a on smithi130 2024-06-18T02:07:54.495 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:54 smithi007 ceph-mon[25091]: Reconfiguring prometheus.a (dependencies changed)... 2024-06-18T02:07:54.495 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:54 smithi007 ceph-mon[25091]: Reconfiguring daemon prometheus.a on smithi130 2024-06-18T02:07:54.495 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:54 smithi007 ceph-mon[29879]: Reconfiguring prometheus.a (dependencies changed)... 2024-06-18T02:07:54.495 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:54 smithi007 ceph-mon[29879]: Reconfiguring daemon prometheus.a on smithi130 2024-06-18T02:07:55.413 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:55 smithi130 ceph-mon[26123]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 69 KiB/s rd, 0 B/s wr, 38 op/s 2024-06-18T02:07:55.414 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:55 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:55.414 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:55 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:55.414 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:55 smithi130 ceph-mon[26123]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 56 KiB/s rd, 0 B/s wr, 31 op/s 2024-06-18T02:07:55.414 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:55 smithi130 ceph-mon[26123]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:07:55.414 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:55 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:55.423 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:55 smithi007 ceph-mon[25091]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 69 KiB/s rd, 0 B/s wr, 38 op/s 2024-06-18T02:07:55.423 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:55 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:55.423 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:55 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:55.423 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:55 smithi007 ceph-mon[25091]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 56 KiB/s rd, 0 B/s wr, 31 op/s 2024-06-18T02:07:55.423 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:55 smithi007 ceph-mon[25091]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:07:55.423 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:55 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:55.423 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:55 smithi007 ceph-mon[29879]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 69 KiB/s rd, 0 B/s wr, 38 op/s 2024-06-18T02:07:55.423 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:55 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:55.423 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:55 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:55.423 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:55 smithi007 ceph-mon[29879]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 56 KiB/s rd, 0 B/s wr, 31 op/s 2024-06-18T02:07:55.424 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:55 smithi007 ceph-mon[29879]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:07:55.424 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:55 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:56.985 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:56 smithi130 ceph-mon[26123]: pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:07:56.985 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:56 smithi130 systemd[1]: Stopping Ceph prometheus.a for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:07:56.985 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:56 smithi130 bash[58948]: Error: no container with name or ID "ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus.a" found: no such container 2024-06-18T02:07:56.994 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:56 smithi007 ceph-mon[25091]: pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:07:56.995 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:56 smithi007 ceph-mon[29879]: pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:07:57.293 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:56 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[54666]: ts=2024-06-18T02:07:56.986Z caller=main.go:775 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-06-18T02:07:57.294 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:56 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[54666]: ts=2024-06-18T02:07:56.986Z caller=main.go:798 level=info msg="Stopping scrape discovery manager..." 2024-06-18T02:07:57.294 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:56 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[54666]: ts=2024-06-18T02:07:56.986Z caller=main.go:812 level=info msg="Stopping notify discovery manager..." 2024-06-18T02:07:57.294 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:56 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[54666]: ts=2024-06-18T02:07:56.986Z caller=main.go:834 level=info msg="Stopping scrape manager..." 2024-06-18T02:07:57.294 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:56 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[54666]: ts=2024-06-18T02:07:56.986Z caller=main.go:794 level=info msg="Scrape discovery manager stopped" 2024-06-18T02:07:57.294 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:56 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[54666]: ts=2024-06-18T02:07:56.986Z caller=main.go:808 level=info msg="Notify discovery manager stopped" 2024-06-18T02:07:57.294 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:56 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[54666]: ts=2024-06-18T02:07:56.986Z caller=manager.go:945 level=info component="rule manager" msg="Stopping rule manager..." 2024-06-18T02:07:57.294 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:56 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[54666]: ts=2024-06-18T02:07:56.986Z caller=main.go:828 level=info msg="Scrape manager stopped" 2024-06-18T02:07:57.294 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:56 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[54666]: ts=2024-06-18T02:07:56.986Z caller=manager.go:955 level=info component="rule manager" msg="Rule manager stopped" 2024-06-18T02:07:57.294 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:56 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[54666]: ts=2024-06-18T02:07:56.986Z caller=notifier.go:600 level=info component=notifier msg="Stopping notification manager..." 2024-06-18T02:07:57.294 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:56 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[54666]: ts=2024-06-18T02:07:56.986Z caller=main.go:1054 level=info msg="Notifier manager stopped" 2024-06-18T02:07:57.295 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:56 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[54666]: ts=2024-06-18T02:07:56.987Z caller=main.go:1066 level=info msg="See you next time!" 2024-06-18T02:07:57.295 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:56 smithi130 podman[58959]: 2024-06-18 02:07:56.99654704 +0000 UTC m=+0.127759217 container died eba01af28dcabfaefaa8a3fe462b22626d89b80f0432576d05906d4bb5aa8f7e (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-06-18T02:07:57.648 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:57 smithi130 podman[58959]: 2024-06-18 02:07:57.410449557 +0000 UTC m=+0.541661735 container cleanup eba01af28dcabfaefaa8a3fe462b22626d89b80f0432576d05906d4bb5aa8f7e (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-06-18T02:07:57.649 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:57 smithi130 bash[58959]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a 2024-06-18T02:07:57.649 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:57 smithi130 bash[58983]: Error: no container with name or ID "ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus.a" found: no such container 2024-06-18T02:07:57.974 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:57 smithi130 podman[58970]: 2024-06-18 02:07:57.650057916 +0000 UTC m=+0.654504478 container remove eba01af28dcabfaefaa8a3fe462b22626d89b80f0432576d05906d4bb5aa8f7e (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-06-18T02:07:57.974 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:57 smithi130 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@prometheus.a.service: Deactivated successfully. 2024-06-18T02:07:57.974 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:57 smithi130 systemd[1]: Stopped Ceph prometheus.a for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:07:57.974 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:57 smithi130 systemd[1]: Starting Ceph prometheus.a for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:07:57.974 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:57 smithi130 podman[59045]: 2024-06-18 02:07:57.87936092 +0000 UTC m=+0.111471335 container create 12e3e1deaaab009d8a89b13a584132f356b0ecfa12bcc3e6fbcee6e9d2681656 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-06-18T02:07:57.975 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:57 smithi130 podman[59045]: 2024-06-18 02:07:57.786088859 +0000 UTC m=+0.018199293 image pull 514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d quay.io/prometheus/prometheus:v2.33.4 2024-06-18T02:07:58.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:58 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:58.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:58 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/75196862' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-18T02:07:58.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:58 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:58.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:58 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/75196862' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-18T02:07:58.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:58 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:58.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:58 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/75196862' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-18T02:07:58.544 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:58 smithi130 podman[59045]: 2024-06-18 02:07:58.082081726 +0000 UTC m=+0.314192158 container init 12e3e1deaaab009d8a89b13a584132f356b0ecfa12bcc3e6fbcee6e9d2681656 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-06-18T02:07:58.544 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:58 smithi130 podman[59045]: 2024-06-18 02:07:58.085107717 +0000 UTC m=+0.317218134 container start 12e3e1deaaab009d8a89b13a584132f356b0ecfa12bcc3e6fbcee6e9d2681656 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-06-18T02:07:58.544 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:58 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[59059]: ts=2024-06-18T02:07:58.108Z caller=main.go:475 level=info msg="No time or size retention was set so using the default time retention" duration=15d 2024-06-18T02:07:58.544 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:58 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[59059]: ts=2024-06-18T02:07:58.108Z caller=main.go:512 level=info msg="Starting Prometheus" version="(version=2.33.4, branch=HEAD, revision=83032011a5d3e6102624fe58241a374a7201fee8)" 2024-06-18T02:07:58.544 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:58 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[59059]: ts=2024-06-18T02:07:58.108Z caller=main.go:517 level=info build_context="(go=go1.17.7, user=root@d13bf69e7be8, date=20220222-16:51:28)" 2024-06-18T02:07:58.544 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:58 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[59059]: ts=2024-06-18T02:07:58.108Z caller=main.go:518 level=info host_details="(Linux 5.14.0-460.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024 x86_64 smithi130 (none))" 2024-06-18T02:07:58.544 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:58 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[59059]: ts=2024-06-18T02:07:58.108Z caller=main.go:519 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-06-18T02:07:58.544 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:58 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[59059]: ts=2024-06-18T02:07:58.108Z caller=main.go:520 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-06-18T02:07:58.544 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:58 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[59059]: ts=2024-06-18T02:07:58.110Z caller=web.go:570 level=info component=web msg="Start listening for connections" address=:9095 2024-06-18T02:07:58.544 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:58 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[59059]: ts=2024-06-18T02:07:58.110Z caller=main.go:923 level=info msg="Starting TSDB ..." 2024-06-18T02:07:58.544 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:58 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[59059]: ts=2024-06-18T02:07:58.111Z caller=tls_config.go:195 level=info component=web msg="TLS is disabled." http2=false 2024-06-18T02:07:58.544 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:58 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[59059]: ts=2024-06-18T02:07:58.113Z caller=head.go:493 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-06-18T02:07:58.545 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:58 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[59059]: ts=2024-06-18T02:07:58.113Z caller=head.go:527 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=2.26µs 2024-06-18T02:07:58.545 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:58 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[59059]: ts=2024-06-18T02:07:58.113Z caller=head.go:533 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-06-18T02:07:58.545 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:58 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[59059]: ts=2024-06-18T02:07:58.114Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=3 2024-06-18T02:07:58.545 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:58 smithi130 bash[59045]: 12e3e1deaaab009d8a89b13a584132f356b0ecfa12bcc3e6fbcee6e9d2681656 2024-06-18T02:07:58.545 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:58 smithi130 systemd[1]: Started Ceph prometheus.a for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:07:58.819 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:58 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[59059]: ts=2024-06-18T02:07:58.563Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=3 2024-06-18T02:07:58.819 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:58 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[59059]: ts=2024-06-18T02:07:58.792Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=2 maxSegment=3 2024-06-18T02:07:58.819 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:58 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[59059]: ts=2024-06-18T02:07:58.793Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=3 maxSegment=3 2024-06-18T02:07:58.819 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:58 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[59059]: ts=2024-06-18T02:07:58.793Z caller=head.go:610 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=44.135µs wal_replay_duration=679.393325ms total_replay_duration=679.459479ms 2024-06-18T02:07:58.819 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:58 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[59059]: ts=2024-06-18T02:07:58.797Z caller=main.go:944 level=info fs_type=XFS_SUPER_MAGIC 2024-06-18T02:07:58.819 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:58 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[59059]: ts=2024-06-18T02:07:58.797Z caller=main.go:947 level=info msg="TSDB started" 2024-06-18T02:07:58.819 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:58 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[59059]: ts=2024-06-18T02:07:58.797Z caller=main.go:1128 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-06-18T02:07:58.819 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:58 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[59059]: ts=2024-06-18T02:07:58.819Z caller=main.go:1165 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=21.947974ms db_storage=1.034µs remote_storage=1.187µs web_handler=334ns query_engine=861ns scrape=343.182µs scrape_sd=96.588µs notify=16.732µs notify_sd=23.479µs rules=20.887473ms 2024-06-18T02:07:58.819 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:07:58 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[59059]: ts=2024-06-18T02:07:58.819Z caller=main.go:896 level=info msg="Server is ready to receive web requests." 2024-06-18T02:07:59.431 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:59 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:59.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:59 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:59.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:59 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-06-18T02:07:59.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:59 smithi007 ceph-mon[29879]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-06-18T02:07:59.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:59 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:07:59.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:59 smithi007 ceph-mon[29879]: Upgrade: Need to upgrade myself (mgr.y) 2024-06-18T02:07:59.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:59 smithi007 ceph-mon[29879]: Upgrade: Need to upgrade myself (mgr.y) 2024-06-18T02:07:59.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:07:59 smithi007 ceph-mon[29879]: pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:07:59.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:59 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:59.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:59 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:59.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:59 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-06-18T02:07:59.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:59 smithi007 ceph-mon[25091]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-06-18T02:07:59.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:59 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:07:59.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:59 smithi007 ceph-mon[25091]: Upgrade: Need to upgrade myself (mgr.y) 2024-06-18T02:07:59.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:59 smithi007 ceph-mon[25091]: Upgrade: Need to upgrade myself (mgr.y) 2024-06-18T02:07:59.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:07:59 smithi007 ceph-mon[25091]: pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:07:59.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:59 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:59.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:59 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:07:59.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:59 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-06-18T02:07:59.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:59 smithi130 ceph-mon[26123]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-06-18T02:07:59.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:59 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:07:59.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:59 smithi130 ceph-mon[26123]: Upgrade: Need to upgrade myself (mgr.y) 2024-06-18T02:07:59.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:59 smithi130 ceph-mon[26123]: Upgrade: Need to upgrade myself (mgr.y) 2024-06-18T02:07:59.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:07:59 smithi130 ceph-mon[26123]: pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:08:00.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:00 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:08:00.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:00 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:08:00.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:00 smithi007 ceph-mon[25091]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:08:00.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:00 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:08:00.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:00 smithi007 ceph-mon[25091]: Upgrade: Updating mgr.x 2024-06-18T02:08:00.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:00 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-18T02:08:00.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:00 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-18T02:08:00.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:00 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:08:00.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:00 smithi007 ceph-mon[25091]: Deploying daemon mgr.x on smithi130 2024-06-18T02:08:00.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:00 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:08:00.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:00 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:08:00.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:00 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:08:00.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:00 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:08:00.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:00 smithi007 ceph-mon[29879]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:08:00.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:00 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:08:00.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:00 smithi007 ceph-mon[29879]: Upgrade: Updating mgr.x 2024-06-18T02:08:00.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:00 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-18T02:08:00.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:00 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-18T02:08:00.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:00 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:08:00.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:00 smithi007 ceph-mon[29879]: Deploying daemon mgr.x on smithi130 2024-06-18T02:08:00.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:00 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:08:00.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:00 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:08:00.945 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:00 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:08:00.945 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:00 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:08:00.945 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:00 smithi130 ceph-mon[26123]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:08:00.945 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:00 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:08:00.946 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:00 smithi130 ceph-mon[26123]: Upgrade: Updating mgr.x 2024-06-18T02:08:00.946 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:00 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-18T02:08:00.946 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:00 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-18T02:08:00.946 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:00 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:08:00.946 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:00 smithi130 ceph-mon[26123]: Deploying daemon mgr.x on smithi130 2024-06-18T02:08:00.946 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:00 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:08:00.946 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:00 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:08:01.497 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:01 smithi130 systemd[1]: Stopping Ceph mgr.x for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:08:01.760 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:01 smithi130 ceph-mon[26123]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-06-18T02:08:01.760 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:01 smithi130 ceph-mon[26123]: Cluster is now healthy 2024-06-18T02:08:01.760 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:01 smithi130 podman[59379]: 2024-06-18 02:08:01.497880236 +0000 UTC m=+0.125359460 container died a297d5406893f70868773fe6ae699ec3dd47479d94f7b068c83d2c3a9d0e24ff (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, RELEASE=squid-3781e3a, org.label-schema.build-date=20240612, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-06-18T02:08:01.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:01 smithi007 ceph-mon[25091]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-06-18T02:08:01.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:01 smithi007 ceph-mon[25091]: Cluster is now healthy 2024-06-18T02:08:01.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:01 smithi007 ceph-mon[29879]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-06-18T02:08:01.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:01 smithi007 ceph-mon[29879]: Cluster is now healthy 2024-06-18T02:08:02.043 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:01 smithi130 podman[59379]: 2024-06-18 02:08:01.859237882 +0000 UTC m=+0.486717102 container cleanup a297d5406893f70868773fe6ae699ec3dd47479d94f7b068c83d2c3a9d0e24ff (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x, RELEASE=squid-3781e3a, org.label-schema.build-date=20240612, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.36.0) 2024-06-18T02:08:02.043 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:01 smithi130 bash[59379]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x 2024-06-18T02:08:02.493 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:02 smithi130 podman[59394]: 2024-06-18 02:08:02.143965461 +0000 UTC m=+0.647665328 container remove a297d5406893f70868773fe6ae699ec3dd47479d94f7b068c83d2c3a9d0e24ff (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.36.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240612, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-3781e3a, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-18T02:08:02.494 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:02 smithi130 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mgr.x.service: Main process exited, code=exited, status=143/n/a 2024-06-18T02:08:02.494 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:02 smithi130 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mgr.x.service: Failed with result 'exit-code'. 2024-06-18T02:08:02.494 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:02 smithi130 systemd[1]: Stopped Ceph mgr.x for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:08:02.494 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:02 smithi130 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mgr.x.service: Consumed 21.302s CPU time. 2024-06-18T02:08:02.784 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:02 smithi130 ceph-mon[26123]: pgmap v23: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 510 B/s rd, 0 op/s 2024-06-18T02:08:02.784 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:02 smithi130 systemd[1]: Starting Ceph mgr.x for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:08:02.784 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:02 smithi130 podman[59519]: 2024-06-18 02:08:02.613449109 +0000 UTC m=+0.017385231 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:08:02.784 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:02 smithi130 podman[59519]: 2024-06-18 02:08:02.78575182 +0000 UTC m=+0.189687924 container create 01017e37bdbe757cfdd7f13646a7c8fe201fa1f456269b4d94e5c485062c26b5 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-3781e3a, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.build-date=20240612, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-06-18T02:08:02.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:02 smithi007 ceph-mon[25091]: pgmap v23: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 510 B/s rd, 0 op/s 2024-06-18T02:08:02.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:02 smithi007 ceph-mon[29879]: pgmap v23: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 510 B/s rd, 0 op/s 2024-06-18T02:08:03.043 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:02 smithi130 podman[59519]: 2024-06-18 02:08:02.998116888 +0000 UTC m=+0.402052992 container init 01017e37bdbe757cfdd7f13646a7c8fe201fa1f456269b4d94e5c485062c26b5 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240612, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-3781e3a, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-06-18T02:08:03.043 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:03 smithi130 podman[59519]: 2024-06-18 02:08:03.001003749 +0000 UTC m=+0.404939854 container start 01017e37bdbe757cfdd7f13646a7c8fe201fa1f456269b4d94e5c485062c26b5 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240612, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-3781e3a, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-06-18T02:08:03.043 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:03 smithi130 ceph-mgr[59538]: -- 172.21.15.130:0/3051712473 <== mon.2 v2:172.21.15.130:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56433f54b0e0 con 0x56433f529400 2024-06-18T02:08:03.367 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:03 smithi130 bash[59519]: 01017e37bdbe757cfdd7f13646a7c8fe201fa1f456269b4d94e5c485062c26b5 2024-06-18T02:08:03.367 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:03 smithi130 systemd[1]: Started Ceph mgr.x for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:08:03.367 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:03 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:03.136+0000 7f4206d19040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-18T02:08:03.367 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:03 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:03.297+0000 7f4206d19040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-18T02:08:03.367 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:03 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:03.367+0000 7f4206d19040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-18T02:08:03.622 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:03 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[59059]: ts=2024-06-18T02:08:03.504Z caller=manager.go:609 level=warn component="rule manager" group=nodes msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on(instance) group_left(nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi007\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"cd9a3408-2d15-11ef-bc9d-c7b262605968\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-06-18T02:08:04.043 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:03 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:03.623+0000 7f4206d19040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-18T02:08:04.043 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:03 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:03.686+0000 7f4206d19040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-18T02:08:04.431 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:04 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: ignoring --setuser ceph since I am not root 2024-06-18T02:08:04.432 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:04 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: ignoring --setgroup ceph since I am not root 2024-06-18T02:08:04.432 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:04 smithi007 ceph-mgr[65903]: -- 172.21.15.7:0/3049486269 <== mon.1 v2:172.21.15.7:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c281d0b0e0 con 0x55c281ce8800 2024-06-18T02:08:04.432 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:04 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:08:04.359+0000 7fc92588d040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-18T02:08:04.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:04 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:08:04.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:04 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:08:04.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:04 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:08:04.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:04 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:08:04.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:04 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:08:04.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:04 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:08:04.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:04 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:08:04.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:04 smithi007 ceph-mon[29879]: Upgrade: Need to upgrade myself (mgr.y) 2024-06-18T02:08:04.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:04 smithi007 ceph-mon[29879]: Upgrade: Need to upgrade myself (mgr.y) 2024-06-18T02:08:04.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:04 smithi007 ceph-mon[29879]: Failing over to other MGR 2024-06-18T02:08:04.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:04 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-06-18T02:08:04.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:04 smithi007 ceph-mon[29879]: osdmap e107: 8 total, 8 up, 8 in 2024-06-18T02:08:04.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:04 smithi007 ceph-mon[29879]: Standby manager daemon y started 2024-06-18T02:08:04.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:04 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:08:04.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:04 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:08:04.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:04 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:08:04.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:04 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:08:04.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:04 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:08:04.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:04 smithi007 ceph-mon[25091]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:08:04.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:04 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:08:04.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:04 smithi007 ceph-mon[25091]: Upgrade: Need to upgrade myself (mgr.y) 2024-06-18T02:08:04.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:04 smithi007 ceph-mon[25091]: Upgrade: Need to upgrade myself (mgr.y) 2024-06-18T02:08:04.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:04 smithi007 ceph-mon[25091]: Failing over to other MGR 2024-06-18T02:08:04.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:04 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-06-18T02:08:04.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:04 smithi007 ceph-mon[25091]: osdmap e107: 8 total, 8 up, 8 in 2024-06-18T02:08:04.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:04 smithi007 ceph-mon[25091]: Standby manager daemon y started 2024-06-18T02:08:04.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:04 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:08:04.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:04 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:08:04.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:04 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:08:04.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:04 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:08:04.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:04 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' 2024-06-18T02:08:04.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:04 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:08:04.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:04 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:08:04.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:04 smithi130 ceph-mon[26123]: Upgrade: Need to upgrade myself (mgr.y) 2024-06-18T02:08:04.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:04 smithi130 ceph-mon[26123]: Upgrade: Need to upgrade myself (mgr.y) 2024-06-18T02:08:04.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:04 smithi130 ceph-mon[26123]: Failing over to other MGR 2024-06-18T02:08:04.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:04 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-06-18T02:08:04.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:04 smithi130 ceph-mon[26123]: osdmap e107: 8 total, 8 up, 8 in 2024-06-18T02:08:04.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:04 smithi130 ceph-mon[26123]: Standby manager daemon y started 2024-06-18T02:08:04.853 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:04 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:08:04.523+0000 7fc92588d040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-18T02:08:04.853 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:04 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:08:04.595+0000 7fc92588d040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-18T02:08:04.853 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:04 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:08:04.853+0000 7fc92588d040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-18T02:08:05.038 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:04 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:04.648+0000 7f4206d19040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-18T02:08:05.039 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:04 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:04.766+0000 7f4206d19040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-18T02:08:05.039 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:04 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:04.823+0000 7f4206d19040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-18T02:08:05.179 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:04 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:08:04.916+0000 7fc92588d040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-18T02:08:05.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:05 smithi130 ceph-mon[26123]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2024-06-18T02:08:05.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:05 smithi130 ceph-mon[26123]: mgrmap e33: x(active, starting, since 0.883556s), standbys: y 2024-06-18T02:08:05.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:05 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:05.039+0000 7f4206d19040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-18T02:08:05.294 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:05 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:05.102+0000 7f4206d19040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-18T02:08:05.294 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:05 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:05.169+0000 7f4206d19040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-18T02:08:05.431 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:05 smithi007 ceph-mon[29879]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2024-06-18T02:08:05.431 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:05 smithi007 ceph-mon[29879]: mgrmap e33: x(active, starting, since 0.883556s), standbys: y 2024-06-18T02:08:05.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:05 smithi007 ceph-mon[25091]: from='mgr.25219 172.21.15.7:0/208809247' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2024-06-18T02:08:05.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:05 smithi007 ceph-mon[25091]: mgrmap e33: x(active, starting, since 0.883556s), standbys: y 2024-06-18T02:08:05.747 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:05 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:05.319+0000 7f4206d19040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-18T02:08:06.043 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:05 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:05.747+0000 7f4206d19040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-18T02:08:06.181 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:05 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:08:05.909+0000 7fc92588d040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-18T02:08:06.181 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:06 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:08:06.033+0000 7fc92588d040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-18T02:08:06.182 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:06 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:08:06.093+0000 7fc92588d040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-18T02:08:06.456 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:06 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:08:06.321+0000 7fc92588d040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-18T02:08:06.457 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:06 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:08:06.387+0000 7fc92588d040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-18T02:08:06.457 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:06 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:08:06.458+0000 7fc92588d040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-18T02:08:06.543 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:06 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:06.074+0000 7f4206d19040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-18T02:08:06.543 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:06 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:06.142+0000 7f4206d19040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-18T02:08:06.543 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:06 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:06.295+0000 7f4206d19040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-18T02:08:06.931 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:06 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:08:06.616+0000 7fc92588d040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-18T02:08:07.009 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:06 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:06.610+0000 7f4206d19040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-18T02:08:07.009 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:06 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:06.672+0000 7f4206d19040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-18T02:08:07.009 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:06 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:06.859+0000 7f4206d19040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-18T02:08:07.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:07 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:07.009+0000 7f4206d19040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-18T02:08:07.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:07 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:07.075+0000 7f4206d19040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-18T02:08:07.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:07 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:07.159+0000 7f4206d19040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-18T02:08:07.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:07 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:07.220+0000 7f4206d19040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-18T02:08:07.408 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:07 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:08:07.063+0000 7fc92588d040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-18T02:08:07.681 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:07 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:08:07.408+0000 7fc92588d040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-18T02:08:07.682 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:07 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:08:07.482+0000 7fc92588d040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-18T02:08:07.682 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:07 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:08:07.648+0000 7fc92588d040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-18T02:08:08.036 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:07 smithi130 ceph-mon[26123]: Active manager daemon x restarted 2024-06-18T02:08:08.037 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:07 smithi130 ceph-mon[26123]: Activating manager daemon x 2024-06-18T02:08:08.037 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:07 smithi130 ceph-mon[26123]: from='mgr.? 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-06-18T02:08:08.037 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:07 smithi130 ceph-mon[26123]: osdmap e108: 8 total, 8 up, 8 in 2024-06-18T02:08:08.037 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:07 smithi130 ceph-mon[26123]: from='mgr.? 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-18T02:08:08.037 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:07 smithi130 ceph-mon[26123]: from='mgr.? 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-06-18T02:08:08.037 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:07 smithi130 ceph-mon[26123]: from='mgr.? 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-18T02:08:08.037 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:07 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:07.767+0000 7f4206d19040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-18T02:08:08.037 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:07 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:07.930+0000 7f4206d19040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-18T02:08:08.037 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:07 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: [18/Jun/2024:02:08:07] ENGINE Bus STARTING 2024-06-18T02:08:08.037 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:07 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: CherryPy Checker: 2024-06-18T02:08:08.038 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:07 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: The Application mounted at '' has an empty config. 2024-06-18T02:08:08.038 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:07 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:08.038 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:08 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: [18/Jun/2024:02:08:08] ENGINE Serving on http://:::9283 2024-06-18T02:08:08.038 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:08 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: [18/Jun/2024:02:08:08] ENGINE Bus STARTED 2024-06-18T02:08:08.261 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:07 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:08:07.994+0000 7fc92588d040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-18T02:08:08.261 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:08:08.062+0000 7fc92588d040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-18T02:08:08.261 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:07 smithi007 ceph-mon[29879]: Active manager daemon x restarted 2024-06-18T02:08:08.262 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:07 smithi007 ceph-mon[29879]: Activating manager daemon x 2024-06-18T02:08:08.262 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:07 smithi007 ceph-mon[29879]: from='mgr.? 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-06-18T02:08:08.262 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:07 smithi007 ceph-mon[29879]: osdmap e108: 8 total, 8 up, 8 in 2024-06-18T02:08:08.262 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:07 smithi007 ceph-mon[29879]: from='mgr.? 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-18T02:08:08.262 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:07 smithi007 ceph-mon[29879]: from='mgr.? 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-06-18T02:08:08.262 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:07 smithi007 ceph-mon[29879]: from='mgr.? 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-18T02:08:08.262 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:07 smithi007 ceph-mon[25091]: Active manager daemon x restarted 2024-06-18T02:08:08.262 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:07 smithi007 ceph-mon[25091]: Activating manager daemon x 2024-06-18T02:08:08.262 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:07 smithi007 ceph-mon[25091]: from='mgr.? 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-06-18T02:08:08.262 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:07 smithi007 ceph-mon[25091]: osdmap e108: 8 total, 8 up, 8 in 2024-06-18T02:08:08.262 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:07 smithi007 ceph-mon[25091]: from='mgr.? 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-18T02:08:08.263 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:07 smithi007 ceph-mon[25091]: from='mgr.? 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-06-18T02:08:08.263 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:07 smithi007 ceph-mon[25091]: from='mgr.? 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-18T02:08:08.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:08 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: [18/Jun/2024:02:08:08] ENGINE Bus STOPPING 2024-06-18T02:08:08.583 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:08:08.262+0000 7fc92588d040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-18T02:08:08.583 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:08:08.424+0000 7fc92588d040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-18T02:08:08.583 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:08:08.492+0000 7fc92588d040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-18T02:08:08.793 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:08 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: [18/Jun/2024:02:08:08] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-06-18T02:08:08.793 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:08 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: [18/Jun/2024:02:08:08] ENGINE Bus STOPPED 2024-06-18T02:08:08.794 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:08 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: [18/Jun/2024:02:08:08] ENGINE Bus STARTING 2024-06-18T02:08:08.794 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:08 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: [18/Jun/2024:02:08:08] ENGINE Serving on http://:::9283 2024-06-18T02:08:08.794 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:08 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: [18/Jun/2024:02:08:08] ENGINE Bus STARTED 2024-06-18T02:08:08.934 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:08:08.584+0000 7fc92588d040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-18T02:08:08.934 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:08:08.650+0000 7fc92588d040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-18T02:08:09.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:09 smithi130 ceph-mon[26123]: mgrmap e34: x(active, starting, since 0.0584343s), standbys: y 2024-06-18T02:08:09.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:09 smithi130 ceph-mon[26123]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-18T02:08:09.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:09 smithi130 ceph-mon[26123]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-18T02:08:09.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:09 smithi130 ceph-mon[26123]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-18T02:08:09.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:09 smithi130 ceph-mon[26123]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-06-18T02:08:09.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:09 smithi130 ceph-mon[26123]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-06-18T02:08:09.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:09 smithi130 ceph-mon[26123]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-18T02:08:09.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:09 smithi130 ceph-mon[26123]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-18T02:08:09.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:09 smithi130 ceph-mon[26123]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-18T02:08:09.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:09 smithi130 ceph-mon[26123]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-18T02:08:09.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:09 smithi130 ceph-mon[26123]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-18T02:08:09.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:09 smithi130 ceph-mon[26123]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-18T02:08:09.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:09 smithi130 ceph-mon[26123]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-18T02:08:09.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:09 smithi130 ceph-mon[26123]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-18T02:08:09.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:09 smithi130 ceph-mon[26123]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-18T02:08:09.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:09 smithi130 ceph-mon[26123]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-18T02:08:09.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:09 smithi130 ceph-mon[26123]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-18T02:08:09.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:09 smithi130 ceph-mon[26123]: Manager daemon x is now available 2024-06-18T02:08:09.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:09 smithi130 ceph-mon[26123]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:09.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:09 smithi130 ceph-mon[26123]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi007", "caps": []}]: dispatch 2024-06-18T02:08:09.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:09 smithi130 ceph-mon[26123]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi130", "caps": []}]: dispatch 2024-06-18T02:08:09.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:09 smithi130 ceph-mon[26123]: from='mgr.25202 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi007", "caps": []}]: dispatch 2024-06-18T02:08:09.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:09 smithi130 ceph-mon[26123]: from='mgr.25202 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi130", "caps": []}]: dispatch 2024-06-18T02:08:09.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:09 smithi130 ceph-mon[26123]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:09.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:09 smithi130 ceph-mon[26123]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-06-18T02:08:09.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:09 smithi130 ceph-mon[26123]: from='mgr.25202 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-06-18T02:08:09.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:09 smithi130 ceph-mon[26123]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:08:09.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:09 smithi130 ceph-mon[26123]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-06-18T02:08:09.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:09 smithi130 ceph-mon[26123]: from='mgr.25202 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-06-18T02:08:09.407 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:09 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:08:09.236+0000 7fc92588d040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-18T02:08:09.407 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[25091]: mgrmap e34: x(active, starting, since 0.0584343s), standbys: y 2024-06-18T02:08:09.407 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[25091]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-18T02:08:09.408 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[25091]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-18T02:08:09.408 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[25091]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-18T02:08:09.408 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[25091]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-06-18T02:08:09.408 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[25091]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-06-18T02:08:09.408 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[25091]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-18T02:08:09.408 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[25091]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-18T02:08:09.408 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[25091]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-18T02:08:09.408 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[25091]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-18T02:08:09.408 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[25091]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-18T02:08:09.408 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[25091]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-18T02:08:09.408 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[25091]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-18T02:08:09.408 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[25091]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-18T02:08:09.408 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[25091]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-18T02:08:09.409 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[25091]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-18T02:08:09.409 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[25091]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-18T02:08:09.409 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[25091]: Manager daemon x is now available 2024-06-18T02:08:09.409 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[25091]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:09.409 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[25091]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi007", "caps": []}]: dispatch 2024-06-18T02:08:09.409 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[25091]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi130", "caps": []}]: dispatch 2024-06-18T02:08:09.409 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[25091]: from='mgr.25202 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi007", "caps": []}]: dispatch 2024-06-18T02:08:09.409 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[25091]: from='mgr.25202 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi130", "caps": []}]: dispatch 2024-06-18T02:08:09.409 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[25091]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:09.409 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[25091]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-06-18T02:08:09.409 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[25091]: from='mgr.25202 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-06-18T02:08:09.409 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[25091]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:08:09.409 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[25091]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-06-18T02:08:09.410 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[25091]: from='mgr.25202 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-06-18T02:08:09.410 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[29879]: mgrmap e34: x(active, starting, since 0.0584343s), standbys: y 2024-06-18T02:08:09.410 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[29879]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-18T02:08:09.410 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[29879]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-18T02:08:09.410 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[29879]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-18T02:08:09.410 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[29879]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-06-18T02:08:09.410 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[29879]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-06-18T02:08:09.410 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[29879]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-18T02:08:09.410 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[29879]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-18T02:08:09.410 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[29879]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-18T02:08:09.411 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[29879]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-18T02:08:09.411 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[29879]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-18T02:08:09.411 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[29879]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-18T02:08:09.411 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[29879]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-18T02:08:09.411 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[29879]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-18T02:08:09.411 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[29879]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-18T02:08:09.411 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[29879]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-18T02:08:09.411 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[29879]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-18T02:08:09.411 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[29879]: Manager daemon x is now available 2024-06-18T02:08:09.411 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[29879]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:09.411 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[29879]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi007", "caps": []}]: dispatch 2024-06-18T02:08:09.411 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[29879]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi130", "caps": []}]: dispatch 2024-06-18T02:08:09.411 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[29879]: from='mgr.25202 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi007", "caps": []}]: dispatch 2024-06-18T02:08:09.411 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[29879]: from='mgr.25202 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi130", "caps": []}]: dispatch 2024-06-18T02:08:09.412 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[29879]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:09.412 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[29879]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-06-18T02:08:09.412 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[29879]: from='mgr.25202 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-06-18T02:08:09.412 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[29879]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:08:09.412 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[29879]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-06-18T02:08:09.412 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:08 smithi007 ceph-mon[29879]: from='mgr.25202 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-06-18T02:08:09.682 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:09 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:08:09.408+0000 7fc92588d040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-18T02:08:09.682 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:09 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: [18/Jun/2024:02:08:09] ENGINE Bus STARTING 2024-06-18T02:08:09.682 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:09 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: CherryPy Checker: 2024-06-18T02:08:09.682 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:09 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: The Application mounted at '' has an empty config. 2024-06-18T02:08:09.682 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:09 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:08:09.682 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:09 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: [18/Jun/2024:02:08:09] ENGINE Serving on http://:::9283 2024-06-18T02:08:09.682 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:09 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: [18/Jun/2024:02:08:09] ENGINE Bus STARTED 2024-06-18T02:08:10.262 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:10 smithi007 ceph-mon[25091]: mgrmap e35: x(active, since 1.07657s), standbys: y 2024-06-18T02:08:10.262 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:10 smithi007 ceph-mon[25091]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:08:10.262 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:10 smithi007 ceph-mon[25091]: from='client.25291 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:08:10.263 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:10 smithi007 ceph-mon[25091]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi007", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:08:10.263 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:10 smithi007 ceph-mon[25091]: from='mgr.25202 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi007", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:08:10.263 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:10 smithi007 ceph-mon[25091]: Standby manager daemon y restarted 2024-06-18T02:08:10.263 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:10 smithi007 ceph-mon[25091]: Standby manager daemon y started 2024-06-18T02:08:10.263 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:10 smithi007 ceph-mon[25091]: from='mgr.? 172.21.15.7:0/3184707382' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-06-18T02:08:10.263 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:10 smithi007 ceph-mon[25091]: from='mgr.? 172.21.15.7:0/3184707382' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-18T02:08:10.263 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:10 smithi007 ceph-mon[25091]: from='mgr.? 172.21.15.7:0/3184707382' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-06-18T02:08:10.263 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:10 smithi007 ceph-mon[25091]: from='mgr.? 172.21.15.7:0/3184707382' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-18T02:08:10.263 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:10 smithi007 ceph-mon[29879]: mgrmap e35: x(active, since 1.07657s), standbys: y 2024-06-18T02:08:10.263 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:10 smithi007 ceph-mon[29879]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:08:10.263 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:10 smithi007 ceph-mon[29879]: from='client.25291 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:08:10.263 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:10 smithi007 ceph-mon[29879]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi007", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:08:10.263 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:10 smithi007 ceph-mon[29879]: from='mgr.25202 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi007", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:08:10.264 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:10 smithi007 ceph-mon[29879]: Standby manager daemon y restarted 2024-06-18T02:08:10.264 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:10 smithi007 ceph-mon[29879]: Standby manager daemon y started 2024-06-18T02:08:10.264 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:10 smithi007 ceph-mon[29879]: from='mgr.? 172.21.15.7:0/3184707382' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-06-18T02:08:10.264 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:10 smithi007 ceph-mon[29879]: from='mgr.? 172.21.15.7:0/3184707382' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-18T02:08:10.264 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:10 smithi007 ceph-mon[29879]: from='mgr.? 172.21.15.7:0/3184707382' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-06-18T02:08:10.264 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:10 smithi007 ceph-mon[29879]: from='mgr.? 172.21.15.7:0/3184707382' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-18T02:08:10.280 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:10 smithi130 ceph-mon[26123]: mgrmap e35: x(active, since 1.07657s), standbys: y 2024-06-18T02:08:10.280 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:10 smithi130 ceph-mon[26123]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:08:10.280 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:10 smithi130 ceph-mon[26123]: from='client.25291 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:08:10.280 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:10 smithi130 ceph-mon[26123]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi007", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:08:10.281 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:10 smithi130 ceph-mon[26123]: from='mgr.25202 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi007", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:08:10.281 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:10 smithi130 ceph-mon[26123]: Standby manager daemon y restarted 2024-06-18T02:08:10.281 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:10 smithi130 ceph-mon[26123]: Standby manager daemon y started 2024-06-18T02:08:10.281 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:10 smithi130 ceph-mon[26123]: from='mgr.? 172.21.15.7:0/3184707382' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-06-18T02:08:10.281 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:10 smithi130 ceph-mon[26123]: from='mgr.? 172.21.15.7:0/3184707382' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-18T02:08:10.281 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:10 smithi130 ceph-mon[26123]: from='mgr.? 172.21.15.7:0/3184707382' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-06-18T02:08:10.281 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:10 smithi130 ceph-mon[26123]: from='mgr.? 172.21.15.7:0/3184707382' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-18T02:08:10.281 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:10 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:10.051+0000 7f415f048640 -1 log_channel(cephadm) log [ERR] : [18/Jun/2024:02:08:10] ENGINE Error in HTTPServer.serve 2024-06-18T02:08:10.281 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:10 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: Traceback (most recent call last): 2024-06-18T02:08:10.282 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:10 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-06-18T02:08:10.282 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:10 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: self._connections.run(self.expiration_interval) 2024-06-18T02:08:10.282 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:10 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-06-18T02:08:10.282 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:10 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: self._run(expiration_interval) 2024-06-18T02:08:10.282 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:10 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-06-18T02:08:10.282 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:10 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: new_conn = self._from_server_socket(self.server.socket) 2024-06-18T02:08:10.282 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:10 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-06-18T02:08:10.282 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:10 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-06-18T02:08:10.282 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:10 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-06-18T02:08:10.282 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:10 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: s = self.context.wrap_socket( 2024-06-18T02:08:10.282 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:10 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-06-18T02:08:10.282 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:10 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: return self.sslsocket_class._create( 2024-06-18T02:08:10.282 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:10 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-06-18T02:08:10.283 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:10 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: self.do_handshake() 2024-06-18T02:08:10.283 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:10 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-06-18T02:08:10.283 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:10 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: self._sslobj.do_handshake() 2024-06-18T02:08:10.283 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:10 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1129) 2024-06-18T02:08:10.283 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:10 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:11.256 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:11 smithi007 ceph-mon[25091]: [18/Jun/2024:02:08:09] ENGINE Bus STARTING 2024-06-18T02:08:11.256 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:11 smithi007 ceph-mon[25091]: [18/Jun/2024:02:08:09] ENGINE Serving on http://172.21.15.130:8765 2024-06-18T02:08:11.256 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:11 smithi007 ceph-mon[25091]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:08:11.256 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:11 smithi007 ceph-mon[25091]: mgrmap e36: x(active, since 2s), standbys: y 2024-06-18T02:08:11.257 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:11 smithi007 ceph-mon[25091]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi130", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:08:11.257 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:11 smithi007 ceph-mon[25091]: from='mgr.25202 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi130", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:08:11.257 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:11 smithi007 ceph-mon[25091]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:08:11.257 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:11 smithi007 ceph-mon[25091]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:08:11.257 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:11 smithi007 ceph-mon[25091]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:11.257 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:11 smithi007 ceph-mon[25091]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:11.257 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:11 smithi007 ceph-mon[29879]: [18/Jun/2024:02:08:09] ENGINE Bus STARTING 2024-06-18T02:08:11.257 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:11 smithi007 ceph-mon[29879]: [18/Jun/2024:02:08:09] ENGINE Serving on http://172.21.15.130:8765 2024-06-18T02:08:11.257 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:11 smithi007 ceph-mon[29879]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:08:11.257 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:11 smithi007 ceph-mon[29879]: mgrmap e36: x(active, since 2s), standbys: y 2024-06-18T02:08:11.258 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:11 smithi007 ceph-mon[29879]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi130", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:08:11.258 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:11 smithi007 ceph-mon[29879]: from='mgr.25202 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi130", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:08:11.258 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:11 smithi007 ceph-mon[29879]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:08:11.258 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:11 smithi007 ceph-mon[29879]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:08:11.258 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:11 smithi007 ceph-mon[29879]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:11.258 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:11 smithi007 ceph-mon[29879]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:11.260 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:11 smithi130 ceph-mon[26123]: [18/Jun/2024:02:08:09] ENGINE Bus STARTING 2024-06-18T02:08:11.260 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:11 smithi130 ceph-mon[26123]: [18/Jun/2024:02:08:09] ENGINE Serving on http://172.21.15.130:8765 2024-06-18T02:08:11.260 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:11 smithi130 ceph-mon[26123]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:08:11.260 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:11 smithi130 ceph-mon[26123]: mgrmap e36: x(active, since 2s), standbys: y 2024-06-18T02:08:11.260 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:11 smithi130 ceph-mon[26123]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi130", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:08:11.260 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:11 smithi130 ceph-mon[26123]: from='mgr.25202 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi130", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:08:11.260 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:11 smithi130 ceph-mon[26123]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:08:11.260 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:11 smithi130 ceph-mon[26123]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:08:11.260 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:11 smithi130 ceph-mon[26123]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:11.260 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:11 smithi130 ceph-mon[26123]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:12.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:12 smithi130 ceph-mon[26123]: [18/Jun/2024:02:08:10] ENGINE Serving on https://172.21.15.130:7151 2024-06-18T02:08:12.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:12 smithi130 ceph-mon[26123]: [18/Jun/2024:02:08:10] ENGINE Bus STARTED 2024-06-18T02:08:12.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:12 smithi130 ceph-mon[26123]: [18/Jun/2024:02:08:10] ENGINE Error in HTTPServer.serve 2024-06-18T02:08:12.044 INFO:journalctl@ceph.mon.b.smithi130.stdout: Traceback (most recent call last): 2024-06-18T02:08:12.044 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-06-18T02:08:12.044 INFO:journalctl@ceph.mon.b.smithi130.stdout: self._connections.run(self.expiration_interval) 2024-06-18T02:08:12.044 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-06-18T02:08:12.044 INFO:journalctl@ceph.mon.b.smithi130.stdout: self._run(expiration_interval) 2024-06-18T02:08:12.044 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-06-18T02:08:12.044 INFO:journalctl@ceph.mon.b.smithi130.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-06-18T02:08:12.044 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-06-18T02:08:12.044 INFO:journalctl@ceph.mon.b.smithi130.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-06-18T02:08:12.044 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-06-18T02:08:12.044 INFO:journalctl@ceph.mon.b.smithi130.stdout: s = self.context.wrap_socket( 2024-06-18T02:08:12.045 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-06-18T02:08:12.045 INFO:journalctl@ceph.mon.b.smithi130.stdout: return self.sslsocket_class._create( 2024-06-18T02:08:12.045 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-06-18T02:08:12.045 INFO:journalctl@ceph.mon.b.smithi130.stdout: self.do_handshake() 2024-06-18T02:08:12.045 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-06-18T02:08:12.045 INFO:journalctl@ceph.mon.b.smithi130.stdout: self._sslobj.do_handshake() 2024-06-18T02:08:12.045 INFO:journalctl@ceph.mon.b.smithi130.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1129) 2024-06-18T02:08:12.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:12 smithi130 ceph-mon[26123]: Updating smithi007:/etc/ceph/ceph.conf 2024-06-18T02:08:12.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:12 smithi130 ceph-mon[26123]: Updating smithi130:/etc/ceph/ceph.conf 2024-06-18T02:08:12.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:12 smithi130 ceph-mon[26123]: Updating smithi007:/var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/config/ceph.conf 2024-06-18T02:08:12.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:12 smithi130 ceph-mon[26123]: Updating smithi130:/var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/config/ceph.conf 2024-06-18T02:08:12.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:12 smithi130 ceph-mon[26123]: Updating smithi007:/etc/ceph/ceph.client.admin.keyring 2024-06-18T02:08:12.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:12 smithi130 ceph-mon[26123]: Updating smithi130:/etc/ceph/ceph.client.admin.keyring 2024-06-18T02:08:12.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:12 smithi130 ceph-mon[26123]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:12.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:12 smithi130 ceph-mon[26123]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:12.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:12 smithi130 ceph-mon[26123]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:12.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:12 smithi130 ceph-mon[26123]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:12.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:12 smithi130 ceph-mon[26123]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:12.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:12 smithi130 ceph-mon[26123]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:12.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:12 smithi130 ceph-mon[26123]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi007", "caps": []}]: dispatch 2024-06-18T02:08:12.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:12 smithi130 ceph-mon[26123]: from='mgr.25202 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi007", "caps": []}]: dispatch 2024-06-18T02:08:12.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:12 smithi130 ceph-mon[26123]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi007.xvdrwd", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-06-18T02:08:12.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:12 smithi130 ceph-mon[26123]: from='mgr.25202 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi007.xvdrwd", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-06-18T02:08:12.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:12 smithi130 ceph-mon[26123]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:08:12.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:12 smithi007 ceph-mon[25091]: [18/Jun/2024:02:08:10] ENGINE Serving on https://172.21.15.130:7151 2024-06-18T02:08:12.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:12 smithi007 ceph-mon[25091]: [18/Jun/2024:02:08:10] ENGINE Bus STARTED 2024-06-18T02:08:12.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:12 smithi007 ceph-mon[25091]: [18/Jun/2024:02:08:10] ENGINE Error in HTTPServer.serve 2024-06-18T02:08:12.303 INFO:journalctl@ceph.mon.a.smithi007.stdout: Traceback (most recent call last): 2024-06-18T02:08:12.303 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-06-18T02:08:12.303 INFO:journalctl@ceph.mon.a.smithi007.stdout: self._connections.run(self.expiration_interval) 2024-06-18T02:08:12.303 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-06-18T02:08:12.303 INFO:journalctl@ceph.mon.a.smithi007.stdout: self._run(expiration_interval) 2024-06-18T02:08:12.303 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-06-18T02:08:12.303 INFO:journalctl@ceph.mon.a.smithi007.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-06-18T02:08:12.303 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-06-18T02:08:12.303 INFO:journalctl@ceph.mon.a.smithi007.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-06-18T02:08:12.303 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-06-18T02:08:12.303 INFO:journalctl@ceph.mon.a.smithi007.stdout: s = self.context.wrap_socket( 2024-06-18T02:08:12.303 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-06-18T02:08:12.303 INFO:journalctl@ceph.mon.a.smithi007.stdout: return self.sslsocket_class._create( 2024-06-18T02:08:12.303 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-06-18T02:08:12.304 INFO:journalctl@ceph.mon.a.smithi007.stdout: self.do_handshake() 2024-06-18T02:08:12.304 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-06-18T02:08:12.304 INFO:journalctl@ceph.mon.a.smithi007.stdout: self._sslobj.do_handshake() 2024-06-18T02:08:12.304 INFO:journalctl@ceph.mon.a.smithi007.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1129) 2024-06-18T02:08:12.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:12 smithi007 ceph-mon[25091]: Updating smithi007:/etc/ceph/ceph.conf 2024-06-18T02:08:12.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:12 smithi007 ceph-mon[25091]: Updating smithi130:/etc/ceph/ceph.conf 2024-06-18T02:08:12.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:12 smithi007 ceph-mon[25091]: Updating smithi007:/var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/config/ceph.conf 2024-06-18T02:08:12.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:12 smithi007 ceph-mon[25091]: Updating smithi130:/var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/config/ceph.conf 2024-06-18T02:08:12.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:12 smithi007 ceph-mon[25091]: Updating smithi007:/etc/ceph/ceph.client.admin.keyring 2024-06-18T02:08:12.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:12 smithi007 ceph-mon[25091]: Updating smithi130:/etc/ceph/ceph.client.admin.keyring 2024-06-18T02:08:12.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:12 smithi007 ceph-mon[25091]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:12.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:12 smithi007 ceph-mon[25091]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:12.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:12 smithi007 ceph-mon[25091]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:12.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:12 smithi007 ceph-mon[25091]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:12.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:12 smithi007 ceph-mon[25091]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:12.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:12 smithi007 ceph-mon[25091]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:12.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:12 smithi007 ceph-mon[25091]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi007", "caps": []}]: dispatch 2024-06-18T02:08:12.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:12 smithi007 ceph-mon[25091]: from='mgr.25202 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi007", "caps": []}]: dispatch 2024-06-18T02:08:12.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:12 smithi007 ceph-mon[25091]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi007.xvdrwd", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-06-18T02:08:12.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:12 smithi007 ceph-mon[25091]: from='mgr.25202 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi007.xvdrwd", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-06-18T02:08:12.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:12 smithi007 ceph-mon[25091]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:08:12.305 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:12 smithi007 ceph-mon[29879]: [18/Jun/2024:02:08:10] ENGINE Serving on https://172.21.15.130:7151 2024-06-18T02:08:12.305 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:12 smithi007 ceph-mon[29879]: [18/Jun/2024:02:08:10] ENGINE Bus STARTED 2024-06-18T02:08:12.305 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:12 smithi007 ceph-mon[29879]: [18/Jun/2024:02:08:10] ENGINE Error in HTTPServer.serve 2024-06-18T02:08:12.305 INFO:journalctl@ceph.mon.c.smithi007.stdout: Traceback (most recent call last): 2024-06-18T02:08:12.306 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-06-18T02:08:12.306 INFO:journalctl@ceph.mon.c.smithi007.stdout: self._connections.run(self.expiration_interval) 2024-06-18T02:08:12.306 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-06-18T02:08:12.306 INFO:journalctl@ceph.mon.c.smithi007.stdout: self._run(expiration_interval) 2024-06-18T02:08:12.306 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-06-18T02:08:12.306 INFO:journalctl@ceph.mon.c.smithi007.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-06-18T02:08:12.306 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-06-18T02:08:12.306 INFO:journalctl@ceph.mon.c.smithi007.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-06-18T02:08:12.306 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-06-18T02:08:12.306 INFO:journalctl@ceph.mon.c.smithi007.stdout: s = self.context.wrap_socket( 2024-06-18T02:08:12.306 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-06-18T02:08:12.306 INFO:journalctl@ceph.mon.c.smithi007.stdout: return self.sslsocket_class._create( 2024-06-18T02:08:12.306 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-06-18T02:08:12.306 INFO:journalctl@ceph.mon.c.smithi007.stdout: self.do_handshake() 2024-06-18T02:08:12.307 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-06-18T02:08:12.307 INFO:journalctl@ceph.mon.c.smithi007.stdout: self._sslobj.do_handshake() 2024-06-18T02:08:12.307 INFO:journalctl@ceph.mon.c.smithi007.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1129) 2024-06-18T02:08:12.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:12 smithi007 ceph-mon[29879]: Updating smithi007:/etc/ceph/ceph.conf 2024-06-18T02:08:12.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:12 smithi007 ceph-mon[29879]: Updating smithi130:/etc/ceph/ceph.conf 2024-06-18T02:08:12.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:12 smithi007 ceph-mon[29879]: Updating smithi007:/var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/config/ceph.conf 2024-06-18T02:08:12.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:12 smithi007 ceph-mon[29879]: Updating smithi130:/var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/config/ceph.conf 2024-06-18T02:08:12.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:12 smithi007 ceph-mon[29879]: Updating smithi007:/etc/ceph/ceph.client.admin.keyring 2024-06-18T02:08:12.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:12 smithi007 ceph-mon[29879]: Updating smithi130:/etc/ceph/ceph.client.admin.keyring 2024-06-18T02:08:12.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:12 smithi007 ceph-mon[29879]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:12.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:12 smithi007 ceph-mon[29879]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:12.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:12 smithi007 ceph-mon[29879]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:12.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:12 smithi007 ceph-mon[29879]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:12.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:12 smithi007 ceph-mon[29879]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:12.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:12 smithi007 ceph-mon[29879]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:12.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:12 smithi007 ceph-mon[29879]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi007", "caps": []}]: dispatch 2024-06-18T02:08:12.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:12 smithi007 ceph-mon[29879]: from='mgr.25202 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi007", "caps": []}]: dispatch 2024-06-18T02:08:12.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:12 smithi007 ceph-mon[29879]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi007.xvdrwd", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-06-18T02:08:12.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:12 smithi007 ceph-mon[29879]: from='mgr.25202 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi007.xvdrwd", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-06-18T02:08:12.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:12 smithi007 ceph-mon[29879]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:08:13.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:13 smithi007 ceph-mon[25091]: Updating smithi007:/var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/config/ceph.client.admin.keyring 2024-06-18T02:08:13.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:13 smithi007 ceph-mon[25091]: Updating smithi130:/var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/config/ceph.client.admin.keyring 2024-06-18T02:08:13.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:13 smithi007 ceph-mon[25091]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:08:13.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:13 smithi007 ceph-mon[25091]: Reconfiguring iscsi.foo.smithi007.xvdrwd (dependencies changed)... 2024-06-18T02:08:13.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:13 smithi007 ceph-mon[25091]: Reconfiguring daemon iscsi.foo.smithi007.xvdrwd on smithi007 2024-06-18T02:08:13.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:13 smithi007 ceph-mon[25091]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:08:13.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:13 smithi007 ceph-mon[25091]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:13.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:13 smithi007 ceph-mon[25091]: mgrmap e37: x(active, since 4s), standbys: y 2024-06-18T02:08:13.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:13 smithi007 ceph-mon[25091]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:13.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:13 smithi007 ceph-mon[25091]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:13.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:13 smithi007 ceph-mon[25091]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:13.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:13 smithi007 ceph-mon[25091]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:13.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:13 smithi007 ceph-mon[25091]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:13.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:13 smithi007 ceph-mon[25091]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:13.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:13 smithi007 ceph-mon[29879]: Updating smithi007:/var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/config/ceph.client.admin.keyring 2024-06-18T02:08:13.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:13 smithi007 ceph-mon[29879]: Updating smithi130:/var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/config/ceph.client.admin.keyring 2024-06-18T02:08:13.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:13 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:08:13.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:13 smithi007 ceph-mon[29879]: Reconfiguring iscsi.foo.smithi007.xvdrwd (dependencies changed)... 2024-06-18T02:08:13.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:13 smithi007 ceph-mon[29879]: Reconfiguring daemon iscsi.foo.smithi007.xvdrwd on smithi007 2024-06-18T02:08:13.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:13 smithi007 ceph-mon[29879]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:08:13.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:13 smithi007 ceph-mon[29879]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:13.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:13 smithi007 ceph-mon[29879]: mgrmap e37: x(active, since 4s), standbys: y 2024-06-18T02:08:13.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:13 smithi007 ceph-mon[29879]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:13.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:13 smithi007 ceph-mon[29879]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:13.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:13 smithi007 ceph-mon[29879]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:13.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:13 smithi007 ceph-mon[29879]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:13.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:13 smithi007 ceph-mon[29879]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:13.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:13 smithi007 ceph-mon[29879]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:13.199 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:13 smithi130 ceph-mon[26123]: Updating smithi007:/var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/config/ceph.client.admin.keyring 2024-06-18T02:08:13.199 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:13 smithi130 ceph-mon[26123]: Updating smithi130:/var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/config/ceph.client.admin.keyring 2024-06-18T02:08:13.199 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:13 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:08:13.199 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:13 smithi130 ceph-mon[26123]: Reconfiguring iscsi.foo.smithi007.xvdrwd (dependencies changed)... 2024-06-18T02:08:13.199 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:13 smithi130 ceph-mon[26123]: Reconfiguring daemon iscsi.foo.smithi007.xvdrwd on smithi007 2024-06-18T02:08:13.199 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:13 smithi130 ceph-mon[26123]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:08:13.200 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:13 smithi130 ceph-mon[26123]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:13.200 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:13 smithi130 ceph-mon[26123]: mgrmap e37: x(active, since 4s), standbys: y 2024-06-18T02:08:13.200 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:13 smithi130 ceph-mon[26123]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:13.200 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:13 smithi130 ceph-mon[26123]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:13.200 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:13 smithi130 ceph-mon[26123]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:13.200 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:13 smithi130 ceph-mon[26123]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:13.200 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:13 smithi130 ceph-mon[26123]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:13.200 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:13 smithi130 ceph-mon[26123]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:13.793 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:13 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[59059]: ts=2024-06-18T02:08:13.504Z caller=manager.go:609 level=warn component="rule manager" group=nodes msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on(instance) group_left(nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi007\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"cd9a3408-2d15-11ef-bc9d-c7b262605968\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-06-18T02:08:14.383 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:14 smithi130 ceph-mon[26123]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:14.383 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:14 smithi130 ceph-mon[26123]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:14.383 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:14 smithi130 ceph-mon[26123]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:14.383 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:14 smithi130 ceph-mon[26123]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:08:14.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:14 smithi007 ceph-mon[29879]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:14.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:14 smithi007 ceph-mon[29879]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:14.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:14 smithi007 ceph-mon[29879]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:14.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:14 smithi007 ceph-mon[29879]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:08:14.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:14 smithi007 ceph-mon[25091]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:14.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:14 smithi007 ceph-mon[25091]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:14.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:14 smithi007 ceph-mon[25091]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:14.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:14 smithi007 ceph-mon[25091]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:08:16.820 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:16 smithi007 ceph-mon[25091]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-06-18T02:08:16.820 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:16 smithi007 ceph-mon[29879]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-06-18T02:08:17.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:16 smithi130 ceph-mon[26123]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-06-18T02:08:17.544 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:17.191+0000 7f4197ab6640 -1 log_channel(cephadm) log [ERR] : cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi007.xvdrwd ... 2024-06-18T02:08:17.544 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: Creating ceph-iscsi config... 2024-06-18T02:08:17.544 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/iscsi-gateway.cfg 2024-06-18T02:08:17.544 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/tcmu-runner-entrypoint.sh 2024-06-18T02:08:17.544 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: Non-zero exit code 1 from systemctl restart ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd 2024-06-18T02:08:17.544 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: systemctl: stderr Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:08:17.544 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: systemctl: stderr See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:08:17.545 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: Traceback (most recent call last): 2024-06-18T02:08:17.545 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-06-18T02:08:17.545 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: return _run_code(code, main_globals, None, 2024-06-18T02:08:17.545 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-06-18T02:08:17.545 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: exec(code, run_globals) 2024-06-18T02:08:17.545 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5618, in 2024-06-18T02:08:17.545 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5606, in main 2024-06-18T02:08:17.545 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3096, in command_deploy_from 2024-06-18T02:08:17.545 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3131, in _common_deploy 2024-06-18T02:08:17.545 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3151, in _deploy_daemon_container 2024-06-18T02:08:17.545 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 1123, in deploy_daemon 2024-06-18T02:08:17.545 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/tmp/tmp3vdsh41i.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-06-18T02:08:17.545 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: RuntimeError: Failed command: systemctl restart ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd: Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:08:17.546 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:08:17.546 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: Traceback (most recent call last): 2024-06-18T02:08:17.546 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-06-18T02:08:17.546 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: self.mgr._daemon_action(daemon_spec, action=action) 2024-06-18T02:08:17.546 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/usr/share/ceph/mgr/cephadm/module.py", line 2456, in _daemon_action 2024-06-18T02:08:17.546 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: return self.wait_async( 2024-06-18T02:08:17.546 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/usr/share/ceph/mgr/cephadm/module.py", line 779, in wait_async 2024-06-18T02:08:17.547 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: return self.event_loop.get_result(coro, timeout) 2024-06-18T02:08:17.547 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-06-18T02:08:17.547 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: return future.result(timeout) 2024-06-18T02:08:17.547 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/lib64/python3.9/concurrent/futures/_base.py", line 446, in result 2024-06-18T02:08:17.547 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: return self.__get_result() 2024-06-18T02:08:17.547 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/lib64/python3.9/concurrent/futures/_base.py", line 391, in __get_result 2024-06-18T02:08:17.547 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: raise self._exception 2024-06-18T02:08:17.547 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1350, in _create_daemon 2024-06-18T02:08:17.547 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: out, err, code = await self._run_cephadm( 2024-06-18T02:08:17.547 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1691, in _run_cephadm 2024-06-18T02:08:17.547 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: raise OrchestratorError( 2024-06-18T02:08:17.547 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi007.xvdrwd ... 2024-06-18T02:08:17.547 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: Creating ceph-iscsi config... 2024-06-18T02:08:17.548 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/iscsi-gateway.cfg 2024-06-18T02:08:17.548 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/tcmu-runner-entrypoint.sh 2024-06-18T02:08:17.548 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: Non-zero exit code 1 from systemctl restart ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd 2024-06-18T02:08:17.548 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: systemctl: stderr Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:08:17.548 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: systemctl: stderr See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:08:17.548 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: Traceback (most recent call last): 2024-06-18T02:08:17.549 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-06-18T02:08:17.549 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: return _run_code(code, main_globals, None, 2024-06-18T02:08:17.549 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-06-18T02:08:17.549 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: exec(code, run_globals) 2024-06-18T02:08:17.549 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5618, in 2024-06-18T02:08:17.549 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5606, in main 2024-06-18T02:08:17.550 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3096, in command_deploy_from 2024-06-18T02:08:17.550 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3131, in _common_deploy 2024-06-18T02:08:17.550 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3151, in _deploy_daemon_container 2024-06-18T02:08:17.550 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 1123, in deploy_daemon 2024-06-18T02:08:17.550 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/tmp/tmp3vdsh41i.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-06-18T02:08:17.550 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: RuntimeError: Failed command: systemctl restart ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd: Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:08:17.550 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:08:18.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:18 smithi007 ceph-mon[25091]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi007.xvdrwd ... 2024-06-18T02:08:18.432 INFO:journalctl@ceph.mon.a.smithi007.stdout: Creating ceph-iscsi config... 2024-06-18T02:08:18.432 INFO:journalctl@ceph.mon.a.smithi007.stdout: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/iscsi-gateway.cfg 2024-06-18T02:08:18.432 INFO:journalctl@ceph.mon.a.smithi007.stdout: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/tcmu-runner-entrypoint.sh 2024-06-18T02:08:18.433 INFO:journalctl@ceph.mon.a.smithi007.stdout: Non-zero exit code 1 from systemctl restart ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd 2024-06-18T02:08:18.433 INFO:journalctl@ceph.mon.a.smithi007.stdout: systemctl: stderr Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:08:18.433 INFO:journalctl@ceph.mon.a.smithi007.stdout: systemctl: stderr See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:08:18.433 INFO:journalctl@ceph.mon.a.smithi007.stdout: Traceback (most recent call last): 2024-06-18T02:08:18.433 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-06-18T02:08:18.433 INFO:journalctl@ceph.mon.a.smithi007.stdout: return _run_code(code, main_globals, None, 2024-06-18T02:08:18.433 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-06-18T02:08:18.433 INFO:journalctl@ceph.mon.a.smithi007.stdout: exec(code, run_globals) 2024-06-18T02:08:18.433 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5618, in 2024-06-18T02:08:18.433 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5606, in main 2024-06-18T02:08:18.433 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3096, in command_deploy_from 2024-06-18T02:08:18.433 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3131, in _common_deploy 2024-06-18T02:08:18.434 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3151, in _deploy_daemon_container 2024-06-18T02:08:18.434 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 1123, in deploy_daemon 2024-06-18T02:08:18.434 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-06-18T02:08:18.434 INFO:journalctl@ceph.mon.a.smithi007.stdout: RuntimeError: Failed command: systemctl restart ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd: Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:08:18.434 INFO:journalctl@ceph.mon.a.smithi007.stdout: See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:08:18.434 INFO:journalctl@ceph.mon.a.smithi007.stdout: Traceback (most recent call last): 2024-06-18T02:08:18.434 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-06-18T02:08:18.434 INFO:journalctl@ceph.mon.a.smithi007.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-06-18T02:08:18.434 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2456, in _daemon_action 2024-06-18T02:08:18.434 INFO:journalctl@ceph.mon.a.smithi007.stdout: return self.wait_async( 2024-06-18T02:08:18.434 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 779, in wait_async 2024-06-18T02:08:18.434 INFO:journalctl@ceph.mon.a.smithi007.stdout: return self.event_loop.get_result(coro, timeout) 2024-06-18T02:08:18.434 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-06-18T02:08:18.435 INFO:journalctl@ceph.mon.a.smithi007.stdout: return future.result(timeout) 2024-06-18T02:08:18.435 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib64/python3.9/concurrent/futures/_base.py", line 446, in result 2024-06-18T02:08:18.435 INFO:journalctl@ceph.mon.a.smithi007.stdout: return self.__get_result() 2024-06-18T02:08:18.435 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib64/python3.9/concurrent/futures/_base.py", line 391, in __get_result 2024-06-18T02:08:18.435 INFO:journalctl@ceph.mon.a.smithi007.stdout: raise self._exception 2024-06-18T02:08:18.435 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1350, in _create_daemon 2024-06-18T02:08:18.435 INFO:journalctl@ceph.mon.a.smithi007.stdout: out, err, code = await self._run_cephadm( 2024-06-18T02:08:18.435 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1691, in _run_cephadm 2024-06-18T02:08:18.435 INFO:journalctl@ceph.mon.a.smithi007.stdout: raise OrchestratorError( 2024-06-18T02:08:18.435 INFO:journalctl@ceph.mon.a.smithi007.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi007.xvdrwd ... 2024-06-18T02:08:18.435 INFO:journalctl@ceph.mon.a.smithi007.stdout: Creating ceph-iscsi config... 2024-06-18T02:08:18.435 INFO:journalctl@ceph.mon.a.smithi007.stdout: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/iscsi-gateway.cfg 2024-06-18T02:08:18.435 INFO:journalctl@ceph.mon.a.smithi007.stdout: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/tcmu-runner-entrypoint.sh 2024-06-18T02:08:18.435 INFO:journalctl@ceph.mon.a.smithi007.stdout: Non-zero exit code 1 from systemctl restart ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd 2024-06-18T02:08:18.436 INFO:journalctl@ceph.mon.a.smithi007.stdout: systemctl: stderr Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:08:18.436 INFO:journalctl@ceph.mon.a.smithi007.stdout: systemctl: stderr See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:08:18.436 INFO:journalctl@ceph.mon.a.smithi007.stdout: Traceback (most recent call last): 2024-06-18T02:08:18.436 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-06-18T02:08:18.436 INFO:journalctl@ceph.mon.a.smithi007.stdout: return _run_code(code, main_globals, None, 2024-06-18T02:08:18.436 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-06-18T02:08:18.436 INFO:journalctl@ceph.mon.a.smithi007.stdout: exec(code, run_globals) 2024-06-18T02:08:18.436 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5618, in 2024-06-18T02:08:18.436 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5606, in main 2024-06-18T02:08:18.436 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3096, in command_deploy_from 2024-06-18T02:08:18.436 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3131, in _common_deploy 2024-06-18T02:08:18.436 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3151, in _deploy_daemon_container 2024-06-18T02:08:18.436 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 1123, in deploy_daemon 2024-06-18T02:08:18.436 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-06-18T02:08:18.437 INFO:journalctl@ceph.mon.a.smithi007.stdout: RuntimeError: Failed command: systemctl restart ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd: Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:08:18.437 INFO:journalctl@ceph.mon.a.smithi007.stdout: See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:08:18.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:18 smithi007 ceph-mon[25091]: Reconfiguring prometheus.a (dependencies changed)... 2024-06-18T02:08:18.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:18 smithi007 ceph-mon[25091]: Reconfiguring daemon prometheus.a on smithi130 2024-06-18T02:08:18.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:18 smithi007 ceph-mon[25091]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 24 KiB/s rd, 0 B/s wr, 13 op/s 2024-06-18T02:08:18.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:18 smithi007 ceph-mon[29879]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi007.xvdrwd ... 2024-06-18T02:08:18.437 INFO:journalctl@ceph.mon.c.smithi007.stdout: Creating ceph-iscsi config... 2024-06-18T02:08:18.437 INFO:journalctl@ceph.mon.c.smithi007.stdout: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/iscsi-gateway.cfg 2024-06-18T02:08:18.437 INFO:journalctl@ceph.mon.c.smithi007.stdout: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/tcmu-runner-entrypoint.sh 2024-06-18T02:08:18.437 INFO:journalctl@ceph.mon.c.smithi007.stdout: Non-zero exit code 1 from systemctl restart ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd 2024-06-18T02:08:18.438 INFO:journalctl@ceph.mon.c.smithi007.stdout: systemctl: stderr Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:08:18.438 INFO:journalctl@ceph.mon.c.smithi007.stdout: systemctl: stderr See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:08:18.438 INFO:journalctl@ceph.mon.c.smithi007.stdout: Traceback (most recent call last): 2024-06-18T02:08:18.438 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-06-18T02:08:18.438 INFO:journalctl@ceph.mon.c.smithi007.stdout: return _run_code(code, main_globals, None, 2024-06-18T02:08:18.438 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-06-18T02:08:18.438 INFO:journalctl@ceph.mon.c.smithi007.stdout: exec(code, run_globals) 2024-06-18T02:08:18.438 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5618, in 2024-06-18T02:08:18.439 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5606, in main 2024-06-18T02:08:18.439 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3096, in command_deploy_from 2024-06-18T02:08:18.439 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3131, in _common_deploy 2024-06-18T02:08:18.439 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3151, in _deploy_daemon_container 2024-06-18T02:08:18.439 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 1123, in deploy_daemon 2024-06-18T02:08:18.439 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-06-18T02:08:18.439 INFO:journalctl@ceph.mon.c.smithi007.stdout: RuntimeError: Failed command: systemctl restart ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd: Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:08:18.439 INFO:journalctl@ceph.mon.c.smithi007.stdout: See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:08:18.439 INFO:journalctl@ceph.mon.c.smithi007.stdout: Traceback (most recent call last): 2024-06-18T02:08:18.439 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-06-18T02:08:18.439 INFO:journalctl@ceph.mon.c.smithi007.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-06-18T02:08:18.439 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2456, in _daemon_action 2024-06-18T02:08:18.440 INFO:journalctl@ceph.mon.c.smithi007.stdout: return self.wait_async( 2024-06-18T02:08:18.440 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 779, in wait_async 2024-06-18T02:08:18.440 INFO:journalctl@ceph.mon.c.smithi007.stdout: return self.event_loop.get_result(coro, timeout) 2024-06-18T02:08:18.440 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-06-18T02:08:18.440 INFO:journalctl@ceph.mon.c.smithi007.stdout: return future.result(timeout) 2024-06-18T02:08:18.440 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/lib64/python3.9/concurrent/futures/_base.py", line 446, in result 2024-06-18T02:08:18.440 INFO:journalctl@ceph.mon.c.smithi007.stdout: return self.__get_result() 2024-06-18T02:08:18.440 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/lib64/python3.9/concurrent/futures/_base.py", line 391, in __get_result 2024-06-18T02:08:18.440 INFO:journalctl@ceph.mon.c.smithi007.stdout: raise self._exception 2024-06-18T02:08:18.440 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1350, in _create_daemon 2024-06-18T02:08:18.440 INFO:journalctl@ceph.mon.c.smithi007.stdout: out, err, code = await self._run_cephadm( 2024-06-18T02:08:18.440 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1691, in _run_cephadm 2024-06-18T02:08:18.440 INFO:journalctl@ceph.mon.c.smithi007.stdout: raise OrchestratorError( 2024-06-18T02:08:18.440 INFO:journalctl@ceph.mon.c.smithi007.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi007.xvdrwd ... 2024-06-18T02:08:18.441 INFO:journalctl@ceph.mon.c.smithi007.stdout: Creating ceph-iscsi config... 2024-06-18T02:08:18.441 INFO:journalctl@ceph.mon.c.smithi007.stdout: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/iscsi-gateway.cfg 2024-06-18T02:08:18.441 INFO:journalctl@ceph.mon.c.smithi007.stdout: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/tcmu-runner-entrypoint.sh 2024-06-18T02:08:18.441 INFO:journalctl@ceph.mon.c.smithi007.stdout: Non-zero exit code 1 from systemctl restart ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd 2024-06-18T02:08:18.441 INFO:journalctl@ceph.mon.c.smithi007.stdout: systemctl: stderr Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:08:18.441 INFO:journalctl@ceph.mon.c.smithi007.stdout: systemctl: stderr See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:08:18.441 INFO:journalctl@ceph.mon.c.smithi007.stdout: Traceback (most recent call last): 2024-06-18T02:08:18.441 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-06-18T02:08:18.441 INFO:journalctl@ceph.mon.c.smithi007.stdout: return _run_code(code, main_globals, None, 2024-06-18T02:08:18.441 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-06-18T02:08:18.441 INFO:journalctl@ceph.mon.c.smithi007.stdout: exec(code, run_globals) 2024-06-18T02:08:18.441 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5618, in 2024-06-18T02:08:18.441 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5606, in main 2024-06-18T02:08:18.441 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3096, in command_deploy_from 2024-06-18T02:08:18.442 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3131, in _common_deploy 2024-06-18T02:08:18.442 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3151, in _deploy_daemon_container 2024-06-18T02:08:18.442 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 1123, in deploy_daemon 2024-06-18T02:08:18.442 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-06-18T02:08:18.442 INFO:journalctl@ceph.mon.c.smithi007.stdout: RuntimeError: Failed command: systemctl restart ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd: Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:08:18.442 INFO:journalctl@ceph.mon.c.smithi007.stdout: See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:08:18.442 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:18 smithi007 ceph-mon[29879]: Reconfiguring prometheus.a (dependencies changed)... 2024-06-18T02:08:18.442 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:18 smithi007 ceph-mon[29879]: Reconfiguring daemon prometheus.a on smithi130 2024-06-18T02:08:18.442 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:18 smithi007 ceph-mon[29879]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 24 KiB/s rd, 0 B/s wr, 13 op/s 2024-06-18T02:08:18.448 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:18 smithi130 ceph-mon[26123]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi007.xvdrwd ... 2024-06-18T02:08:18.448 INFO:journalctl@ceph.mon.b.smithi130.stdout: Creating ceph-iscsi config... 2024-06-18T02:08:18.448 INFO:journalctl@ceph.mon.b.smithi130.stdout: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/iscsi-gateway.cfg 2024-06-18T02:08:18.448 INFO:journalctl@ceph.mon.b.smithi130.stdout: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/tcmu-runner-entrypoint.sh 2024-06-18T02:08:18.449 INFO:journalctl@ceph.mon.b.smithi130.stdout: Non-zero exit code 1 from systemctl restart ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd 2024-06-18T02:08:18.449 INFO:journalctl@ceph.mon.b.smithi130.stdout: systemctl: stderr Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:08:18.449 INFO:journalctl@ceph.mon.b.smithi130.stdout: systemctl: stderr See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:08:18.449 INFO:journalctl@ceph.mon.b.smithi130.stdout: Traceback (most recent call last): 2024-06-18T02:08:18.449 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-06-18T02:08:18.449 INFO:journalctl@ceph.mon.b.smithi130.stdout: return _run_code(code, main_globals, None, 2024-06-18T02:08:18.449 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-06-18T02:08:18.449 INFO:journalctl@ceph.mon.b.smithi130.stdout: exec(code, run_globals) 2024-06-18T02:08:18.449 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5618, in 2024-06-18T02:08:18.449 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5606, in main 2024-06-18T02:08:18.450 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3096, in command_deploy_from 2024-06-18T02:08:18.450 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3131, in _common_deploy 2024-06-18T02:08:18.450 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3151, in _deploy_daemon_container 2024-06-18T02:08:18.450 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 1123, in deploy_daemon 2024-06-18T02:08:18.450 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-06-18T02:08:18.450 INFO:journalctl@ceph.mon.b.smithi130.stdout: RuntimeError: Failed command: systemctl restart ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd: Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:08:18.450 INFO:journalctl@ceph.mon.b.smithi130.stdout: See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:08:18.450 INFO:journalctl@ceph.mon.b.smithi130.stdout: Traceback (most recent call last): 2024-06-18T02:08:18.450 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-06-18T02:08:18.450 INFO:journalctl@ceph.mon.b.smithi130.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-06-18T02:08:18.450 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2456, in _daemon_action 2024-06-18T02:08:18.450 INFO:journalctl@ceph.mon.b.smithi130.stdout: return self.wait_async( 2024-06-18T02:08:18.450 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 779, in wait_async 2024-06-18T02:08:18.451 INFO:journalctl@ceph.mon.b.smithi130.stdout: return self.event_loop.get_result(coro, timeout) 2024-06-18T02:08:18.451 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-06-18T02:08:18.451 INFO:journalctl@ceph.mon.b.smithi130.stdout: return future.result(timeout) 2024-06-18T02:08:18.451 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/lib64/python3.9/concurrent/futures/_base.py", line 446, in result 2024-06-18T02:08:18.451 INFO:journalctl@ceph.mon.b.smithi130.stdout: return self.__get_result() 2024-06-18T02:08:18.451 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/lib64/python3.9/concurrent/futures/_base.py", line 391, in __get_result 2024-06-18T02:08:18.451 INFO:journalctl@ceph.mon.b.smithi130.stdout: raise self._exception 2024-06-18T02:08:18.451 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1350, in _create_daemon 2024-06-18T02:08:18.451 INFO:journalctl@ceph.mon.b.smithi130.stdout: out, err, code = await self._run_cephadm( 2024-06-18T02:08:18.451 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1691, in _run_cephadm 2024-06-18T02:08:18.451 INFO:journalctl@ceph.mon.b.smithi130.stdout: raise OrchestratorError( 2024-06-18T02:08:18.451 INFO:journalctl@ceph.mon.b.smithi130.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi007.xvdrwd ... 2024-06-18T02:08:18.451 INFO:journalctl@ceph.mon.b.smithi130.stdout: Creating ceph-iscsi config... 2024-06-18T02:08:18.452 INFO:journalctl@ceph.mon.b.smithi130.stdout: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/iscsi-gateway.cfg 2024-06-18T02:08:18.452 INFO:journalctl@ceph.mon.b.smithi130.stdout: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/tcmu-runner-entrypoint.sh 2024-06-18T02:08:18.452 INFO:journalctl@ceph.mon.b.smithi130.stdout: Non-zero exit code 1 from systemctl restart ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd 2024-06-18T02:08:18.452 INFO:journalctl@ceph.mon.b.smithi130.stdout: systemctl: stderr Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:08:18.452 INFO:journalctl@ceph.mon.b.smithi130.stdout: systemctl: stderr See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:08:18.452 INFO:journalctl@ceph.mon.b.smithi130.stdout: Traceback (most recent call last): 2024-06-18T02:08:18.452 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-06-18T02:08:18.452 INFO:journalctl@ceph.mon.b.smithi130.stdout: return _run_code(code, main_globals, None, 2024-06-18T02:08:18.452 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-06-18T02:08:18.452 INFO:journalctl@ceph.mon.b.smithi130.stdout: exec(code, run_globals) 2024-06-18T02:08:18.452 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5618, in 2024-06-18T02:08:18.453 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5606, in main 2024-06-18T02:08:18.453 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3096, in command_deploy_from 2024-06-18T02:08:18.453 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3131, in _common_deploy 2024-06-18T02:08:18.453 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3151, in _deploy_daemon_container 2024-06-18T02:08:18.453 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 1123, in deploy_daemon 2024-06-18T02:08:18.453 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-06-18T02:08:18.453 INFO:journalctl@ceph.mon.b.smithi130.stdout: RuntimeError: Failed command: systemctl restart ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd: Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:08:18.453 INFO:journalctl@ceph.mon.b.smithi130.stdout: See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:08:18.453 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:18 smithi130 ceph-mon[26123]: Reconfiguring prometheus.a (dependencies changed)... 2024-06-18T02:08:18.453 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:18 smithi130 ceph-mon[26123]: Reconfiguring daemon prometheus.a on smithi130 2024-06-18T02:08:18.453 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:18 smithi130 ceph-mon[26123]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 24 KiB/s rd, 0 B/s wr, 13 op/s 2024-06-18T02:08:19.431 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:19 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:08:19] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-06-18T02:08:19.997 INFO:teuthology.orchestra.run.smithi007.stdout:true 2024-06-18T02:08:20.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:20 smithi130 ceph-mon[26123]: from='client.25339 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:08:20.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:20 smithi130 ceph-mon[26123]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 19 KiB/s rd, 0 B/s wr, 11 op/s 2024-06-18T02:08:20.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:20 smithi007 ceph-mon[25091]: from='client.25339 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:08:20.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:20 smithi007 ceph-mon[25091]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 19 KiB/s rd, 0 B/s wr, 11 op/s 2024-06-18T02:08:20.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:20 smithi007 ceph-mon[29879]: from='client.25339 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:08:20.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:20 smithi007 ceph-mon[29879]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 19 KiB/s rd, 0 B/s wr, 11 op/s 2024-06-18T02:08:20.692 INFO:teuthology.orchestra.run.smithi007.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-18T02:08:20.692 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi007 smithi007 running 7s ago 11m - - 2024-06-18T02:08:20.692 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi130 smithi130 running 26s ago 11m - - 2024-06-18T02:08:20.693 INFO:teuthology.orchestra.run.smithi007.stdout:alertmanager.a smithi007 *:9093,9094 running (74s) 7s ago 6m 15.0M - 0.23.0 ba2b418f427c 5994e8525c64 2024-06-18T02:08:20.693 INFO:teuthology.orchestra.run.smithi007.stdout:grafana.a smithi130 *:3000 running (51s) 26s ago 5m 40.6M - 8.3.5 dad864ee21e9 70ba81d97c8e 2024-06-18T02:08:20.693 INFO:teuthology.orchestra.run.smithi007.stdout:iscsi.foo.smithi007.xvdrwd smithi007 running (24s) 7s ago 4m 52.5M - 3.5 e1d6a67b021e f0d6ad2febf4 2024-06-18T02:08:20.693 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.x smithi130 *:8443,9283,8765 starting - - - - 2024-06-18T02:08:20.693 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.y smithi007 *:8443,9283,8765 running (45s) 7s ago 12m 437M - 19.0.0-3124-g3781e3a5 af93c036e016 820dafc9907d 2024-06-18T02:08:20.693 INFO:teuthology.orchestra.run.smithi007.stdout:mon.a smithi007 running (12m) 7s ago 12m 62.3M 2048M 17.2.0 e1d6a67b021e 147f3ea02ae3 2024-06-18T02:08:20.693 INFO:teuthology.orchestra.run.smithi007.stdout:mon.b smithi130 running (11m) 26s ago 11m 54.5M 2048M 17.2.0 e1d6a67b021e a0b38a9a595f 2024-06-18T02:08:20.693 INFO:teuthology.orchestra.run.smithi007.stdout:mon.c smithi007 running (11m) 7s ago 11m 53.2M 2048M 17.2.0 e1d6a67b021e 1d1e2628656b 2024-06-18T02:08:20.693 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.a smithi007 *:9100 running (82s) 7s ago 6m 8312k - 1.3.1 1dbe0e931976 8128e558f099 2024-06-18T02:08:20.693 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.b smithi130 *:9100 running (55s) 26s ago 6m 9273k - 1.3.1 1dbe0e931976 bab93b43cf16 2024-06-18T02:08:20.693 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0 smithi007 running (10m) 7s ago 10m 53.5M 4096M 17.2.0 e1d6a67b021e 1ef6e23afd55 2024-06-18T02:08:20.693 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1 smithi007 running (10m) 7s ago 10m 55.1M 4096M 17.2.0 e1d6a67b021e a967706523cb 2024-06-18T02:08:20.693 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2 smithi007 running (9m) 7s ago 9m 49.3M 4096M 17.2.0 e1d6a67b021e 2c1b76bd0876 2024-06-18T02:08:20.693 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3 smithi007 running (9m) 7s ago 9m 53.6M 4096M 17.2.0 e1d6a67b021e 8b91b2a07564 2024-06-18T02:08:20.693 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4 smithi130 running (8m) 26s ago 8m 55.6M 4096M 17.2.0 e1d6a67b021e c428dccffdf0 2024-06-18T02:08:20.694 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5 smithi130 running (8m) 26s ago 8m 54.2M 4096M 17.2.0 e1d6a67b021e f645d7f12378 2024-06-18T02:08:20.694 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6 smithi130 running (8m) 26s ago 8m 48.7M 4096M 17.2.0 e1d6a67b021e c7af86c14959 2024-06-18T02:08:20.694 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7 smithi130 running (7m) 26s ago 7m 52.4M 4096M 17.2.0 e1d6a67b021e 3688af8b2c46 2024-06-18T02:08:20.694 INFO:teuthology.orchestra.run.smithi007.stdout:prometheus.a smithi130 *:9095 starting - - - - 2024-06-18T02:08:20.694 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi007.dvbvbk smithi007 *:8000 running (5m) 7s ago 5m 75.2M - 17.2.0 e1d6a67b021e 1344b55b763c 2024-06-18T02:08:20.694 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi130.aakmof smithi130 *:8000 running (5m) 26s ago 5m 73.1M - 17.2.0 e1d6a67b021e e257e3230c6c 2024-06-18T02:08:20.694 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi007.hgrnmk smithi007 *:80 running (4m) 7s ago 4m 73.6M - 17.2.0 e1d6a67b021e 2173947bc4d6 2024-06-18T02:08:20.694 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi130.wwebfk smithi130 *:80 running (4m) 26s ago 4m 74.9M - 17.2.0 e1d6a67b021e 8662706b2231 2024-06-18T02:08:21.123 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:08:21.124 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": { 2024-06-18T02:08:21.124 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-06-18T02:08:21.124 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:08:21.124 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": { 2024-06-18T02:08:21.124 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 2 2024-06-18T02:08:21.124 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:08:21.124 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": { 2024-06-18T02:08:21.124 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-06-18T02:08:21.124 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:08:21.124 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": {}, 2024-06-18T02:08:21.124 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw": { 2024-06-18T02:08:21.124 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-06-18T02:08:21.124 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:08:21.125 INFO:teuthology.orchestra.run.smithi007.stdout: "overall": { 2024-06-18T02:08:21.125 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 15, 2024-06-18T02:08:21.125 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 2 2024-06-18T02:08:21.125 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-06-18T02:08:21.125 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:08:21.493 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:08:21.494 INFO:teuthology.orchestra.run.smithi007.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00", 2024-06-18T02:08:21.494 INFO:teuthology.orchestra.run.smithi007.stdout: "in_progress": true, 2024-06-18T02:08:21.494 INFO:teuthology.orchestra.run.smithi007.stdout: "which": "Upgrading all daemon types on all hosts", 2024-06-18T02:08:21.494 INFO:teuthology.orchestra.run.smithi007.stdout: "services_complete": [], 2024-06-18T02:08:21.494 INFO:teuthology.orchestra.run.smithi007.stdout: "progress": "", 2024-06-18T02:08:21.494 INFO:teuthology.orchestra.run.smithi007.stdout: "message": "", 2024-06-18T02:08:21.494 INFO:teuthology.orchestra.run.smithi007.stdout: "is_paused": false 2024-06-18T02:08:21.494 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:08:21.940 INFO:teuthology.orchestra.run.smithi007.stdout:HEALTH_OK 2024-06-18T02:08:22.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:21 smithi007 ceph-mon[25091]: from='client.15438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:08:22.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:21 smithi007 ceph-mon[25091]: from='client.15444 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:08:22.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:21 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/4067515527' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:08:22.041 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:21 smithi007 ceph-mon[29879]: from='client.15438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:08:22.041 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:21 smithi007 ceph-mon[29879]: from='client.15444 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:08:22.041 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:21 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/4067515527' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:08:22.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:21 smithi130 ceph-mon[26123]: from='client.15438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:08:22.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:21 smithi130 ceph-mon[26123]: from='client.15444 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:08:22.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:21 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/4067515527' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:08:23.023 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:22 smithi007 ceph-mon[25091]: from='client.25363 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:08:23.023 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:22 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/2891743824' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:08:23.024 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:22 smithi007 ceph-mon[25091]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-06-18T02:08:23.024 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:22 smithi007 ceph-mon[29879]: from='client.25363 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:08:23.024 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:22 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/2891743824' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:08:23.024 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:22 smithi007 ceph-mon[29879]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-06-18T02:08:23.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:22 smithi130 ceph-mon[26123]: from='client.25363 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:08:23.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:22 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/2891743824' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:08:23.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:22 smithi130 ceph-mon[26123]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-06-18T02:08:23.793 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:23 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[59059]: ts=2024-06-18T02:08:23.504Z caller=manager.go:609 level=warn component="rule manager" group=nodes msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on(instance) group_left(nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi007\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"cd9a3408-2d15-11ef-bc9d-c7b262605968\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-06-18T02:08:24.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:24 smithi007 ceph-mon[25091]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:24.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:24 smithi007 ceph-mon[25091]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:08:24.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:24 smithi007 ceph-mon[25091]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-06-18T02:08:24.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:24 smithi007 ceph-mon[29879]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:24.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:24 smithi007 ceph-mon[29879]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:08:24.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:24 smithi007 ceph-mon[29879]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-06-18T02:08:24.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:24 smithi130 ceph-mon[26123]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:24.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:24 smithi130 ceph-mon[26123]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:08:24.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:24 smithi130 ceph-mon[26123]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-06-18T02:08:25.482 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:25 smithi130 ceph-mon[26123]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:25.482 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:25 smithi130 ceph-mon[26123]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:25.482 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:25 smithi130 ceph-mon[26123]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 0 B/s wr, 12 op/s 2024-06-18T02:08:25.483 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:25 smithi130 ceph-mon[26123]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:25.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:25 smithi007 ceph-mon[25091]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:25.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:25 smithi007 ceph-mon[25091]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:25.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:25 smithi007 ceph-mon[25091]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 0 B/s wr, 12 op/s 2024-06-18T02:08:25.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:25 smithi007 ceph-mon[25091]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:25.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:25 smithi007 ceph-mon[29879]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:25.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:25 smithi007 ceph-mon[29879]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:25.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:25 smithi007 ceph-mon[29879]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 0 B/s wr, 12 op/s 2024-06-18T02:08:25.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:25 smithi007 ceph-mon[29879]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:26.485 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:26 smithi130 ceph-mon[26123]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-06-18T02:08:26.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:26 smithi007 ceph-mon[25091]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-06-18T02:08:26.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:26 smithi007 ceph-mon[29879]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-06-18T02:08:27.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:27 smithi007 ceph-mon[25091]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 301 B/s rd, 0 op/s 2024-06-18T02:08:27.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:27 smithi007 ceph-mon[29879]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 301 B/s rd, 0 op/s 2024-06-18T02:08:27.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:27 smithi130 ceph-mon[26123]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 301 B/s rd, 0 op/s 2024-06-18T02:08:28.259 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:28 smithi130 systemd[1]: Stopping Ceph prometheus.a for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:08:28.543 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:28 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[59059]: ts=2024-06-18T02:08:28.260Z caller=main.go:775 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-06-18T02:08:28.544 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:28 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[59059]: ts=2024-06-18T02:08:28.260Z caller=main.go:798 level=info msg="Stopping scrape discovery manager..." 2024-06-18T02:08:28.544 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:28 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[59059]: ts=2024-06-18T02:08:28.261Z caller=main.go:812 level=info msg="Stopping notify discovery manager..." 2024-06-18T02:08:28.544 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:28 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[59059]: ts=2024-06-18T02:08:28.261Z caller=main.go:834 level=info msg="Stopping scrape manager..." 2024-06-18T02:08:28.544 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:28 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[59059]: ts=2024-06-18T02:08:28.261Z caller=main.go:794 level=info msg="Scrape discovery manager stopped" 2024-06-18T02:08:28.544 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:28 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[59059]: ts=2024-06-18T02:08:28.261Z caller=main.go:808 level=info msg="Notify discovery manager stopped" 2024-06-18T02:08:28.544 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:28 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[59059]: ts=2024-06-18T02:08:28.261Z caller=manager.go:945 level=info component="rule manager" msg="Stopping rule manager..." 2024-06-18T02:08:28.544 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:28 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[59059]: ts=2024-06-18T02:08:28.261Z caller=main.go:828 level=info msg="Scrape manager stopped" 2024-06-18T02:08:28.544 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:28 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[59059]: ts=2024-06-18T02:08:28.261Z caller=manager.go:955 level=info component="rule manager" msg="Rule manager stopped" 2024-06-18T02:08:28.544 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:28 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[59059]: ts=2024-06-18T02:08:28.261Z caller=notifier.go:600 level=info component=notifier msg="Stopping notification manager..." 2024-06-18T02:08:28.544 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:28 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[59059]: ts=2024-06-18T02:08:28.261Z caller=main.go:1054 level=info msg="Notifier manager stopped" 2024-06-18T02:08:28.544 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:28 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[59059]: ts=2024-06-18T02:08:28.261Z caller=main.go:1066 level=info msg="See you next time!" 2024-06-18T02:08:28.544 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:28 smithi130 podman[61862]: 2024-06-18 02:08:28.271294286 +0000 UTC m=+0.150174509 container died 12e3e1deaaab009d8a89b13a584132f356b0ecfa12bcc3e6fbcee6e9d2681656 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-06-18T02:08:29.011 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:28 smithi130 podman[61862]: 2024-06-18 02:08:28.760762464 +0000 UTC m=+0.639642679 container cleanup 12e3e1deaaab009d8a89b13a584132f356b0ecfa12bcc3e6fbcee6e9d2681656 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-06-18T02:08:29.011 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:28 smithi130 bash[61862]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a 2024-06-18T02:08:29.011 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:28 smithi130 bash[61889]: Error: no container with name or ID "ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus.a" found: no such container 2024-06-18T02:08:29.270 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:29 smithi130 ceph-mon[26123]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 301 B/s rd, 0 op/s 2024-06-18T02:08:29.271 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:29 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/3470108188' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-18T02:08:29.271 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:29 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/2092580494' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/2421897417"}]: dispatch 2024-06-18T02:08:29.271 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:29 smithi130 ceph-mon[26123]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/2421897417"}]: dispatch 2024-06-18T02:08:29.271 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:29 smithi130 podman[61874]: 2024-06-18 02:08:29.012235599 +0000 UTC m=+0.741878503 container remove 12e3e1deaaab009d8a89b13a584132f356b0ecfa12bcc3e6fbcee6e9d2681656 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-06-18T02:08:29.271 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:29 smithi130 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@prometheus.a.service: Deactivated successfully. 2024-06-18T02:08:29.271 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:29 smithi130 systemd[1]: Stopped Ceph prometheus.a for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:08:29.271 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:29 smithi130 systemd[1]: Starting Ceph prometheus.a for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:08:29.271 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:29 smithi130 podman[61952]: 2024-06-18 02:08:29.162430987 +0000 UTC m=+0.018630148 image pull 514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d quay.io/prometheus/prometheus:v2.33.4 2024-06-18T02:08:29.541 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:29 smithi130 podman[61952]: 2024-06-18 02:08:29.271721834 +0000 UTC m=+0.127920984 container create e905fb2eb4a61a5202ae703be971b061154f41907e0f50ed3aebcacaf52a499f (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-06-18T02:08:29.542 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:29 smithi130 podman[61952]: 2024-06-18 02:08:29.515910684 +0000 UTC m=+0.372109847 container init e905fb2eb4a61a5202ae703be971b061154f41907e0f50ed3aebcacaf52a499f (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-06-18T02:08:29.542 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:29 smithi130 podman[61952]: 2024-06-18 02:08:29.518622125 +0000 UTC m=+0.374821279 container start e905fb2eb4a61a5202ae703be971b061154f41907e0f50ed3aebcacaf52a499f (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-06-18T02:08:29.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:29 smithi007 ceph-mon[25091]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 301 B/s rd, 0 op/s 2024-06-18T02:08:29.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:29 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/3470108188' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-18T02:08:29.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:29 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/2092580494' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/2421897417"}]: dispatch 2024-06-18T02:08:29.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:29 smithi007 ceph-mon[25091]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/2421897417"}]: dispatch 2024-06-18T02:08:29.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:29 smithi007 ceph-mon[29879]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 301 B/s rd, 0 op/s 2024-06-18T02:08:29.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:29 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/3470108188' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-18T02:08:29.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:29 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/2092580494' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/2421897417"}]: dispatch 2024-06-18T02:08:29.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:29 smithi007 ceph-mon[29879]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/2421897417"}]: dispatch 2024-06-18T02:08:29.793 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:29 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:08:29.543Z caller=main.go:475 level=info msg="No time or size retention was set so using the default time retention" duration=15d 2024-06-18T02:08:29.793 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:29 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:08:29.543Z caller=main.go:512 level=info msg="Starting Prometheus" version="(version=2.33.4, branch=HEAD, revision=83032011a5d3e6102624fe58241a374a7201fee8)" 2024-06-18T02:08:29.794 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:29 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:08:29.543Z caller=main.go:517 level=info build_context="(go=go1.17.7, user=root@d13bf69e7be8, date=20220222-16:51:28)" 2024-06-18T02:08:29.794 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:29 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:08:29.543Z caller=main.go:518 level=info host_details="(Linux 5.14.0-460.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024 x86_64 smithi130 (none))" 2024-06-18T02:08:29.794 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:29 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:08:29.543Z caller=main.go:519 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-06-18T02:08:29.794 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:29 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:08:29.543Z caller=main.go:520 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-06-18T02:08:29.794 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:29 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:08:29.544Z caller=web.go:570 level=info component=web msg="Start listening for connections" address=:9095 2024-06-18T02:08:29.794 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:29 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:08:29.545Z caller=main.go:923 level=info msg="Starting TSDB ..." 2024-06-18T02:08:29.794 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:29 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:08:29.546Z caller=tls_config.go:195 level=info component=web msg="TLS is disabled." http2=false 2024-06-18T02:08:29.794 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:29 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:08:29.548Z caller=head.go:493 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-06-18T02:08:29.794 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:29 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:08:29.548Z caller=head.go:527 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.565µs 2024-06-18T02:08:29.794 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:29 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:08:29.548Z caller=head.go:533 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-06-18T02:08:29.794 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:29 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:08:29.549Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=4 2024-06-18T02:08:29.794 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:29 smithi130 bash[61952]: e905fb2eb4a61a5202ae703be971b061154f41907e0f50ed3aebcacaf52a499f 2024-06-18T02:08:29.795 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:29 smithi130 systemd[1]: Started Ceph prometheus.a for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:08:30.364 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:30 smithi007 ceph-mon[25091]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/2421897417"}]': finished 2024-06-18T02:08:30.364 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:30 smithi007 ceph-mon[25091]: osdmap e109: 8 total, 8 up, 8 in 2024-06-18T02:08:30.364 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:30 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/4045216756' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6801/1667253164"}]: dispatch 2024-06-18T02:08:30.364 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:30 smithi007 ceph-mon[25091]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6801/1667253164"}]: dispatch 2024-06-18T02:08:30.365 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:30 smithi007 ceph-mon[25091]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:30.365 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:30 smithi007 ceph-mon[25091]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:30.365 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:30 smithi007 ceph-mon[25091]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-06-18T02:08:30.365 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:30 smithi007 ceph-mon[25091]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-06-18T02:08:30.365 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:30 smithi007 ceph-mon[25091]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:08:30.365 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:30 smithi007 ceph-mon[25091]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-06-18T02:08:30.365 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:30 smithi007 ceph-mon[25091]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-06-18T02:08:30.365 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:30 smithi007 ceph-mon[25091]: Upgrade: It appears safe to stop mon.a 2024-06-18T02:08:30.365 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:30 smithi007 ceph-mon[29879]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/2421897417"}]': finished 2024-06-18T02:08:30.365 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:30 smithi007 ceph-mon[29879]: osdmap e109: 8 total, 8 up, 8 in 2024-06-18T02:08:30.365 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:30 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/4045216756' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6801/1667253164"}]: dispatch 2024-06-18T02:08:30.365 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:30 smithi007 ceph-mon[29879]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6801/1667253164"}]: dispatch 2024-06-18T02:08:30.366 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:30 smithi007 ceph-mon[29879]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:30.366 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:30 smithi007 ceph-mon[29879]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:30.366 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:30 smithi007 ceph-mon[29879]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-06-18T02:08:30.366 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:30 smithi007 ceph-mon[29879]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-06-18T02:08:30.366 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:30 smithi007 ceph-mon[29879]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:08:30.366 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:30 smithi007 ceph-mon[29879]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-06-18T02:08:30.366 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:30 smithi007 ceph-mon[29879]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-06-18T02:08:30.366 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:30 smithi007 ceph-mon[29879]: Upgrade: It appears safe to stop mon.a 2024-06-18T02:08:30.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:30 smithi130 ceph-mon[26123]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/2421897417"}]': finished 2024-06-18T02:08:30.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:30 smithi130 ceph-mon[26123]: osdmap e109: 8 total, 8 up, 8 in 2024-06-18T02:08:30.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:30 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/4045216756' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6801/1667253164"}]: dispatch 2024-06-18T02:08:30.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:30 smithi130 ceph-mon[26123]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6801/1667253164"}]: dispatch 2024-06-18T02:08:30.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:30 smithi130 ceph-mon[26123]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:30.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:30 smithi130 ceph-mon[26123]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:30.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:30 smithi130 ceph-mon[26123]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-06-18T02:08:30.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:30 smithi130 ceph-mon[26123]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-06-18T02:08:30.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:30 smithi130 ceph-mon[26123]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:08:30.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:30 smithi130 ceph-mon[26123]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-06-18T02:08:30.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:30 smithi130 ceph-mon[26123]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-06-18T02:08:30.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:30 smithi130 ceph-mon[26123]: Upgrade: It appears safe to stop mon.a 2024-06-18T02:08:30.545 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:30 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:08:30.048Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=4 2024-06-18T02:08:30.545 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:30 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:08:30.255Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=2 maxSegment=4 2024-06-18T02:08:30.545 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:30 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:08:30.256Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=3 maxSegment=4 2024-06-18T02:08:30.545 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:30 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:08:30.260Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=4 maxSegment=4 2024-06-18T02:08:30.545 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:30 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:08:30.260Z caller=head.go:610 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=36.709µs wal_replay_duration=711.59179ms total_replay_duration=711.642074ms 2024-06-18T02:08:30.545 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:30 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:08:30.266Z caller=main.go:944 level=info fs_type=XFS_SUPER_MAGIC 2024-06-18T02:08:30.545 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:30 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:08:30.266Z caller=main.go:947 level=info msg="TSDB started" 2024-06-18T02:08:30.545 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:30 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:08:30.266Z caller=main.go:1128 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-06-18T02:08:30.545 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:30 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:08:30.291Z caller=main.go:1165 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=24.84623ms db_storage=744ns remote_storage=1.65µs web_handler=451ns query_engine=817ns scrape=578.427µs scrape_sd=161.638µs notify=18.883µs notify_sd=32.509µs rules=23.500825ms 2024-06-18T02:08:30.545 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:30 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:08:30.291Z caller=main.go:896 level=info msg="Server is ready to receive web requests." 2024-06-18T02:08:31.517 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:31 smithi007 ceph-mon[25091]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 124 B/s rd, 0 op/s 2024-06-18T02:08:31.517 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:31 smithi007 ceph-mon[25091]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6801/1667253164"}]': finished 2024-06-18T02:08:31.517 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:31 smithi007 ceph-mon[25091]: osdmap e110: 8 total, 8 up, 8 in 2024-06-18T02:08:31.517 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:31 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/3513926245' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/558266026"}]: dispatch 2024-06-18T02:08:31.517 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:31 smithi007 ceph-mon[25091]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/558266026"}]: dispatch 2024-06-18T02:08:31.517 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:31 smithi007 ceph-mon[25091]: Upgrade: Updating mon.a 2024-06-18T02:08:31.517 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:31 smithi007 ceph-mon[25091]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:31.517 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:31 smithi007 ceph-mon[25091]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-18T02:08:31.517 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:31 smithi007 ceph-mon[25091]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-18T02:08:31.517 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:31 smithi007 ceph-mon[25091]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:08:31.517 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:31 smithi007 ceph-mon[25091]: Deploying daemon mon.a on smithi007 2024-06-18T02:08:31.518 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:31 smithi007 ceph-mon[29879]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 124 B/s rd, 0 op/s 2024-06-18T02:08:31.518 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:31 smithi007 ceph-mon[29879]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6801/1667253164"}]': finished 2024-06-18T02:08:31.518 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:31 smithi007 ceph-mon[29879]: osdmap e110: 8 total, 8 up, 8 in 2024-06-18T02:08:31.518 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:31 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/3513926245' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/558266026"}]: dispatch 2024-06-18T02:08:31.518 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:31 smithi007 ceph-mon[29879]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/558266026"}]: dispatch 2024-06-18T02:08:31.518 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:31 smithi007 ceph-mon[29879]: Upgrade: Updating mon.a 2024-06-18T02:08:31.518 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:31 smithi007 ceph-mon[29879]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:31.518 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:31 smithi007 ceph-mon[29879]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-18T02:08:31.518 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:31 smithi007 ceph-mon[29879]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-18T02:08:31.518 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:31 smithi007 ceph-mon[29879]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:08:31.518 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:31 smithi007 ceph-mon[29879]: Deploying daemon mon.a on smithi007 2024-06-18T02:08:31.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:31 smithi130 ceph-mon[26123]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 124 B/s rd, 0 op/s 2024-06-18T02:08:31.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:31 smithi130 ceph-mon[26123]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6801/1667253164"}]': finished 2024-06-18T02:08:31.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:31 smithi130 ceph-mon[26123]: osdmap e110: 8 total, 8 up, 8 in 2024-06-18T02:08:31.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:31 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/3513926245' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/558266026"}]: dispatch 2024-06-18T02:08:31.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:31 smithi130 ceph-mon[26123]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/558266026"}]: dispatch 2024-06-18T02:08:31.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:31 smithi130 ceph-mon[26123]: Upgrade: Updating mon.a 2024-06-18T02:08:31.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:31 smithi130 ceph-mon[26123]: from='mgr.25202 ' entity='mgr.x' 2024-06-18T02:08:31.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:31 smithi130 ceph-mon[26123]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-18T02:08:31.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:31 smithi130 ceph-mon[26123]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-18T02:08:31.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:31 smithi130 ceph-mon[26123]: from='mgr.25202 172.21.15.130:0/158241214' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:08:31.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:31 smithi130 ceph-mon[26123]: Deploying daemon mon.a on smithi007 2024-06-18T02:08:32.397 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:32 smithi007 ceph-mon[25091]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/558266026"}]': finished 2024-06-18T02:08:32.397 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:32 smithi007 ceph-mon[25091]: osdmap e111: 8 total, 8 up, 8 in 2024-06-18T02:08:32.397 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:32 smithi007 ceph-mon[25091]: from='client.? 172.21.15.7:0/1349530686' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6800/1667253164"}]: dispatch 2024-06-18T02:08:32.397 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:32 smithi007 ceph-mon[25091]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6800/1667253164"}]: dispatch 2024-06-18T02:08:32.398 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:32 smithi007 ceph-mon[29879]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/558266026"}]': finished 2024-06-18T02:08:32.398 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:32 smithi007 ceph-mon[29879]: osdmap e111: 8 total, 8 up, 8 in 2024-06-18T02:08:32.398 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:32 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/1349530686' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6800/1667253164"}]: dispatch 2024-06-18T02:08:32.398 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:32 smithi007 ceph-mon[29879]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6800/1667253164"}]: dispatch 2024-06-18T02:08:32.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:32 smithi130 ceph-mon[26123]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/558266026"}]': finished 2024-06-18T02:08:32.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:32 smithi130 ceph-mon[26123]: osdmap e111: 8 total, 8 up, 8 in 2024-06-18T02:08:32.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:32 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/1349530686' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6800/1667253164"}]: dispatch 2024-06-18T02:08:32.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:32 smithi130 ceph-mon[26123]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:6800/1667253164"}]: dispatch 2024-06-18T02:08:32.930 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:32 smithi007 systemd[1]: Stopping Ceph mon.a for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:08:33.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:32 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-a[25087]: 2024-06-18T02:08:32.929+0000 7fc35d705700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-06-18T02:08:33.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:32 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-a[25087]: 2024-06-18T02:08:32.929+0000 7fc35d705700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-06-18T02:08:33.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:32 smithi007 podman[73338]: 2024-06-18 02:08:32.991813022 +0000 UTC m=+0.184645200 container died 147f3ea02ae3172f2191bd6e60ec4737befb79c6c82c755bb167ccad2a982a3b (image=quay.io/ceph/ceph:v17.2.0, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-a, name=centos-stream, version=8, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, GIT_CLEAN=True, release=754, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, vendor=Red Hat, Inc., build-date=2022-05-03T08:36:31.336870, io.openshift.tags=base centos centos-stream, io.buildah.version=1.19.8, architecture=x86_64, RELEASE=HEAD, io.openshift.expose-services=, ceph=True, com.redhat.component=centos-stream-container, io.k8s.display-name=CentOS Stream 8, maintainer=Guillaume Abrioux , vcs-type=git, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, distribution-scope=public, CEPH_POINT_RELEASE=-17.2.0, GIT_REPO=https://github.com/ceph/ceph-container.git, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_BRANCH=HEAD) 2024-06-18T02:08:33.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:33 smithi007 podman[73338]: 2024-06-18 02:08:33.446435576 +0000 UTC m=+0.639267756 container cleanup 147f3ea02ae3172f2191bd6e60ec4737befb79c6c82c755bb167ccad2a982a3b (image=quay.io/ceph/ceph:v17.2.0, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-a, vcs-type=git, RELEASE=HEAD, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.19.8, distribution-scope=public, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, maintainer=Guillaume Abrioux , com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, CEPH_POINT_RELEASE=-17.2.0, name=centos-stream, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, GIT_CLEAN=True, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, com.redhat.component=centos-stream-container, ceph=True, vendor=Red Hat, Inc., io.openshift.tags=base centos centos-stream, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, release=754, io.openshift.expose-services=, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, build-date=2022-05-03T08:36:31.336870, version=8, architecture=x86_64, io.k8s.display-name=CentOS Stream 8) 2024-06-18T02:08:33.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:33 smithi007 bash[73338]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-a 2024-06-18T02:08:33.793 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:33 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:08:33.505Z caller=manager.go:609 level=warn component="rule manager" group=nodes msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on(instance) group_left(nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi007\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"cd9a3408-2d15-11ef-bc9d-c7b262605968\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-06-18T02:08:34.071 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:33 smithi007 podman[73352]: 2024-06-18 02:08:33.731483255 +0000 UTC m=+0.741922084 container remove 147f3ea02ae3172f2191bd6e60ec4737befb79c6c82c755bb167ccad2a982a3b (image=quay.io/ceph/ceph:v17.2.0, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-a, io.openshift.tags=base centos centos-stream, GIT_CLEAN=True, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, RELEASE=HEAD, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, version=8, vendor=Red Hat, Inc., io.openshift.expose-services=, ceph=True, maintainer=Guillaume Abrioux , description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, name=centos-stream, CEPH_POINT_RELEASE=-17.2.0, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.k8s.display-name=CentOS Stream 8, architecture=x86_64, com.redhat.component=centos-stream-container, GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.19.8, distribution-scope=public, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_BRANCH=HEAD, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., build-date=2022-05-03T08:36:31.336870, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, vcs-type=git, release=754) 2024-06-18T02:08:34.071 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:33 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mon.a.service: Deactivated successfully. 2024-06-18T02:08:34.071 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:33 smithi007 systemd[1]: Stopped Ceph mon.a for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:08:34.071 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:33 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mon.a.service: Consumed 17.063s CPU time. 2024-06-18T02:08:34.373 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 systemd[1]: Starting Ceph mon.a for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:08:34.374 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 podman[73481]: 2024-06-18 02:08:34.265808382 +0000 UTC m=+0.090203065 container create 670d7777ae9b5d2cce51bb4a0520822cf60591520b5fc6126caad4d816a0064c (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-a, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240612, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, RELEASE=squid-3781e3a, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0) 2024-06-18T02:08:34.374 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 podman[73481]: 2024-06-18 02:08:34.193793223 +0000 UTC m=+0.018187915 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:08:34.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 podman[73481]: 2024-06-18 02:08:34.501760585 +0000 UTC m=+0.326155278 container init 670d7777ae9b5d2cce51bb4a0520822cf60591520b5fc6126caad4d816a0064c (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-a, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240612, io.buildah.version=1.36.0, RELEASE=squid-3781e3a, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-06-18T02:08:34.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 podman[73481]: 2024-06-18 02:08:34.505121682 +0000 UTC m=+0.329516366 container start 670d7777ae9b5d2cce51bb4a0520822cf60591520b5fc6126caad4d816a0064c (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, RELEASE=squid-3781e3a, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240612) 2024-06-18T02:08:34.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: set uid:gid to 167:167 (ceph:ceph) 2024-06-18T02:08:34.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc), process ceph-mon, pid 2 2024-06-18T02:08:34.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: pidfile_write: ignore empty --pid-file 2024-06-18T02:08:34.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: load: jerasure load: lrc 2024-06-18T02:08:34.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: RocksDB version: 7.9.2 2024-06-18T02:08:34.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Git sha 0 2024-06-18T02:08:34.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Compile date 2024-06-17 15:21:02 2024-06-18T02:08:34.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: DB SUMMARY 2024-06-18T02:08:34.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: DB Session ID: 5KP3054Z2YBED2AWBK9L 2024-06-18T02:08:34.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: CURRENT file: CURRENT 2024-06-18T02:08:34.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: IDENTITY file: IDENTITY 2024-06-18T02:08:34.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1142 Bytes 2024-06-18T02:08:34.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000033.sst 2024-06-18T02:08:34.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000031.log size: 9052175 ; 2024-06-18T02:08:34.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.error_if_exists: 0 2024-06-18T02:08:34.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.create_if_missing: 0 2024-06-18T02:08:34.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.paranoid_checks: 1 2024-06-18T02:08:34.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.flush_verify_memtable_count: 1 2024-06-18T02:08:34.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-06-18T02:08:34.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-06-18T02:08:34.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.env: 0x556fedb30740 2024-06-18T02:08:34.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.fs: PosixFileSystem 2024-06-18T02:08:34.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.info_log: 0x556feeccd000 2024-06-18T02:08:34.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.max_file_opening_threads: 16 2024-06-18T02:08:34.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.statistics: (nil) 2024-06-18T02:08:34.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.use_fsync: 0 2024-06-18T02:08:34.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.max_log_file_size: 0 2024-06-18T02:08:34.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-06-18T02:08:34.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.log_file_time_to_roll: 0 2024-06-18T02:08:34.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.keep_log_file_num: 1000 2024-06-18T02:08:34.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.recycle_log_file_num: 0 2024-06-18T02:08:34.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.allow_fallocate: 1 2024-06-18T02:08:34.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.allow_mmap_reads: 0 2024-06-18T02:08:34.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.allow_mmap_writes: 0 2024-06-18T02:08:34.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.use_direct_reads: 0 2024-06-18T02:08:34.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-06-18T02:08:34.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.create_missing_column_families: 0 2024-06-18T02:08:34.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.db_log_dir: 2024-06-18T02:08:34.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.wal_dir: 2024-06-18T02:08:34.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.table_cache_numshardbits: 6 2024-06-18T02:08:34.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.WAL_ttl_seconds: 0 2024-06-18T02:08:34.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.WAL_size_limit_MB: 0 2024-06-18T02:08:34.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-06-18T02:08:34.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-06-18T02:08:34.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.is_fd_close_on_exec: 1 2024-06-18T02:08:34.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.advise_random_on_open: 1 2024-06-18T02:08:34.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.db_write_buffer_size: 0 2024-06-18T02:08:34.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.write_buffer_manager: 0x556feecdc1e0 2024-06-18T02:08:34.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-06-18T02:08:34.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-06-18T02:08:34.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.use_adaptive_mutex: 0 2024-06-18T02:08:34.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.rate_limiter: (nil) 2024-06-18T02:08:34.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-06-18T02:08:34.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.wal_recovery_mode: 2 2024-06-18T02:08:34.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.enable_thread_tracking: 0 2024-06-18T02:08:34.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.enable_pipelined_write: 0 2024-06-18T02:08:34.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.unordered_write: 0 2024-06-18T02:08:34.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-06-18T02:08:34.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-06-18T02:08:34.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-06-18T02:08:34.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-06-18T02:08:34.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.row_cache: None 2024-06-18T02:08:34.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.wal_filter: None 2024-06-18T02:08:34.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-06-18T02:08:34.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.allow_ingest_behind: 0 2024-06-18T02:08:34.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.two_write_queues: 0 2024-06-18T02:08:34.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.manual_wal_flush: 0 2024-06-18T02:08:34.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.wal_compression: 0 2024-06-18T02:08:34.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.atomic_flush: 0 2024-06-18T02:08:34.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-06-18T02:08:34.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.persist_stats_to_disk: 0 2024-06-18T02:08:34.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.write_dbid_to_manifest: 0 2024-06-18T02:08:34.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.log_readahead_size: 0 2024-06-18T02:08:34.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-06-18T02:08:34.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.best_efforts_recovery: 0 2024-06-18T02:08:34.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-06-18T02:08:34.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-06-18T02:08:34.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.allow_data_in_errors: 0 2024-06-18T02:08:34.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.db_host_id: __hostname__ 2024-06-18T02:08:34.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.enforce_single_del_contracts: true 2024-06-18T02:08:34.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.max_background_jobs: 2 2024-06-18T02:08:34.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.max_background_compactions: -1 2024-06-18T02:08:34.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.max_subcompactions: 1 2024-06-18T02:08:34.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-06-18T02:08:34.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-06-18T02:08:34.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.delayed_write_rate : 16777216 2024-06-18T02:08:34.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.max_total_wal_size: 0 2024-06-18T02:08:34.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-06-18T02:08:34.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.stats_dump_period_sec: 600 2024-06-18T02:08:34.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.stats_persist_period_sec: 600 2024-06-18T02:08:34.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-06-18T02:08:34.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.max_open_files: -1 2024-06-18T02:08:34.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.bytes_per_sync: 0 2024-06-18T02:08:34.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.wal_bytes_per_sync: 0 2024-06-18T02:08:34.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.strict_bytes_per_sync: 0 2024-06-18T02:08:34.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.compaction_readahead_size: 0 2024-06-18T02:08:34.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.max_background_flushes: -1 2024-06-18T02:08:34.941 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Compression algorithms supported: 2024-06-18T02:08:34.941 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: kZSTD supported: 0 2024-06-18T02:08:34.941 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: kXpressCompression supported: 0 2024-06-18T02:08:34.941 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: kBZip2Compression supported: 0 2024-06-18T02:08:34.941 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-06-18T02:08:34.941 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: kLZ4Compression supported: 1 2024-06-18T02:08:34.941 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: kZlibCompression supported: 1 2024-06-18T02:08:34.941 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: kLZ4HCCompression supported: 1 2024-06-18T02:08:34.941 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: kSnappyCompression supported: 1 2024-06-18T02:08:34.941 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Fast CRC32 supported: Supported on x86 2024-06-18T02:08:34.941 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: DMutex implementation: pthread_mutex_t 2024-06-18T02:08:34.941 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000015 2024-06-18T02:08:34.941 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-06-18T02:08:34.942 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-06-18T02:08:34.942 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.merge_operator: 2024-06-18T02:08:34.942 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.compaction_filter: None 2024-06-18T02:08:34.942 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.compaction_filter_factory: None 2024-06-18T02:08:34.942 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.sst_partitioner_factory: None 2024-06-18T02:08:34.942 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.memtable_factory: SkipListFactory 2024-06-18T02:08:34.942 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.table_factory: BlockBasedTable 2024-06-18T02:08:34.942 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x556feecccd00) 2024-06-18T02:08:34.942 INFO:journalctl@ceph.mon.a.smithi007.stdout: cache_index_and_filter_blocks: 1 2024-06-18T02:08:34.942 INFO:journalctl@ceph.mon.a.smithi007.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-06-18T02:08:34.942 INFO:journalctl@ceph.mon.a.smithi007.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-06-18T02:08:34.942 INFO:journalctl@ceph.mon.a.smithi007.stdout: pin_top_level_index_and_filter: 1 2024-06-18T02:08:34.942 INFO:journalctl@ceph.mon.a.smithi007.stdout: index_type: 0 2024-06-18T02:08:34.942 INFO:journalctl@ceph.mon.a.smithi007.stdout: data_block_index_type: 0 2024-06-18T02:08:34.943 INFO:journalctl@ceph.mon.a.smithi007.stdout: index_shortening: 1 2024-06-18T02:08:34.943 INFO:journalctl@ceph.mon.a.smithi007.stdout: data_block_hash_table_util_ratio: 0.750000 2024-06-18T02:08:34.943 INFO:journalctl@ceph.mon.a.smithi007.stdout: checksum: 4 2024-06-18T02:08:34.943 INFO:journalctl@ceph.mon.a.smithi007.stdout: no_block_cache: 0 2024-06-18T02:08:34.943 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_cache: 0x556feecc3090 2024-06-18T02:08:34.943 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_cache_name: BinnedLRUCache 2024-06-18T02:08:34.943 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_cache_options: 2024-06-18T02:08:34.943 INFO:journalctl@ceph.mon.a.smithi007.stdout: capacity : 536870912 2024-06-18T02:08:34.943 INFO:journalctl@ceph.mon.a.smithi007.stdout: num_shard_bits : 4 2024-06-18T02:08:34.943 INFO:journalctl@ceph.mon.a.smithi007.stdout: strict_capacity_limit : 0 2024-06-18T02:08:34.943 INFO:journalctl@ceph.mon.a.smithi007.stdout: high_pri_pool_ratio: 0.000 2024-06-18T02:08:34.943 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_cache_compressed: (nil) 2024-06-18T02:08:34.943 INFO:journalctl@ceph.mon.a.smithi007.stdout: persistent_cache: (nil) 2024-06-18T02:08:34.943 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_size: 4096 2024-06-18T02:08:34.944 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_size_deviation: 10 2024-06-18T02:08:34.944 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_restart_interval: 16 2024-06-18T02:08:34.944 INFO:journalctl@ceph.mon.a.smithi007.stdout: index_block_restart_interval: 1 2024-06-18T02:08:34.944 INFO:journalctl@ceph.mon.a.smithi007.stdout: metadata_block_size: 4096 2024-06-18T02:08:34.944 INFO:journalctl@ceph.mon.a.smithi007.stdout: partition_filters: 0 2024-06-18T02:08:34.944 INFO:journalctl@ceph.mon.a.smithi007.stdout: use_delta_encoding: 1 2024-06-18T02:08:34.944 INFO:journalctl@ceph.mon.a.smithi007.stdout: filter_policy: bloomfilter 2024-06-18T02:08:34.944 INFO:journalctl@ceph.mon.a.smithi007.stdout: whole_key_filtering: 1 2024-06-18T02:08:34.944 INFO:journalctl@ceph.mon.a.smithi007.stdout: verify_compression: 0 2024-06-18T02:08:34.944 INFO:journalctl@ceph.mon.a.smithi007.stdout: read_amp_bytes_per_bit: 0 2024-06-18T02:08:34.944 INFO:journalctl@ceph.mon.a.smithi007.stdout: format_version: 5 2024-06-18T02:08:34.944 INFO:journalctl@ceph.mon.a.smithi007.stdout: enable_index_compression: 1 2024-06-18T02:08:34.944 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_align: 0 2024-06-18T02:08:34.944 INFO:journalctl@ceph.mon.a.smithi007.stdout: max_auto_readahead_size: 262144 2024-06-18T02:08:34.945 INFO:journalctl@ceph.mon.a.smithi007.stdout: prepopulate_block_cache: 0 2024-06-18T02:08:34.945 INFO:journalctl@ceph.mon.a.smithi007.stdout: initial_auto_readahead_size: 8192 2024-06-18T02:08:34.945 INFO:journalctl@ceph.mon.a.smithi007.stdout: num_file_reads_for_auto_readahead: 2 2024-06-18T02:08:34.945 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.write_buffer_size: 33554432 2024-06-18T02:08:34.945 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.max_write_buffer_number: 2 2024-06-18T02:08:34.945 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.compression: NoCompression 2024-06-18T02:08:34.945 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.bottommost_compression: Disabled 2024-06-18T02:08:34.945 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.prefix_extractor: nullptr 2024-06-18T02:08:34.945 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-06-18T02:08:34.945 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.num_levels: 7 2024-06-18T02:08:34.945 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-06-18T02:08:34.945 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-06-18T02:08:34.945 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-06-18T02:08:34.945 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-06-18T02:08:34.946 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-06-18T02:08:34.946 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-06-18T02:08:34.946 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-06-18T02:08:34.946 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-06-18T02:08:34.946 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-06-18T02:08:34.946 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-06-18T02:08:34.946 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-06-18T02:08:34.946 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-06-18T02:08:34.946 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.compression_opts.window_bits: -14 2024-06-18T02:08:34.946 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.compression_opts.level: 32767 2024-06-18T02:08:34.946 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.compression_opts.strategy: 0 2024-06-18T02:08:34.946 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-06-18T02:08:34.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-06-18T02:08:34.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-06-18T02:08:34.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-06-18T02:08:34.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.compression_opts.enabled: false 2024-06-18T02:08:34.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-06-18T02:08:34.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-06-18T02:08:34.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-06-18T02:08:34.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-06-18T02:08:34.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.target_file_size_base: 67108864 2024-06-18T02:08:34.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.target_file_size_multiplier: 1 2024-06-18T02:08:34.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-06-18T02:08:34.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-06-18T02:08:34.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-06-18T02:08:34.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-06-18T02:08:34.948 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-06-18T02:08:34.948 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-06-18T02:08:34.948 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-06-18T02:08:34.948 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-06-18T02:08:34.948 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-06-18T02:08:34.948 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-06-18T02:08:34.948 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-06-18T02:08:34.948 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-06-18T02:08:34.948 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-06-18T02:08:34.948 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.arena_block_size: 1048576 2024-06-18T02:08:34.948 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-06-18T02:08:34.948 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-06-18T02:08:34.948 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.disable_auto_compactions: 0 2024-06-18T02:08:34.949 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-06-18T02:08:34.949 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-06-18T02:08:34.949 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-06-18T02:08:34.949 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-06-18T02:08:34.949 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-06-18T02:08:34.949 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-06-18T02:08:34.949 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-06-18T02:08:34.949 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-06-18T02:08:34.949 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-06-18T02:08:34.949 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-06-18T02:08:34.949 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.table_properties_collectors: 2024-06-18T02:08:34.949 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.inplace_update_support: 0 2024-06-18T02:08:34.949 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.inplace_update_num_locks: 10000 2024-06-18T02:08:34.949 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-06-18T02:08:34.949 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-06-18T02:08:34.950 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.memtable_huge_page_size: 0 2024-06-18T02:08:34.950 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.bloom_locality: 0 2024-06-18T02:08:34.950 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.max_successive_merges: 0 2024-06-18T02:08:34.950 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.optimize_filters_for_hits: 0 2024-06-18T02:08:34.950 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.paranoid_file_checks: 0 2024-06-18T02:08:34.950 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.force_consistency_checks: 1 2024-06-18T02:08:34.950 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.report_bg_io_stats: 0 2024-06-18T02:08:34.950 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.ttl: 2592000 2024-06-18T02:08:34.950 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.periodic_compaction_seconds: 0 2024-06-18T02:08:34.950 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-06-18T02:08:34.950 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-06-18T02:08:34.950 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.enable_blob_files: false 2024-06-18T02:08:34.950 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.min_blob_size: 0 2024-06-18T02:08:34.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.blob_file_size: 268435456 2024-06-18T02:08:34.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.blob_compression_type: NoCompression 2024-06-18T02:08:34.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.enable_blob_garbage_collection: false 2024-06-18T02:08:34.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-06-18T02:08:34.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-06-18T02:08:34.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-06-18T02:08:34.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.blob_file_starting_level: 0 2024-06-18T02:08:34.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-06-18T02:08:34.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 33.sst 2024-06-18T02:08:34.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-06-18T02:08:34.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 35, last_sequence is 12347, log_number is 31,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-06-18T02:08:34.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 31 2024-06-18T02:08:34.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: e87bb5f4-533e-44e3-a05d-92dfdc098920 2024-06-18T02:08:34.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: EVENT_LOG_v1 {"time_micros": 1718676514533603, "job": 1, "event": "recovery_started", "wal_files": [31]} 2024-06-18T02:08:34.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #31 mode 2 2024-06-18T02:08:34.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: EVENT_LOG_v1 {"time_micros": 1718676514557163, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 36, "file_size": 8197046, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12348, "largest_seqno": 16188, "table_properties": {"data_size": 8180124, "index_size": 11421, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 4485, "raw_key_size": 39314, "raw_average_key_size": 22, "raw_value_size": 8143860, "raw_average_value_size": 4593, "num_data_blocks": 511, "num_entries": 1773, "num_filter_entries": 1773, "num_deletions": 251, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1718676514, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "e87bb5f4-533e-44e3-a05d-92dfdc098920", "db_session_id": "5KP3054Z2YBED2AWBK9L", "orig_file_number": 36, "seqno_to_time_mapping": "N/A"}} 2024-06-18T02:08:34.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: EVENT_LOG_v1 {"time_micros": 1718676514557264, "job": 1, "event": "recovery_finished"} 2024-06-18T02:08:34.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: [db/version_set.cc:5047] Creating manifest 38 2024-06-18T02:08:34.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-06-18T02:08:34.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000031.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-06-18T02:08:34.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x556feecf0e00 2024-06-18T02:08:34.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: DB pointer 0x556feede6000 2024-06-18T02:08:34.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-06-18T02:08:34.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-06-18T02:08:34.952 INFO:journalctl@ceph.mon.a.smithi007.stdout: ** DB Stats ** 2024-06-18T02:08:34.952 INFO:journalctl@ceph.mon.a.smithi007.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-18T02:08:34.952 INFO:journalctl@ceph.mon.a.smithi007.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-06-18T02:08:34.953 INFO:journalctl@ceph.mon.a.smithi007.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-18T02:08:34.953 INFO:journalctl@ceph.mon.a.smithi007.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-18T02:08:34.953 INFO:journalctl@ceph.mon.a.smithi007.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-06-18T02:08:34.953 INFO:journalctl@ceph.mon.a.smithi007.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-18T02:08:34.953 INFO:journalctl@ceph.mon.a.smithi007.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-18T02:08:34.953 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-06-18T02:08:34.953 INFO:journalctl@ceph.mon.a.smithi007.stdout: ** Compaction Stats [default] ** 2024-06-18T02:08:34.953 INFO:journalctl@ceph.mon.a.smithi007.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-06-18T02:08:34.953 INFO:journalctl@ceph.mon.a.smithi007.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-06-18T02:08:34.953 INFO:journalctl@ceph.mon.a.smithi007.stdout: L0 1/0 7.82 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 713.2 0.01 0.00 1 0.011 0 0 0.0 0.0 2024-06-18T02:08:34.953 INFO:journalctl@ceph.mon.a.smithi007.stdout: L6 1/0 5.91 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-06-18T02:08:34.953 INFO:journalctl@ceph.mon.a.smithi007.stdout: Sum 2/0 13.73 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 713.2 0.01 0.00 1 0.011 0 0 0.0 0.0 2024-06-18T02:08:34.953 INFO:journalctl@ceph.mon.a.smithi007.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 713.2 0.01 0.00 1 0.011 0 0 0.0 0.0 2024-06-18T02:08:34.953 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-06-18T02:08:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout: ** Compaction Stats [default] ** 2024-06-18T02:08:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-06-18T02:08:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-06-18T02:08:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 713.2 0.01 0.00 1 0.011 0 0 0.0 0.0 2024-06-18T02:08:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-06-18T02:08:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-06-18T02:08:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-06-18T02:08:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-18T02:08:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout: Flush(GB): cumulative 0.008, interval 0.008 2024-06-18T02:08:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-06-18T02:08:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-06-18T02:08:34.955 INFO:journalctl@ceph.mon.a.smithi007.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-06-18T02:08:34.955 INFO:journalctl@ceph.mon.a.smithi007.stdout: AddFile(Keys): cumulative 0, interval 0 2024-06-18T02:08:34.955 INFO:journalctl@ceph.mon.a.smithi007.stdout: Cumulative compaction: 0.01 GB write, 295.86 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-18T02:08:34.955 INFO:journalctl@ceph.mon.a.smithi007.stdout: Interval compaction: 0.01 GB write, 295.86 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-18T02:08:34.955 INFO:journalctl@ceph.mon.a.smithi007.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-06-18T02:08:34.955 INFO:journalctl@ceph.mon.a.smithi007.stdout: Block cache BinnedLRUCache@0x556feecc3090#2 capacity: 512.00 MB usage: 16.61 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-06-18T02:08:34.955 INFO:journalctl@ceph.mon.a.smithi007.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,4.53 KB,0.000864267%) IndexBlock(1,12.08 KB,0.00230372%) Misc(1,0.00 KB,0%) 2024-06-18T02:08:34.955 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-06-18T02:08:34.955 INFO:journalctl@ceph.mon.a.smithi007.stdout: ** File Read Latency Histogram By Level [default] ** 2024-06-18T02:08:34.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: starting mon.a rank 0 at public addrs [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] at bind addrs [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 2024-06-18T02:08:34.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: mon.a@-1(???) e3 preinit fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 2024-06-18T02:08:34.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: mon.a@-1(???).mds e1 new map 2024-06-18T02:08:34.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: mon.a@-1(???).mds e1 print_map 2024-06-18T02:08:34.956 INFO:journalctl@ceph.mon.a.smithi007.stdout: e1 2024-06-18T02:08:34.956 INFO:journalctl@ceph.mon.a.smithi007.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-06-18T02:08:34.957 INFO:journalctl@ceph.mon.a.smithi007.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-18T02:08:34.957 INFO:journalctl@ceph.mon.a.smithi007.stdout: legacy client fscid: -1 2024-06-18T02:08:34.957 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-06-18T02:08:34.957 INFO:journalctl@ceph.mon.a.smithi007.stdout: No filesystems configured 2024-06-18T02:08:34.957 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: mon.a@-1(???).osd e112 crush map has features 3314933000854323200, adjusting msgr requires 2024-06-18T02:08:34.957 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: mon.a@-1(???).osd e112 crush map has features 432629239337189376, adjusting msgr requires 2024-06-18T02:08:34.957 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: mon.a@-1(???).osd e112 crush map has features 432629239337189376, adjusting msgr requires 2024-06-18T02:08:34.957 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: mon.a@-1(???).osd e112 crush map has features 432629239337189376, adjusting msgr requires 2024-06-18T02:08:34.957 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 ceph-mon[73500]: mon.a@-1(???).paxosservice(auth 1..24) refresh upgraded, format 0 -> 3 2024-06-18T02:08:34.958 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 bash[73481]: 670d7777ae9b5d2cce51bb4a0520822cf60591520b5fc6126caad4d816a0064c 2024-06-18T02:08:34.958 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:34 smithi007 systemd[1]: Started Ceph mon.a for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:08:36.093 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:36 smithi130 ceph-mon[26123]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-06-18T02:08:36.093 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:36 smithi130 ceph-mon[26123]: pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-06-18T02:08:36.093 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:36 smithi130 ceph-mon[26123]: mon.a calling monitor election 2024-06-18T02:08:36.093 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:36 smithi130 ceph-mon[26123]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-06-18T02:08:36.093 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:36 smithi130 ceph-mon[26123]: from='client.? ' entity='' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/2713795336"}]: dispatch 2024-06-18T02:08:36.093 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:36 smithi130 ceph-mon[26123]: monmap epoch 3 2024-06-18T02:08:36.093 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:36 smithi130 ceph-mon[26123]: fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 2024-06-18T02:08:36.093 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:36 smithi130 ceph-mon[26123]: last_changed 2024-06-18T01:57:18.881740+0000 2024-06-18T02:08:36.094 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:36 smithi130 ceph-mon[26123]: created 2024-06-18T01:55:37.939231+0000 2024-06-18T02:08:36.094 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:36 smithi130 ceph-mon[26123]: min_mon_release 17 (quincy) 2024-06-18T02:08:36.094 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:36 smithi130 ceph-mon[26123]: election_strategy: 1 2024-06-18T02:08:36.094 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:36 smithi130 ceph-mon[26123]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-06-18T02:08:36.094 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:36 smithi130 ceph-mon[26123]: 1: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-06-18T02:08:36.094 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:36 smithi130 ceph-mon[26123]: 2: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-06-18T02:08:36.094 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:36 smithi130 ceph-mon[26123]: fsmap 2024-06-18T02:08:36.094 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:36 smithi130 ceph-mon[26123]: osdmap e112: 8 total, 8 up, 8 in 2024-06-18T02:08:36.094 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:36 smithi130 ceph-mon[26123]: mgrmap e37: x(active, since 28s), standbys: y 2024-06-18T02:08:36.094 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:36 smithi130 ceph-mon[26123]: Health detail: HEALTH_WARN 1 failed cephadm daemon(s) 2024-06-18T02:08:36.094 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:36 smithi130 ceph-mon[26123]: [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2024-06-18T02:08:36.094 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:36 smithi130 ceph-mon[26123]: daemon iscsi.foo.smithi007.xvdrwd on smithi007 is in unknown state 2024-06-18T02:08:36.094 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:36 smithi130 ceph-mon[26123]: from='mgr.25202 ' entity='' 2024-06-18T02:08:36.095 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:36 smithi130 ceph-mon[26123]: mgrmap e38: x(active, since 28s), standbys: y 2024-06-18T02:08:36.095 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:36 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ignoring --setuser ceph since I am not root 2024-06-18T02:08:36.095 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:36 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ignoring --setgroup ceph since I am not root 2024-06-18T02:08:36.095 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:36 smithi130 ceph-mgr[59538]: -- 172.21.15.130:0/1701279576 <== mon.0 v2:172.21.15.7:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5641ac4f10e0 con 0x5641ac4cf000 2024-06-18T02:08:36.318 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:36 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: ignoring --setuser ceph since I am not root 2024-06-18T02:08:36.318 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:36 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: ignoring --setgroup ceph since I am not root 2024-06-18T02:08:36.318 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:36 smithi007 ceph-mgr[65903]: -- 172.21.15.7:0/1721377168 <== mon.0 v2:172.21.15.7:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555f572ab0e0 con 0x555f57289400 2024-06-18T02:08:36.319 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:36 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:08:36.157+0000 7fe12877d040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-18T02:08:36.319 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:36 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:08:36.318+0000 7fe12877d040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-18T02:08:36.319 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:36 smithi007 ceph-mon[29879]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-06-18T02:08:36.319 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:36 smithi007 ceph-mon[29879]: pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-06-18T02:08:36.319 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:36 smithi007 ceph-mon[29879]: mon.a calling monitor election 2024-06-18T02:08:36.319 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:36 smithi007 ceph-mon[29879]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-06-18T02:08:36.319 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:36 smithi007 ceph-mon[29879]: from='client.? ' entity='' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/2713795336"}]: dispatch 2024-06-18T02:08:36.319 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:36 smithi007 ceph-mon[29879]: monmap epoch 3 2024-06-18T02:08:36.320 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:36 smithi007 ceph-mon[29879]: fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 2024-06-18T02:08:36.320 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:36 smithi007 ceph-mon[29879]: last_changed 2024-06-18T01:57:18.881740+0000 2024-06-18T02:08:36.320 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:36 smithi007 ceph-mon[29879]: created 2024-06-18T01:55:37.939231+0000 2024-06-18T02:08:36.320 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:36 smithi007 ceph-mon[29879]: min_mon_release 17 (quincy) 2024-06-18T02:08:36.320 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:36 smithi007 ceph-mon[29879]: election_strategy: 1 2024-06-18T02:08:36.320 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:36 smithi007 ceph-mon[29879]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-06-18T02:08:36.321 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:36 smithi007 ceph-mon[29879]: 1: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-06-18T02:08:36.321 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:36 smithi007 ceph-mon[29879]: 2: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-06-18T02:08:36.321 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:36 smithi007 ceph-mon[29879]: fsmap 2024-06-18T02:08:36.321 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:36 smithi007 ceph-mon[29879]: osdmap e112: 8 total, 8 up, 8 in 2024-06-18T02:08:36.321 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:36 smithi007 ceph-mon[29879]: mgrmap e37: x(active, since 28s), standbys: y 2024-06-18T02:08:36.321 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:36 smithi007 ceph-mon[29879]: Health detail: HEALTH_WARN 1 failed cephadm daemon(s) 2024-06-18T02:08:36.321 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:36 smithi007 ceph-mon[29879]: [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2024-06-18T02:08:36.321 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:36 smithi007 ceph-mon[29879]: daemon iscsi.foo.smithi007.xvdrwd on smithi007 is in unknown state 2024-06-18T02:08:36.321 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:36 smithi007 ceph-mon[29879]: from='mgr.25202 ' entity='' 2024-06-18T02:08:36.321 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:36 smithi007 ceph-mon[29879]: mgrmap e38: x(active, since 28s), standbys: y 2024-06-18T02:08:36.322 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:36 smithi007 ceph-mon[73500]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-06-18T02:08:36.322 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:36 smithi007 ceph-mon[73500]: pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-06-18T02:08:36.322 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:36 smithi007 ceph-mon[73500]: mon.a calling monitor election 2024-06-18T02:08:36.322 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:36 smithi007 ceph-mon[73500]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-06-18T02:08:36.322 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:36 smithi007 ceph-mon[73500]: from='client.? ' entity='' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/2713795336"}]: dispatch 2024-06-18T02:08:36.322 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:36 smithi007 ceph-mon[73500]: monmap epoch 3 2024-06-18T02:08:36.322 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:36 smithi007 ceph-mon[73500]: fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 2024-06-18T02:08:36.322 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:36 smithi007 ceph-mon[73500]: last_changed 2024-06-18T01:57:18.881740+0000 2024-06-18T02:08:36.322 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:36 smithi007 ceph-mon[73500]: created 2024-06-18T01:55:37.939231+0000 2024-06-18T02:08:36.322 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:36 smithi007 ceph-mon[73500]: min_mon_release 17 (quincy) 2024-06-18T02:08:36.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:36 smithi007 ceph-mon[73500]: election_strategy: 1 2024-06-18T02:08:36.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:36 smithi007 ceph-mon[73500]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-06-18T02:08:36.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:36 smithi007 ceph-mon[73500]: 1: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-06-18T02:08:36.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:36 smithi007 ceph-mon[73500]: 2: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-06-18T02:08:36.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:36 smithi007 ceph-mon[73500]: fsmap 2024-06-18T02:08:36.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:36 smithi007 ceph-mon[73500]: osdmap e112: 8 total, 8 up, 8 in 2024-06-18T02:08:36.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:36 smithi007 ceph-mon[73500]: mgrmap e37: x(active, since 28s), standbys: y 2024-06-18T02:08:36.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:36 smithi007 ceph-mon[73500]: Health detail: HEALTH_WARN 1 failed cephadm daemon(s) 2024-06-18T02:08:36.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:36 smithi007 ceph-mon[73500]: [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2024-06-18T02:08:36.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:36 smithi007 ceph-mon[73500]: daemon iscsi.foo.smithi007.xvdrwd on smithi007 is in unknown state 2024-06-18T02:08:36.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:36 smithi007 ceph-mon[73500]: from='mgr.25202 ' entity='' 2024-06-18T02:08:36.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:36 smithi007 ceph-mon[73500]: mgrmap e38: x(active, since 28s), standbys: y 2024-06-18T02:08:36.379 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:36 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:36.144+0000 7f68701f0040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-18T02:08:36.379 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:36 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:36.306+0000 7f68701f0040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-18T02:08:36.379 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:36 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:36.378+0000 7f68701f0040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-18T02:08:36.573 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:36 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:08:36.395+0000 7fe12877d040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-18T02:08:36.931 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:36 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:08:36.663+0000 7fe12877d040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-18T02:08:36.932 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:36 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:08:36.730+0000 7fe12877d040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-18T02:08:37.041 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:36 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:36.637+0000 7f68701f0040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-18T02:08:37.041 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:36 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:36.699+0000 7f68701f0040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-18T02:08:37.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:37 smithi130 ceph-mon[26123]: from='client.? ' entity='' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/2713795336"}]': finished 2024-06-18T02:08:37.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:37 smithi130 ceph-mon[26123]: osdmap e113: 8 total, 8 up, 8 in 2024-06-18T02:08:37.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:37 smithi130 ceph-mon[26123]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/3564092444"}]: dispatch 2024-06-18T02:08:37.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:37 smithi130 ceph-mon[26123]: mgrmap e39: x(active, since 29s), standbys: y 2024-06-18T02:08:37.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:37 smithi007 ceph-mon[73500]: from='client.? ' entity='' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/2713795336"}]': finished 2024-06-18T02:08:37.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:37 smithi007 ceph-mon[73500]: osdmap e113: 8 total, 8 up, 8 in 2024-06-18T02:08:37.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:37 smithi007 ceph-mon[73500]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/3564092444"}]: dispatch 2024-06-18T02:08:37.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:37 smithi007 ceph-mon[73500]: mgrmap e39: x(active, since 29s), standbys: y 2024-06-18T02:08:37.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:37 smithi007 ceph-mon[29879]: from='client.? ' entity='' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/2713795336"}]': finished 2024-06-18T02:08:37.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:37 smithi007 ceph-mon[29879]: osdmap e113: 8 total, 8 up, 8 in 2024-06-18T02:08:37.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:37 smithi007 ceph-mon[29879]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/3564092444"}]: dispatch 2024-06-18T02:08:37.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:37 smithi007 ceph-mon[29879]: mgrmap e39: x(active, since 29s), standbys: y 2024-06-18T02:08:37.873 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:37 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:08:37.748+0000 7fe12877d040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-18T02:08:38.042 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:37 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:37.704+0000 7f68701f0040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-18T02:08:38.042 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:37 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:37.827+0000 7f68701f0040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-18T02:08:38.042 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:37 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:37.886+0000 7f68701f0040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-18T02:08:38.167 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:38 smithi007 ceph-mon[73500]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/3564092444"}]': finished 2024-06-18T02:08:38.168 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:38 smithi007 ceph-mon[73500]: osdmap e114: 8 total, 8 up, 8 in 2024-06-18T02:08:38.168 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:38 smithi007 ceph-mon[29879]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/3564092444"}]': finished 2024-06-18T02:08:38.168 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:38 smithi007 ceph-mon[29879]: osdmap e114: 8 total, 8 up, 8 in 2024-06-18T02:08:38.168 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:37 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:08:37.874+0000 7fe12877d040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-18T02:08:38.168 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:37 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:08:37.936+0000 7fe12877d040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-18T02:08:38.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:38 smithi130 ceph-mon[26123]: from='client.? ' entity='client.iscsi.foo.smithi007.xvdrwd' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.7:0/3564092444"}]': finished 2024-06-18T02:08:38.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:38 smithi130 ceph-mon[26123]: osdmap e114: 8 total, 8 up, 8 in 2024-06-18T02:08:38.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:38 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:38.115+0000 7f68701f0040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-18T02:08:38.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:38 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:38.179+0000 7f68701f0040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-18T02:08:38.294 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:38 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:38.249+0000 7f68701f0040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-18T02:08:38.431 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:38 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:08:38.168+0000 7fe12877d040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-18T02:08:38.431 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:38 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:08:38.233+0000 7fe12877d040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-18T02:08:38.432 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:38 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:08:38.306+0000 7fe12877d040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-18T02:08:38.791 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:38 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:38.407+0000 7f68701f0040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-18T02:08:38.915 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:38 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:08:38.464+0000 7fe12877d040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-18T02:08:39.043 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:38 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:38.860+0000 7f68701f0040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-18T02:08:39.181 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:38 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:08:38.915+0000 7fe12877d040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-18T02:08:39.478 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:39 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:08:39.267+0000 7fe12877d040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-18T02:08:39.478 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:39 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:08:39.342+0000 7fe12877d040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-18T02:08:39.543 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:39.221+0000 7f68701f0040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-18T02:08:39.543 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:39.293+0000 7f68701f0040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-18T02:08:39.543 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:39.446+0000 7f68701f0040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-18T02:08:39.831 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:39 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:08:39.511+0000 7fe12877d040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-18T02:08:40.019 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:39.767+0000 7f68701f0040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-18T02:08:40.019 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:39.831+0000 7f68701f0040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-18T02:08:40.122 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:39 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:08:39.854+0000 7fe12877d040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-18T02:08:40.123 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:39 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:08:39.921+0000 7fe12877d040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-18T02:08:40.123 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:40 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:08:40.122+0000 7fe12877d040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-18T02:08:40.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:40 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:40.019+0000 7f68701f0040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-18T02:08:40.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:40 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:40.170+0000 7f68701f0040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-18T02:08:40.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:40 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:40.235+0000 7f68701f0040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-18T02:08:40.406 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:40 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:08:40.282+0000 7fe12877d040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-18T02:08:40.406 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:40 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:08:40.359+0000 7fe12877d040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-18T02:08:40.681 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:40 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:08:40.451+0000 7fe12877d040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-18T02:08:40.682 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:40 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:08:40.517+0000 7fe12877d040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-18T02:08:40.793 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:40 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:40.322+0000 7f68701f0040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-18T02:08:40.793 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:40 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:40.382+0000 7f68701f0040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-18T02:08:41.195 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:40 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:40.939+0000 7f68701f0040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-18T02:08:41.195 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:41 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:41.111+0000 7f68701f0040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-18T02:08:41.195 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:41 smithi130 ceph-mon[26123]: Active manager daemon x restarted 2024-06-18T02:08:41.195 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:41 smithi130 ceph-mon[26123]: Activating manager daemon x 2024-06-18T02:08:41.195 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:41 smithi130 ceph-mon[26123]: osdmap e115: 8 total, 8 up, 8 in 2024-06-18T02:08:41.195 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:41 smithi130 ceph-mon[26123]: mgrmap e40: x(active, starting, since 0.00844329s), standbys: y 2024-06-18T02:08:41.195 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:41 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-18T02:08:41.195 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:41 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-18T02:08:41.196 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:41 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-18T02:08:41.196 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:41 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-06-18T02:08:41.196 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:41 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-06-18T02:08:41.196 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:41 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-18T02:08:41.196 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:41 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-18T02:08:41.196 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:41 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-18T02:08:41.196 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:41 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-18T02:08:41.196 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:41 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-18T02:08:41.196 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:41 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-18T02:08:41.196 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:41 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-18T02:08:41.197 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:41 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-18T02:08:41.197 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:41 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-18T02:08:41.197 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:41 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-18T02:08:41.197 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:41 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-18T02:08:41.197 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:41 smithi130 ceph-mon[26123]: Manager daemon x is now available 2024-06-18T02:08:41.381 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:41 smithi007 ceph-mon[73500]: Active manager daemon x restarted 2024-06-18T02:08:41.381 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:41 smithi007 ceph-mon[73500]: Activating manager daemon x 2024-06-18T02:08:41.381 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:41 smithi007 ceph-mon[73500]: osdmap e115: 8 total, 8 up, 8 in 2024-06-18T02:08:41.381 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:41 smithi007 ceph-mon[73500]: mgrmap e40: x(active, starting, since 0.00844329s), standbys: y 2024-06-18T02:08:41.381 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:41 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-18T02:08:41.382 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:41 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-18T02:08:41.382 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:41 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-18T02:08:41.382 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:41 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-06-18T02:08:41.382 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:41 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-06-18T02:08:41.382 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:41 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-18T02:08:41.382 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:41 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-18T02:08:41.382 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:41 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-18T02:08:41.382 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:41 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-18T02:08:41.382 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:41 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-18T02:08:41.382 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:41 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-18T02:08:41.382 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:41 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-18T02:08:41.382 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:41 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-18T02:08:41.382 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:41 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-18T02:08:41.383 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:41 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-18T02:08:41.383 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:41 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-18T02:08:41.383 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:41 smithi007 ceph-mon[73500]: Manager daemon x is now available 2024-06-18T02:08:41.383 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:41 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:08:41.115+0000 7fe12877d040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-18T02:08:41.383 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:41 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:08:41.318+0000 7fe12877d040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-18T02:08:41.383 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:41 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: [18/Jun/2024:02:08:41] ENGINE Bus STARTING 2024-06-18T02:08:41.383 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:41 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: CherryPy Checker: 2024-06-18T02:08:41.383 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:41 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: The Application mounted at '' has an empty config. 2024-06-18T02:08:41.383 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:41 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: 2024-06-18T02:08:41.384 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:41 smithi007 ceph-mon[29879]: Active manager daemon x restarted 2024-06-18T02:08:41.384 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:41 smithi007 ceph-mon[29879]: Activating manager daemon x 2024-06-18T02:08:41.384 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:41 smithi007 ceph-mon[29879]: osdmap e115: 8 total, 8 up, 8 in 2024-06-18T02:08:41.384 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:41 smithi007 ceph-mon[29879]: mgrmap e40: x(active, starting, since 0.00844329s), standbys: y 2024-06-18T02:08:41.384 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:41 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-18T02:08:41.384 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:41 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-18T02:08:41.384 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:41 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-18T02:08:41.384 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:41 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-06-18T02:08:41.384 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:41 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-06-18T02:08:41.384 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:41 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-18T02:08:41.384 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:41 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-18T02:08:41.384 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:41 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-18T02:08:41.384 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:41 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-18T02:08:41.384 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:41 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-18T02:08:41.385 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:41 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-18T02:08:41.385 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:41 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-18T02:08:41.385 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:41 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-18T02:08:41.385 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:41 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-18T02:08:41.385 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:41 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-18T02:08:41.385 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:41 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-18T02:08:41.385 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:41 smithi007 ceph-mon[29879]: Manager daemon x is now available 2024-06-18T02:08:41.543 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:41 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: [18/Jun/2024:02:08:41] ENGINE Bus STARTING 2024-06-18T02:08:41.543 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:41 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: CherryPy Checker: 2024-06-18T02:08:41.543 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:41 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: The Application mounted at '' has an empty config. 2024-06-18T02:08:41.544 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:41 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:41.544 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:41 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: [18/Jun/2024:02:08:41] ENGINE Serving on http://:::9283 2024-06-18T02:08:41.544 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:41 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: [18/Jun/2024:02:08:41] ENGINE Bus STARTED 2024-06-18T02:08:41.681 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:41 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: [18/Jun/2024:02:08:41] ENGINE Serving on http://:::9283 2024-06-18T02:08:41.681 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:41 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[65897]: [18/Jun/2024:02:08:41] ENGINE Bus STARTED 2024-06-18T02:08:42.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:42 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:42.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:42 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi007", "caps": []}]: dispatch 2024-06-18T02:08:42.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:42 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi130", "caps": []}]: dispatch 2024-06-18T02:08:42.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:42 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi007", "caps": []}]: dispatch 2024-06-18T02:08:42.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:42 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi130", "caps": []}]: dispatch 2024-06-18T02:08:42.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:42 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-06-18T02:08:42.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:42 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-06-18T02:08:42.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:42 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:42.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:42 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:08:42.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:42 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-06-18T02:08:42.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:42 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-06-18T02:08:42.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:42 smithi007 ceph-mon[73500]: Standby manager daemon y restarted 2024-06-18T02:08:42.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:42 smithi007 ceph-mon[73500]: Standby manager daemon y started 2024-06-18T02:08:42.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:42 smithi007 ceph-mon[73500]: from='mgr.? 172.21.15.7:0/289058176' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-06-18T02:08:42.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:42 smithi007 ceph-mon[73500]: from='mgr.? 172.21.15.7:0/289058176' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-18T02:08:42.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:42 smithi007 ceph-mon[73500]: from='mgr.? 172.21.15.7:0/289058176' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-06-18T02:08:42.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:42 smithi007 ceph-mon[73500]: from='mgr.? 172.21.15.7:0/289058176' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-18T02:08:42.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:42 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi130", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:08:42.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:42 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi130", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:08:42.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:42 smithi007 ceph-mon[73500]: mgrmap e41: x(active, since 1.00937s), standbys: y 2024-06-18T02:08:42.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:42 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:42.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:42 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi007", "caps": []}]: dispatch 2024-06-18T02:08:42.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:42 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi130", "caps": []}]: dispatch 2024-06-18T02:08:42.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:42 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi007", "caps": []}]: dispatch 2024-06-18T02:08:42.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:42 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi130", "caps": []}]: dispatch 2024-06-18T02:08:42.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:42 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-06-18T02:08:42.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:42 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-06-18T02:08:42.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:42 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:42.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:42 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:08:42.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:42 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-06-18T02:08:42.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:42 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-06-18T02:08:42.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:42 smithi007 ceph-mon[29879]: Standby manager daemon y restarted 2024-06-18T02:08:42.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:42 smithi007 ceph-mon[29879]: Standby manager daemon y started 2024-06-18T02:08:42.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:42 smithi007 ceph-mon[29879]: from='mgr.? 172.21.15.7:0/289058176' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-06-18T02:08:42.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:42 smithi007 ceph-mon[29879]: from='mgr.? 172.21.15.7:0/289058176' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-18T02:08:42.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:42 smithi007 ceph-mon[29879]: from='mgr.? 172.21.15.7:0/289058176' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-06-18T02:08:42.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:42 smithi007 ceph-mon[29879]: from='mgr.? 172.21.15.7:0/289058176' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-18T02:08:42.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:42 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi130", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:08:42.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:42 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi130", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:08:42.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:42 smithi007 ceph-mon[29879]: mgrmap e41: x(active, since 1.00937s), standbys: y 2024-06-18T02:08:42.510 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:42 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:42.124+0000 7f680f9b8640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-06-18T02:08:42.510 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:42 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:42.510 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:42 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi007", "caps": []}]: dispatch 2024-06-18T02:08:42.511 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:42 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi130", "caps": []}]: dispatch 2024-06-18T02:08:42.511 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:42 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi007", "caps": []}]: dispatch 2024-06-18T02:08:42.511 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:42 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi130", "caps": []}]: dispatch 2024-06-18T02:08:42.511 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:42 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-06-18T02:08:42.511 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:42 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-06-18T02:08:42.511 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:42 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:42.511 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:42 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:08:42.511 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:42 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-06-18T02:08:42.511 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:42 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-06-18T02:08:42.511 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:42 smithi130 ceph-mon[26123]: Standby manager daemon y restarted 2024-06-18T02:08:42.511 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:42 smithi130 ceph-mon[26123]: Standby manager daemon y started 2024-06-18T02:08:42.511 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:42 smithi130 ceph-mon[26123]: from='mgr.? 172.21.15.7:0/289058176' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-06-18T02:08:42.512 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:42 smithi130 ceph-mon[26123]: from='mgr.? 172.21.15.7:0/289058176' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-18T02:08:42.512 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:42 smithi130 ceph-mon[26123]: from='mgr.? 172.21.15.7:0/289058176' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-06-18T02:08:42.512 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:42 smithi130 ceph-mon[26123]: from='mgr.? 172.21.15.7:0/289058176' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-18T02:08:42.512 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:42 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi130", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:08:42.512 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:42 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi130", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:08:42.512 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:42 smithi130 ceph-mon[26123]: mgrmap e41: x(active, since 1.00937s), standbys: y 2024-06-18T02:08:42.793 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:42 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:42.737+0000 7f67ce5bc640 -1 log_channel(cephadm) log [ERR] : [18/Jun/2024:02:08:42] ENGINE Error in HTTPServer.serve 2024-06-18T02:08:42.794 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:42 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: Traceback (most recent call last): 2024-06-18T02:08:42.794 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:42 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-06-18T02:08:42.794 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:42 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: self._connections.run(self.expiration_interval) 2024-06-18T02:08:42.794 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:42 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-06-18T02:08:42.794 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:42 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: self._run(expiration_interval) 2024-06-18T02:08:42.794 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:42 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-06-18T02:08:42.794 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:42 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: new_conn = self._from_server_socket(self.server.socket) 2024-06-18T02:08:42.794 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:42 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-06-18T02:08:42.794 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:42 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-06-18T02:08:42.794 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:42 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-06-18T02:08:42.794 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:42 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: s = self.context.wrap_socket( 2024-06-18T02:08:42.794 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:42 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-06-18T02:08:42.795 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:42 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: return self.sslsocket_class._create( 2024-06-18T02:08:42.795 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:42 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-06-18T02:08:42.795 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:42 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: self.do_handshake() 2024-06-18T02:08:42.795 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:42 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-06-18T02:08:42.795 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:42 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: self._sslobj.do_handshake() 2024-06-18T02:08:42.795 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:42 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1129) 2024-06-18T02:08:42.795 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:42 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:43.762 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:43 smithi130 ceph-mon[26123]: [18/Jun/2024:02:08:42] ENGINE Bus STARTING 2024-06-18T02:08:43.762 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:43 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:43.762 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:43 smithi130 ceph-mon[26123]: [18/Jun/2024:02:08:42] ENGINE Serving on http://172.21.15.130:8765 2024-06-18T02:08:43.762 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:43 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:43.762 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:43 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:43.762 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:43 smithi130 ceph-mon[26123]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:08:43.762 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:43 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:43.762 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:43 smithi130 ceph-mon[26123]: [18/Jun/2024:02:08:42] ENGINE Serving on https://172.21.15.130:7150 2024-06-18T02:08:43.762 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:43 smithi130 ceph-mon[26123]: [18/Jun/2024:02:08:42] ENGINE Bus STARTED 2024-06-18T02:08:43.763 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:43 smithi130 ceph-mon[26123]: [18/Jun/2024:02:08:42] ENGINE Error in HTTPServer.serve 2024-06-18T02:08:43.763 INFO:journalctl@ceph.mon.b.smithi130.stdout: Traceback (most recent call last): 2024-06-18T02:08:43.763 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-06-18T02:08:43.763 INFO:journalctl@ceph.mon.b.smithi130.stdout: self._connections.run(self.expiration_interval) 2024-06-18T02:08:43.763 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-06-18T02:08:43.763 INFO:journalctl@ceph.mon.b.smithi130.stdout: self._run(expiration_interval) 2024-06-18T02:08:43.763 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-06-18T02:08:43.763 INFO:journalctl@ceph.mon.b.smithi130.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-06-18T02:08:43.763 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-06-18T02:08:43.763 INFO:journalctl@ceph.mon.b.smithi130.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-06-18T02:08:43.763 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-06-18T02:08:43.763 INFO:journalctl@ceph.mon.b.smithi130.stdout: s = self.context.wrap_socket( 2024-06-18T02:08:43.763 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-06-18T02:08:43.763 INFO:journalctl@ceph.mon.b.smithi130.stdout: return self.sslsocket_class._create( 2024-06-18T02:08:43.764 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-06-18T02:08:43.764 INFO:journalctl@ceph.mon.b.smithi130.stdout: self.do_handshake() 2024-06-18T02:08:43.764 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-06-18T02:08:43.764 INFO:journalctl@ceph.mon.b.smithi130.stdout: self._sslobj.do_handshake() 2024-06-18T02:08:43.764 INFO:journalctl@ceph.mon.b.smithi130.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1129) 2024-06-18T02:08:43.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:43 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi007", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:08:43.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:43 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi007", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:08:43.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:43 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:08:43.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:43 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:08:43.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:43 smithi130 ceph-mon[26123]: Updating smithi007:/etc/ceph/ceph.conf 2024-06-18T02:08:43.764 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:43 smithi130 ceph-mon[26123]: Updating smithi130:/etc/ceph/ceph.conf 2024-06-18T02:08:43.764 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:43 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:08:43.505Z caller=manager.go:609 level=warn component="rule manager" group=nodes msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on(instance) group_left(nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi007\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"cd9a3408-2d15-11ef-bc9d-c7b262605968\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-06-18T02:08:43.864 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:43 smithi007 ceph-mon[73500]: [18/Jun/2024:02:08:42] ENGINE Bus STARTING 2024-06-18T02:08:43.864 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:43 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:43.864 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:43 smithi007 ceph-mon[73500]: [18/Jun/2024:02:08:42] ENGINE Serving on http://172.21.15.130:8765 2024-06-18T02:08:43.864 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:43 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:43.864 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:43 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:43.865 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:43 smithi007 ceph-mon[73500]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:08:43.865 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:43 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:43.865 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:43 smithi007 ceph-mon[73500]: [18/Jun/2024:02:08:42] ENGINE Serving on https://172.21.15.130:7150 2024-06-18T02:08:43.865 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:43 smithi007 ceph-mon[73500]: [18/Jun/2024:02:08:42] ENGINE Bus STARTED 2024-06-18T02:08:43.865 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:43 smithi007 ceph-mon[73500]: [18/Jun/2024:02:08:42] ENGINE Error in HTTPServer.serve 2024-06-18T02:08:43.865 INFO:journalctl@ceph.mon.a.smithi007.stdout: Traceback (most recent call last): 2024-06-18T02:08:43.865 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-06-18T02:08:43.865 INFO:journalctl@ceph.mon.a.smithi007.stdout: self._connections.run(self.expiration_interval) 2024-06-18T02:08:43.865 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-06-18T02:08:43.865 INFO:journalctl@ceph.mon.a.smithi007.stdout: self._run(expiration_interval) 2024-06-18T02:08:43.865 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-06-18T02:08:43.866 INFO:journalctl@ceph.mon.a.smithi007.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-06-18T02:08:43.866 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-06-18T02:08:43.866 INFO:journalctl@ceph.mon.a.smithi007.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-06-18T02:08:43.866 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-06-18T02:08:43.866 INFO:journalctl@ceph.mon.a.smithi007.stdout: s = self.context.wrap_socket( 2024-06-18T02:08:43.866 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-06-18T02:08:43.866 INFO:journalctl@ceph.mon.a.smithi007.stdout: return self.sslsocket_class._create( 2024-06-18T02:08:43.866 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-06-18T02:08:43.866 INFO:journalctl@ceph.mon.a.smithi007.stdout: self.do_handshake() 2024-06-18T02:08:43.866 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-06-18T02:08:43.866 INFO:journalctl@ceph.mon.a.smithi007.stdout: self._sslobj.do_handshake() 2024-06-18T02:08:43.866 INFO:journalctl@ceph.mon.a.smithi007.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1129) 2024-06-18T02:08:43.866 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:43 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi007", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:08:43.867 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:43 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi007", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:08:43.867 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:43 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:08:43.867 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:43 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:08:43.867 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:43 smithi007 ceph-mon[73500]: Updating smithi007:/etc/ceph/ceph.conf 2024-06-18T02:08:43.867 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:43 smithi007 ceph-mon[73500]: Updating smithi130:/etc/ceph/ceph.conf 2024-06-18T02:08:43.867 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:43 smithi007 ceph-mon[29879]: [18/Jun/2024:02:08:42] ENGINE Bus STARTING 2024-06-18T02:08:43.867 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:43 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:43.867 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:43 smithi007 ceph-mon[29879]: [18/Jun/2024:02:08:42] ENGINE Serving on http://172.21.15.130:8765 2024-06-18T02:08:43.867 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:43 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:43.867 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:43 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:43.867 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:43 smithi007 ceph-mon[29879]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:08:43.867 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:43 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:43.867 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:43 smithi007 ceph-mon[29879]: [18/Jun/2024:02:08:42] ENGINE Serving on https://172.21.15.130:7150 2024-06-18T02:08:43.868 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:43 smithi007 ceph-mon[29879]: [18/Jun/2024:02:08:42] ENGINE Bus STARTED 2024-06-18T02:08:43.868 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:43 smithi007 ceph-mon[29879]: [18/Jun/2024:02:08:42] ENGINE Error in HTTPServer.serve 2024-06-18T02:08:43.868 INFO:journalctl@ceph.mon.c.smithi007.stdout: Traceback (most recent call last): 2024-06-18T02:08:43.868 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-06-18T02:08:43.868 INFO:journalctl@ceph.mon.c.smithi007.stdout: self._connections.run(self.expiration_interval) 2024-06-18T02:08:43.868 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-06-18T02:08:43.868 INFO:journalctl@ceph.mon.c.smithi007.stdout: self._run(expiration_interval) 2024-06-18T02:08:43.868 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-06-18T02:08:43.868 INFO:journalctl@ceph.mon.c.smithi007.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-06-18T02:08:43.868 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-06-18T02:08:43.868 INFO:journalctl@ceph.mon.c.smithi007.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-06-18T02:08:43.868 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-06-18T02:08:43.868 INFO:journalctl@ceph.mon.c.smithi007.stdout: s = self.context.wrap_socket( 2024-06-18T02:08:43.868 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-06-18T02:08:43.868 INFO:journalctl@ceph.mon.c.smithi007.stdout: return self.sslsocket_class._create( 2024-06-18T02:08:43.869 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-06-18T02:08:43.869 INFO:journalctl@ceph.mon.c.smithi007.stdout: self.do_handshake() 2024-06-18T02:08:43.869 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-06-18T02:08:43.869 INFO:journalctl@ceph.mon.c.smithi007.stdout: self._sslobj.do_handshake() 2024-06-18T02:08:43.869 INFO:journalctl@ceph.mon.c.smithi007.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1129) 2024-06-18T02:08:43.869 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:43 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi007", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:08:43.869 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:43 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi007", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:08:43.869 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:43 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:08:43.869 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:43 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:08:43.869 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:43 smithi007 ceph-mon[29879]: Updating smithi007:/etc/ceph/ceph.conf 2024-06-18T02:08:43.869 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:43 smithi007 ceph-mon[29879]: Updating smithi130:/etc/ceph/ceph.conf 2024-06-18T02:08:44.718 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:44 smithi007 ceph-mon[73500]: Updating smithi130:/var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/config/ceph.conf 2024-06-18T02:08:44.719 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:44 smithi007 ceph-mon[73500]: Updating smithi007:/var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/config/ceph.conf 2024-06-18T02:08:44.719 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:44 smithi007 ceph-mon[73500]: Updating smithi130:/etc/ceph/ceph.client.admin.keyring 2024-06-18T02:08:44.719 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:44 smithi007 ceph-mon[73500]: Updating smithi007:/etc/ceph/ceph.client.admin.keyring 2024-06-18T02:08:44.719 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:44 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:44.719 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:44 smithi007 ceph-mon[73500]: mgrmap e42: x(active, since 2s), standbys: y 2024-06-18T02:08:44.719 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:44 smithi007 ceph-mon[73500]: Updating smithi130:/var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/config/ceph.client.admin.keyring 2024-06-18T02:08:44.719 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:44 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:44.719 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:44 smithi007 ceph-mon[73500]: Updating smithi007:/var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/config/ceph.client.admin.keyring 2024-06-18T02:08:44.719 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:44 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:44.719 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:44 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:44.719 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:44 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:44.720 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:44 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:44.720 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:44 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:44.720 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:44 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:44.720 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:44 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:44.720 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:44 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:44.720 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:44 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi007.xvdrwd", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-06-18T02:08:44.720 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:44 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi007.xvdrwd", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-06-18T02:08:44.720 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:44 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:08:44.720 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:44 smithi007 ceph-mon[29879]: Updating smithi130:/var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/config/ceph.conf 2024-06-18T02:08:44.720 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:44 smithi007 ceph-mon[29879]: Updating smithi007:/var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/config/ceph.conf 2024-06-18T02:08:44.721 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:44 smithi007 ceph-mon[29879]: Updating smithi130:/etc/ceph/ceph.client.admin.keyring 2024-06-18T02:08:44.721 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:44 smithi007 ceph-mon[29879]: Updating smithi007:/etc/ceph/ceph.client.admin.keyring 2024-06-18T02:08:44.721 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:44 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:44.721 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:44 smithi007 ceph-mon[29879]: mgrmap e42: x(active, since 2s), standbys: y 2024-06-18T02:08:44.721 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:44 smithi007 ceph-mon[29879]: Updating smithi130:/var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/config/ceph.client.admin.keyring 2024-06-18T02:08:44.721 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:44 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:44.721 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:44 smithi007 ceph-mon[29879]: Updating smithi007:/var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/config/ceph.client.admin.keyring 2024-06-18T02:08:44.721 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:44 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:44.721 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:44 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:44.721 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:44 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:44.721 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:44 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:44.721 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:44 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:44.721 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:44 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:44.722 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:44 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:44.722 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:44 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:44.722 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:44 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi007.xvdrwd", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-06-18T02:08:44.722 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:44 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi007.xvdrwd", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-06-18T02:08:44.722 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:44 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:08:44.722 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:44 smithi130 ceph-mon[26123]: Updating smithi130:/var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/config/ceph.conf 2024-06-18T02:08:44.722 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:44 smithi130 ceph-mon[26123]: Updating smithi007:/var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/config/ceph.conf 2024-06-18T02:08:44.722 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:44 smithi130 ceph-mon[26123]: Updating smithi130:/etc/ceph/ceph.client.admin.keyring 2024-06-18T02:08:44.722 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:44 smithi130 ceph-mon[26123]: Updating smithi007:/etc/ceph/ceph.client.admin.keyring 2024-06-18T02:08:44.722 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:44 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:44.723 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:44 smithi130 ceph-mon[26123]: mgrmap e42: x(active, since 2s), standbys: y 2024-06-18T02:08:44.723 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:44 smithi130 ceph-mon[26123]: Updating smithi130:/var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/config/ceph.client.admin.keyring 2024-06-18T02:08:44.723 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:44 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:44.723 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:44 smithi130 ceph-mon[26123]: Updating smithi007:/var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/config/ceph.client.admin.keyring 2024-06-18T02:08:44.723 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:44 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:44.723 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:44 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:44.723 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:44 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:44.723 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:44 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:44.723 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:44 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:44.723 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:44 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:44.723 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:44 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:44.723 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:44 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:44.723 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:44 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi007.xvdrwd", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-06-18T02:08:44.724 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:44 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi007.xvdrwd", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-06-18T02:08:44.724 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:44 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:08:45.774 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:45 smithi007 ceph-mon[73500]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:08:45.775 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:45 smithi007 ceph-mon[73500]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:08:45.775 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:45 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:08:45.775 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:45 smithi007 ceph-mon[73500]: Reconfiguring iscsi.foo.smithi007.xvdrwd (dependencies changed)... 2024-06-18T02:08:45.775 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:45 smithi007 ceph-mon[73500]: Reconfiguring daemon iscsi.foo.smithi007.xvdrwd on smithi007 2024-06-18T02:08:45.775 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:45 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:45.775 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:45 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:45.775 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:45 smithi007 ceph-mon[73500]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:08:45.775 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:45 smithi007 ceph-mon[73500]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:08:45.775 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:45 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:45.775 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:45 smithi007 ceph-mon[29879]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:08:45.775 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:45 smithi007 ceph-mon[29879]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:08:45.775 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:45 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:08:45.776 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:45 smithi007 ceph-mon[29879]: Reconfiguring iscsi.foo.smithi007.xvdrwd (dependencies changed)... 2024-06-18T02:08:45.776 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:45 smithi007 ceph-mon[29879]: Reconfiguring daemon iscsi.foo.smithi007.xvdrwd on smithi007 2024-06-18T02:08:45.776 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:45 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:45.776 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:45 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:45.776 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:45 smithi007 ceph-mon[29879]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:08:45.776 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:45 smithi007 ceph-mon[29879]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:08:45.776 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:45 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:45.895 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:45 smithi130 ceph-mon[26123]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:08:45.895 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:45 smithi130 ceph-mon[26123]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:08:45.896 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:45 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:08:45.896 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:45 smithi130 ceph-mon[26123]: Reconfiguring iscsi.foo.smithi007.xvdrwd (dependencies changed)... 2024-06-18T02:08:45.896 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:45 smithi130 ceph-mon[26123]: Reconfiguring daemon iscsi.foo.smithi007.xvdrwd on smithi007 2024-06-18T02:08:45.896 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:45 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:45.896 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:45 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:45.896 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:45 smithi130 ceph-mon[26123]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:08:45.896 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:45 smithi130 ceph-mon[26123]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:08:45.896 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:45 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:47.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:47 smithi007 ceph-mon[73500]: mgrmap e43: x(active, since 4s), standbys: y 2024-06-18T02:08:47.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:47 smithi007 ceph-mon[73500]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:08:47.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:47 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:47.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:47 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:47.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:47 smithi007 ceph-mon[73500]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:08:47.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:47 smithi007 ceph-mon[73500]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:08:47.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:47 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:47.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:47 smithi007 ceph-mon[29879]: mgrmap e43: x(active, since 4s), standbys: y 2024-06-18T02:08:47.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:47 smithi007 ceph-mon[29879]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:08:47.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:47 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:47.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:47 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:47.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:47 smithi007 ceph-mon[29879]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:08:47.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:47 smithi007 ceph-mon[29879]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:08:47.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:47 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:47.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:47 smithi130 ceph-mon[26123]: mgrmap e43: x(active, since 4s), standbys: y 2024-06-18T02:08:47.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:47 smithi130 ceph-mon[26123]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:08:47.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:47 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:47.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:47 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:47.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:47 smithi130 ceph-mon[26123]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:08:47.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:47 smithi130 ceph-mon[26123]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:08:47.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:47 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:48.119 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:47 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:08:47] "GET /metrics HTTP/1.1" 200 35435 "" "Prometheus/2.33.4" 2024-06-18T02:08:48.793 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:48 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:08:48.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.7\", device_class=\"ssd\", hostname=\"smithi007\", instance=\"172.21.15.130:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.7\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"cd9a3408-2d15-11ef-bc9d-c7b262605968\", cluster_addr=\"172.21.15.7\", device_class=\"ssd\", hostname=\"smithi007\", instance=\"smithi130:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.7\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-06-18T02:08:49.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:49 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:49.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:49 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:49.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:49 smithi130 ceph-mon[26123]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 46 KiB/s rd, 0 B/s wr, 26 op/s 2024-06-18T02:08:49.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:49 smithi130 ceph-mon[26123]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s rd, 0 B/s wr, 30 op/s 2024-06-18T02:08:49.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:49 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:49.862 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:49 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:49.863 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:49 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:49.863 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:49 smithi007 ceph-mon[73500]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 46 KiB/s rd, 0 B/s wr, 26 op/s 2024-06-18T02:08:49.863 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:49 smithi007 ceph-mon[73500]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s rd, 0 B/s wr, 30 op/s 2024-06-18T02:08:49.863 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:49 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:49.863 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:49 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:49.863 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:49 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:49.863 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:49 smithi007 ceph-mon[29879]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 46 KiB/s rd, 0 B/s wr, 26 op/s 2024-06-18T02:08:49.863 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:49 smithi007 ceph-mon[29879]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s rd, 0 B/s wr, 30 op/s 2024-06-18T02:08:49.863 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:49 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:51.294 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:08:50.931+0000 7f680195c640 -1 log_channel(cephadm) log [ERR] : cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi007.xvdrwd ... 2024-06-18T02:08:51.294 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: Creating ceph-iscsi config... 2024-06-18T02:08:51.294 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/iscsi-gateway.cfg 2024-06-18T02:08:51.294 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/tcmu-runner-entrypoint.sh 2024-06-18T02:08:51.294 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: Non-zero exit code 1 from systemctl restart ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd 2024-06-18T02:08:51.294 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: systemctl: stderr Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:08:51.295 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: systemctl: stderr See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:08:51.295 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: Traceback (most recent call last): 2024-06-18T02:08:51.295 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-06-18T02:08:51.295 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: return _run_code(code, main_globals, None, 2024-06-18T02:08:51.295 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-06-18T02:08:51.295 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: exec(code, run_globals) 2024-06-18T02:08:51.295 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5618, in 2024-06-18T02:08:51.295 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5606, in main 2024-06-18T02:08:51.295 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3096, in command_deploy_from 2024-06-18T02:08:51.295 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3131, in _common_deploy 2024-06-18T02:08:51.295 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3151, in _deploy_daemon_container 2024-06-18T02:08:51.295 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 1123, in deploy_daemon 2024-06-18T02:08:51.295 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/tmp/tmp3vdsh41i.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-06-18T02:08:51.295 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: RuntimeError: Failed command: systemctl restart ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd: Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:08:51.296 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:08:51.296 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: Traceback (most recent call last): 2024-06-18T02:08:51.297 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-06-18T02:08:51.297 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: self.mgr._daemon_action(daemon_spec, action=action) 2024-06-18T02:08:51.297 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/usr/share/ceph/mgr/cephadm/module.py", line 2456, in _daemon_action 2024-06-18T02:08:51.297 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: return self.wait_async( 2024-06-18T02:08:51.297 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/usr/share/ceph/mgr/cephadm/module.py", line 779, in wait_async 2024-06-18T02:08:51.297 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: return self.event_loop.get_result(coro, timeout) 2024-06-18T02:08:51.297 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-06-18T02:08:51.297 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: return future.result(timeout) 2024-06-18T02:08:51.297 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/lib64/python3.9/concurrent/futures/_base.py", line 446, in result 2024-06-18T02:08:51.297 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: return self.__get_result() 2024-06-18T02:08:51.298 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/lib64/python3.9/concurrent/futures/_base.py", line 391, in __get_result 2024-06-18T02:08:51.298 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: raise self._exception 2024-06-18T02:08:51.298 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1350, in _create_daemon 2024-06-18T02:08:51.298 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: out, err, code = await self._run_cephadm( 2024-06-18T02:08:51.298 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1691, in _run_cephadm 2024-06-18T02:08:51.298 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: raise OrchestratorError( 2024-06-18T02:08:51.298 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi007.xvdrwd ... 2024-06-18T02:08:51.298 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: Creating ceph-iscsi config... 2024-06-18T02:08:51.298 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/iscsi-gateway.cfg 2024-06-18T02:08:51.298 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/tcmu-runner-entrypoint.sh 2024-06-18T02:08:51.298 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: Non-zero exit code 1 from systemctl restart ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd 2024-06-18T02:08:51.298 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: systemctl: stderr Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:08:51.299 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: systemctl: stderr See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:08:51.299 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: Traceback (most recent call last): 2024-06-18T02:08:51.299 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-06-18T02:08:51.299 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: return _run_code(code, main_globals, None, 2024-06-18T02:08:51.299 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-06-18T02:08:51.299 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: exec(code, run_globals) 2024-06-18T02:08:51.299 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5618, in 2024-06-18T02:08:51.299 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5606, in main 2024-06-18T02:08:51.299 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3096, in command_deploy_from 2024-06-18T02:08:51.299 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3131, in _common_deploy 2024-06-18T02:08:51.299 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3151, in _deploy_daemon_container 2024-06-18T02:08:51.299 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 1123, in deploy_daemon 2024-06-18T02:08:51.299 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: File "/tmp/tmp3vdsh41i.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-06-18T02:08:51.299 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: RuntimeError: Failed command: systemctl restart ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd: Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:08:51.300 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:08:52.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:51 smithi130 ceph-mon[26123]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 36 KiB/s rd, 0 B/s wr, 20 op/s 2024-06-18T02:08:52.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:51 smithi130 ceph-mon[26123]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi007.xvdrwd ... 2024-06-18T02:08:52.044 INFO:journalctl@ceph.mon.b.smithi130.stdout: Creating ceph-iscsi config... 2024-06-18T02:08:52.044 INFO:journalctl@ceph.mon.b.smithi130.stdout: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/iscsi-gateway.cfg 2024-06-18T02:08:52.044 INFO:journalctl@ceph.mon.b.smithi130.stdout: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/tcmu-runner-entrypoint.sh 2024-06-18T02:08:52.044 INFO:journalctl@ceph.mon.b.smithi130.stdout: Non-zero exit code 1 from systemctl restart ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd 2024-06-18T02:08:52.044 INFO:journalctl@ceph.mon.b.smithi130.stdout: systemctl: stderr Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:08:52.044 INFO:journalctl@ceph.mon.b.smithi130.stdout: systemctl: stderr See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:08:52.044 INFO:journalctl@ceph.mon.b.smithi130.stdout: Traceback (most recent call last): 2024-06-18T02:08:52.044 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-06-18T02:08:52.045 INFO:journalctl@ceph.mon.b.smithi130.stdout: return _run_code(code, main_globals, None, 2024-06-18T02:08:52.045 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-06-18T02:08:52.045 INFO:journalctl@ceph.mon.b.smithi130.stdout: exec(code, run_globals) 2024-06-18T02:08:52.045 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5618, in 2024-06-18T02:08:52.045 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5606, in main 2024-06-18T02:08:52.045 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3096, in command_deploy_from 2024-06-18T02:08:52.045 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3131, in _common_deploy 2024-06-18T02:08:52.045 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3151, in _deploy_daemon_container 2024-06-18T02:08:52.045 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 1123, in deploy_daemon 2024-06-18T02:08:52.045 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-06-18T02:08:52.045 INFO:journalctl@ceph.mon.b.smithi130.stdout: RuntimeError: Failed command: systemctl restart ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd: Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:08:52.045 INFO:journalctl@ceph.mon.b.smithi130.stdout: See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:08:52.046 INFO:journalctl@ceph.mon.b.smithi130.stdout: Traceback (most recent call last): 2024-06-18T02:08:52.046 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-06-18T02:08:52.046 INFO:journalctl@ceph.mon.b.smithi130.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-06-18T02:08:52.046 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2456, in _daemon_action 2024-06-18T02:08:52.046 INFO:journalctl@ceph.mon.b.smithi130.stdout: return self.wait_async( 2024-06-18T02:08:52.046 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 779, in wait_async 2024-06-18T02:08:52.046 INFO:journalctl@ceph.mon.b.smithi130.stdout: return self.event_loop.get_result(coro, timeout) 2024-06-18T02:08:52.046 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-06-18T02:08:52.046 INFO:journalctl@ceph.mon.b.smithi130.stdout: return future.result(timeout) 2024-06-18T02:08:52.046 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/lib64/python3.9/concurrent/futures/_base.py", line 446, in result 2024-06-18T02:08:52.046 INFO:journalctl@ceph.mon.b.smithi130.stdout: return self.__get_result() 2024-06-18T02:08:52.046 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/lib64/python3.9/concurrent/futures/_base.py", line 391, in __get_result 2024-06-18T02:08:52.046 INFO:journalctl@ceph.mon.b.smithi130.stdout: raise self._exception 2024-06-18T02:08:52.046 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1350, in _create_daemon 2024-06-18T02:08:52.046 INFO:journalctl@ceph.mon.b.smithi130.stdout: out, err, code = await self._run_cephadm( 2024-06-18T02:08:52.047 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1691, in _run_cephadm 2024-06-18T02:08:52.047 INFO:journalctl@ceph.mon.b.smithi130.stdout: raise OrchestratorError( 2024-06-18T02:08:52.047 INFO:journalctl@ceph.mon.b.smithi130.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi007.xvdrwd ... 2024-06-18T02:08:52.047 INFO:journalctl@ceph.mon.b.smithi130.stdout: Creating ceph-iscsi config... 2024-06-18T02:08:52.047 INFO:journalctl@ceph.mon.b.smithi130.stdout: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/iscsi-gateway.cfg 2024-06-18T02:08:52.047 INFO:journalctl@ceph.mon.b.smithi130.stdout: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/tcmu-runner-entrypoint.sh 2024-06-18T02:08:52.047 INFO:journalctl@ceph.mon.b.smithi130.stdout: Non-zero exit code 1 from systemctl restart ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd 2024-06-18T02:08:52.047 INFO:journalctl@ceph.mon.b.smithi130.stdout: systemctl: stderr Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:08:52.047 INFO:journalctl@ceph.mon.b.smithi130.stdout: systemctl: stderr See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:08:52.047 INFO:journalctl@ceph.mon.b.smithi130.stdout: Traceback (most recent call last): 2024-06-18T02:08:52.047 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-06-18T02:08:52.047 INFO:journalctl@ceph.mon.b.smithi130.stdout: return _run_code(code, main_globals, None, 2024-06-18T02:08:52.047 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-06-18T02:08:52.047 INFO:journalctl@ceph.mon.b.smithi130.stdout: exec(code, run_globals) 2024-06-18T02:08:52.048 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5618, in 2024-06-18T02:08:52.048 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5606, in main 2024-06-18T02:08:52.048 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3096, in command_deploy_from 2024-06-18T02:08:52.048 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3131, in _common_deploy 2024-06-18T02:08:52.048 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3151, in _deploy_daemon_container 2024-06-18T02:08:52.048 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 1123, in deploy_daemon 2024-06-18T02:08:52.048 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-06-18T02:08:52.048 INFO:journalctl@ceph.mon.b.smithi130.stdout: RuntimeError: Failed command: systemctl restart ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd: Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:08:52.048 INFO:journalctl@ceph.mon.b.smithi130.stdout: See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:08:52.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:51 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:08:52.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:51 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:52.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:51 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:52.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:51 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:52.083 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:51 smithi007 ceph-mon[73500]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 36 KiB/s rd, 0 B/s wr, 20 op/s 2024-06-18T02:08:52.083 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:51 smithi007 ceph-mon[73500]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi007.xvdrwd ... 2024-06-18T02:08:52.083 INFO:journalctl@ceph.mon.a.smithi007.stdout: Creating ceph-iscsi config... 2024-06-18T02:08:52.083 INFO:journalctl@ceph.mon.a.smithi007.stdout: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/iscsi-gateway.cfg 2024-06-18T02:08:52.083 INFO:journalctl@ceph.mon.a.smithi007.stdout: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/tcmu-runner-entrypoint.sh 2024-06-18T02:08:52.083 INFO:journalctl@ceph.mon.a.smithi007.stdout: Non-zero exit code 1 from systemctl restart ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd 2024-06-18T02:08:52.083 INFO:journalctl@ceph.mon.a.smithi007.stdout: systemctl: stderr Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:08:52.083 INFO:journalctl@ceph.mon.a.smithi007.stdout: systemctl: stderr See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:08:52.083 INFO:journalctl@ceph.mon.a.smithi007.stdout: Traceback (most recent call last): 2024-06-18T02:08:52.084 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-06-18T02:08:52.084 INFO:journalctl@ceph.mon.a.smithi007.stdout: return _run_code(code, main_globals, None, 2024-06-18T02:08:52.084 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-06-18T02:08:52.084 INFO:journalctl@ceph.mon.a.smithi007.stdout: exec(code, run_globals) 2024-06-18T02:08:52.084 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5618, in 2024-06-18T02:08:52.084 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5606, in main 2024-06-18T02:08:52.084 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3096, in command_deploy_from 2024-06-18T02:08:52.084 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3131, in _common_deploy 2024-06-18T02:08:52.084 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3151, in _deploy_daemon_container 2024-06-18T02:08:52.084 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 1123, in deploy_daemon 2024-06-18T02:08:52.084 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-06-18T02:08:52.084 INFO:journalctl@ceph.mon.a.smithi007.stdout: RuntimeError: Failed command: systemctl restart ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd: Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:08:52.085 INFO:journalctl@ceph.mon.a.smithi007.stdout: See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:08:52.085 INFO:journalctl@ceph.mon.a.smithi007.stdout: Traceback (most recent call last): 2024-06-18T02:08:52.085 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-06-18T02:08:52.085 INFO:journalctl@ceph.mon.a.smithi007.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-06-18T02:08:52.085 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2456, in _daemon_action 2024-06-18T02:08:52.085 INFO:journalctl@ceph.mon.a.smithi007.stdout: return self.wait_async( 2024-06-18T02:08:52.085 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 779, in wait_async 2024-06-18T02:08:52.085 INFO:journalctl@ceph.mon.a.smithi007.stdout: return self.event_loop.get_result(coro, timeout) 2024-06-18T02:08:52.085 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-06-18T02:08:52.085 INFO:journalctl@ceph.mon.a.smithi007.stdout: return future.result(timeout) 2024-06-18T02:08:52.085 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib64/python3.9/concurrent/futures/_base.py", line 446, in result 2024-06-18T02:08:52.085 INFO:journalctl@ceph.mon.a.smithi007.stdout: return self.__get_result() 2024-06-18T02:08:52.085 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib64/python3.9/concurrent/futures/_base.py", line 391, in __get_result 2024-06-18T02:08:52.086 INFO:journalctl@ceph.mon.a.smithi007.stdout: raise self._exception 2024-06-18T02:08:52.086 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1350, in _create_daemon 2024-06-18T02:08:52.086 INFO:journalctl@ceph.mon.a.smithi007.stdout: out, err, code = await self._run_cephadm( 2024-06-18T02:08:52.086 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1691, in _run_cephadm 2024-06-18T02:08:52.086 INFO:journalctl@ceph.mon.a.smithi007.stdout: raise OrchestratorError( 2024-06-18T02:08:52.086 INFO:journalctl@ceph.mon.a.smithi007.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi007.xvdrwd ... 2024-06-18T02:08:52.086 INFO:journalctl@ceph.mon.a.smithi007.stdout: Creating ceph-iscsi config... 2024-06-18T02:08:52.086 INFO:journalctl@ceph.mon.a.smithi007.stdout: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/iscsi-gateway.cfg 2024-06-18T02:08:52.086 INFO:journalctl@ceph.mon.a.smithi007.stdout: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/tcmu-runner-entrypoint.sh 2024-06-18T02:08:52.086 INFO:journalctl@ceph.mon.a.smithi007.stdout: Non-zero exit code 1 from systemctl restart ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd 2024-06-18T02:08:52.086 INFO:journalctl@ceph.mon.a.smithi007.stdout: systemctl: stderr Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:08:52.086 INFO:journalctl@ceph.mon.a.smithi007.stdout: systemctl: stderr See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:08:52.086 INFO:journalctl@ceph.mon.a.smithi007.stdout: Traceback (most recent call last): 2024-06-18T02:08:52.087 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-06-18T02:08:52.087 INFO:journalctl@ceph.mon.a.smithi007.stdout: return _run_code(code, main_globals, None, 2024-06-18T02:08:52.087 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-06-18T02:08:52.087 INFO:journalctl@ceph.mon.a.smithi007.stdout: exec(code, run_globals) 2024-06-18T02:08:52.087 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5618, in 2024-06-18T02:08:52.087 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5606, in main 2024-06-18T02:08:52.087 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3096, in command_deploy_from 2024-06-18T02:08:52.087 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3131, in _common_deploy 2024-06-18T02:08:52.087 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3151, in _deploy_daemon_container 2024-06-18T02:08:52.087 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 1123, in deploy_daemon 2024-06-18T02:08:52.087 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-06-18T02:08:52.087 INFO:journalctl@ceph.mon.a.smithi007.stdout: RuntimeError: Failed command: systemctl restart ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd: Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:08:52.088 INFO:journalctl@ceph.mon.a.smithi007.stdout: See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:08:52.088 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:51 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:08:52.088 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:51 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:52.088 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:51 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:52.088 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:51 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:52.088 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:51 smithi007 ceph-mon[29879]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 36 KiB/s rd, 0 B/s wr, 20 op/s 2024-06-18T02:08:52.088 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:51 smithi007 ceph-mon[29879]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi007.xvdrwd ... 2024-06-18T02:08:52.088 INFO:journalctl@ceph.mon.c.smithi007.stdout: Creating ceph-iscsi config... 2024-06-18T02:08:52.088 INFO:journalctl@ceph.mon.c.smithi007.stdout: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/iscsi-gateway.cfg 2024-06-18T02:08:52.089 INFO:journalctl@ceph.mon.c.smithi007.stdout: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/tcmu-runner-entrypoint.sh 2024-06-18T02:08:52.089 INFO:journalctl@ceph.mon.c.smithi007.stdout: Non-zero exit code 1 from systemctl restart ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd 2024-06-18T02:08:52.089 INFO:journalctl@ceph.mon.c.smithi007.stdout: systemctl: stderr Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:08:52.089 INFO:journalctl@ceph.mon.c.smithi007.stdout: systemctl: stderr See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:08:52.089 INFO:journalctl@ceph.mon.c.smithi007.stdout: Traceback (most recent call last): 2024-06-18T02:08:52.089 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-06-18T02:08:52.089 INFO:journalctl@ceph.mon.c.smithi007.stdout: return _run_code(code, main_globals, None, 2024-06-18T02:08:52.089 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-06-18T02:08:52.089 INFO:journalctl@ceph.mon.c.smithi007.stdout: exec(code, run_globals) 2024-06-18T02:08:52.089 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5618, in 2024-06-18T02:08:52.089 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5606, in main 2024-06-18T02:08:52.089 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3096, in command_deploy_from 2024-06-18T02:08:52.090 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3131, in _common_deploy 2024-06-18T02:08:52.090 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3151, in _deploy_daemon_container 2024-06-18T02:08:52.090 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 1123, in deploy_daemon 2024-06-18T02:08:52.090 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-06-18T02:08:52.090 INFO:journalctl@ceph.mon.c.smithi007.stdout: RuntimeError: Failed command: systemctl restart ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd: Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:08:52.090 INFO:journalctl@ceph.mon.c.smithi007.stdout: See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:08:52.090 INFO:journalctl@ceph.mon.c.smithi007.stdout: Traceback (most recent call last): 2024-06-18T02:08:52.090 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-06-18T02:08:52.090 INFO:journalctl@ceph.mon.c.smithi007.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-06-18T02:08:52.090 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2456, in _daemon_action 2024-06-18T02:08:52.090 INFO:journalctl@ceph.mon.c.smithi007.stdout: return self.wait_async( 2024-06-18T02:08:52.090 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 779, in wait_async 2024-06-18T02:08:52.090 INFO:journalctl@ceph.mon.c.smithi007.stdout: return self.event_loop.get_result(coro, timeout) 2024-06-18T02:08:52.091 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-06-18T02:08:52.091 INFO:journalctl@ceph.mon.c.smithi007.stdout: return future.result(timeout) 2024-06-18T02:08:52.091 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/lib64/python3.9/concurrent/futures/_base.py", line 446, in result 2024-06-18T02:08:52.091 INFO:journalctl@ceph.mon.c.smithi007.stdout: return self.__get_result() 2024-06-18T02:08:52.091 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/lib64/python3.9/concurrent/futures/_base.py", line 391, in __get_result 2024-06-18T02:08:52.091 INFO:journalctl@ceph.mon.c.smithi007.stdout: raise self._exception 2024-06-18T02:08:52.091 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1350, in _create_daemon 2024-06-18T02:08:52.091 INFO:journalctl@ceph.mon.c.smithi007.stdout: out, err, code = await self._run_cephadm( 2024-06-18T02:08:52.091 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1691, in _run_cephadm 2024-06-18T02:08:52.091 INFO:journalctl@ceph.mon.c.smithi007.stdout: raise OrchestratorError( 2024-06-18T02:08:52.091 INFO:journalctl@ceph.mon.c.smithi007.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi007.xvdrwd ... 2024-06-18T02:08:52.091 INFO:journalctl@ceph.mon.c.smithi007.stdout: Creating ceph-iscsi config... 2024-06-18T02:08:52.091 INFO:journalctl@ceph.mon.c.smithi007.stdout: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/iscsi-gateway.cfg 2024-06-18T02:08:52.092 INFO:journalctl@ceph.mon.c.smithi007.stdout: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/tcmu-runner-entrypoint.sh 2024-06-18T02:08:52.092 INFO:journalctl@ceph.mon.c.smithi007.stdout: Non-zero exit code 1 from systemctl restart ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd 2024-06-18T02:08:52.092 INFO:journalctl@ceph.mon.c.smithi007.stdout: systemctl: stderr Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:08:52.092 INFO:journalctl@ceph.mon.c.smithi007.stdout: systemctl: stderr See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:08:52.092 INFO:journalctl@ceph.mon.c.smithi007.stdout: Traceback (most recent call last): 2024-06-18T02:08:52.092 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-06-18T02:08:52.092 INFO:journalctl@ceph.mon.c.smithi007.stdout: return _run_code(code, main_globals, None, 2024-06-18T02:08:52.092 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-06-18T02:08:52.092 INFO:journalctl@ceph.mon.c.smithi007.stdout: exec(code, run_globals) 2024-06-18T02:08:52.092 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5618, in 2024-06-18T02:08:52.092 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5606, in main 2024-06-18T02:08:52.092 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3096, in command_deploy_from 2024-06-18T02:08:52.092 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3131, in _common_deploy 2024-06-18T02:08:52.092 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3151, in _deploy_daemon_container 2024-06-18T02:08:52.093 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 1123, in deploy_daemon 2024-06-18T02:08:52.093 INFO:journalctl@ceph.mon.c.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-06-18T02:08:52.093 INFO:journalctl@ceph.mon.c.smithi007.stdout: RuntimeError: Failed command: systemctl restart ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd: Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:08:52.093 INFO:journalctl@ceph.mon.c.smithi007.stdout: See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:08:52.093 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:51 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:08:52.093 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:51 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:52.093 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:51 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:52.093 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:51 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:52.318 INFO:teuthology.orchestra.run.smithi007.stdout:true 2024-06-18T02:08:53.038 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:52 smithi007 ceph-mon[73500]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 49 KiB/s rd, 0 B/s wr, 27 op/s 2024-06-18T02:08:53.038 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:52 smithi007 ceph-mon[73500]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 50 KiB/s rd, 0 B/s wr, 28 op/s 2024-06-18T02:08:53.039 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:52 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-18T02:08:53.039 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:52 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-18T02:08:53.039 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:52 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-18T02:08:53.039 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:52 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:08:53.039 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:52 smithi007 ceph-mon[29879]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 49 KiB/s rd, 0 B/s wr, 27 op/s 2024-06-18T02:08:53.039 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:52 smithi007 ceph-mon[29879]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 50 KiB/s rd, 0 B/s wr, 28 op/s 2024-06-18T02:08:53.039 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:52 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-18T02:08:53.039 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:52 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-18T02:08:53.039 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:52 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-18T02:08:53.039 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:52 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:08:53.040 INFO:teuthology.orchestra.run.smithi007.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-18T02:08:53.040 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi007 smithi007 running 1s ago 12m - - 2024-06-18T02:08:53.040 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi130 smithi130 running 4s ago 11m - - 2024-06-18T02:08:53.040 INFO:teuthology.orchestra.run.smithi007.stdout:alertmanager.a smithi007 *:9093,9094 running (107s) 1s ago 6m 15.0M - 0.23.0 ba2b418f427c 5994e8525c64 2024-06-18T02:08:53.040 INFO:teuthology.orchestra.run.smithi007.stdout:grafana.a smithi130 *:3000 running (83s) 4s ago 6m 41.2M - 8.3.5 dad864ee21e9 70ba81d97c8e 2024-06-18T02:08:53.040 INFO:teuthology.orchestra.run.smithi007.stdout:iscsi.foo.smithi007.xvdrwd smithi007 unknown 1s ago 5m 48.2M - e1d6a67b021e 6b9ccbaad776 2024-06-18T02:08:53.040 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.x smithi130 *:8443,9283,8765 running (50s) 4s ago 11m 484M - 19.0.0-3124-g3781e3a5 af93c036e016 01017e37bdbe 2024-06-18T02:08:53.040 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.y smithi007 *:8443,9283,8765 running (77s) 1s ago 13m 436M - 19.0.0-3124-g3781e3a5 af93c036e016 820dafc9907d 2024-06-18T02:08:53.040 INFO:teuthology.orchestra.run.smithi007.stdout:mon.a smithi007 running (18s) 1s ago 13m 31.2M 2048M 19.0.0-3124-g3781e3a5 af93c036e016 670d7777ae9b 2024-06-18T02:08:53.040 INFO:teuthology.orchestra.run.smithi007.stdout:mon.b smithi130 running (11m) 4s ago 11m 62.4M 2048M 17.2.0 e1d6a67b021e a0b38a9a595f 2024-06-18T02:08:53.040 INFO:teuthology.orchestra.run.smithi007.stdout:mon.c smithi007 running (11m) 1s ago 11m 57.5M 2048M 17.2.0 e1d6a67b021e 1d1e2628656b 2024-06-18T02:08:53.041 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.a smithi007 *:9100 running (115s) 1s ago 7m 16.7M - 1.3.1 1dbe0e931976 8128e558f099 2024-06-18T02:08:53.041 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.b smithi130 *:9100 running (87s) 4s ago 7m 18.8M - 1.3.1 1dbe0e931976 bab93b43cf16 2024-06-18T02:08:53.041 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0 smithi007 running (10m) 1s ago 10m 54.1M 4096M 17.2.0 e1d6a67b021e 1ef6e23afd55 2024-06-18T02:08:53.041 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1 smithi007 running (10m) 1s ago 10m 55.8M 4096M 17.2.0 e1d6a67b021e a967706523cb 2024-06-18T02:08:53.041 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2 smithi007 running (10m) 1s ago 10m 50.2M 4096M 17.2.0 e1d6a67b021e 2c1b76bd0876 2024-06-18T02:08:53.041 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3 smithi007 running (9m) 1s ago 9m 54.2M 4096M 17.2.0 e1d6a67b021e 8b91b2a07564 2024-06-18T02:08:53.041 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4 smithi130 running (9m) 4s ago 9m 55.5M 4096M 17.2.0 e1d6a67b021e c428dccffdf0 2024-06-18T02:08:53.041 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5 smithi130 running (8m) 4s ago 8m 54.0M 4096M 17.2.0 e1d6a67b021e f645d7f12378 2024-06-18T02:08:53.041 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6 smithi130 running (8m) 4s ago 8m 50.0M 4096M 17.2.0 e1d6a67b021e c7af86c14959 2024-06-18T02:08:53.041 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7 smithi130 running (8m) 4s ago 8m 53.6M 4096M 17.2.0 e1d6a67b021e 3688af8b2c46 2024-06-18T02:08:53.041 INFO:teuthology.orchestra.run.smithi007.stdout:prometheus.a smithi130 *:9095 running (23s) 4s ago 7m 53.9M - 2.33.4 514e6a882f6e e905fb2eb4a6 2024-06-18T02:08:53.041 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi007.dvbvbk smithi007 *:8000 running (5m) 1s ago 5m 75.6M - 17.2.0 e1d6a67b021e 1344b55b763c 2024-06-18T02:08:53.041 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi130.aakmof smithi130 *:8000 running (5m) 4s ago 5m 73.4M - 17.2.0 e1d6a67b021e e257e3230c6c 2024-06-18T02:08:53.042 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi007.hgrnmk smithi007 *:80 running (5m) 1s ago 5m 73.8M - 17.2.0 e1d6a67b021e 2173947bc4d6 2024-06-18T02:08:53.042 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi130.wwebfk smithi130 *:80 running (5m) 4s ago 5m 75.5M - 17.2.0 e1d6a67b021e 8662706b2231 2024-06-18T02:08:53.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:52 smithi130 ceph-mon[26123]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 49 KiB/s rd, 0 B/s wr, 27 op/s 2024-06-18T02:08:53.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:52 smithi130 ceph-mon[26123]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 50 KiB/s rd, 0 B/s wr, 28 op/s 2024-06-18T02:08:53.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:52 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-18T02:08:53.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:52 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-18T02:08:53.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:52 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-18T02:08:53.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:52 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:08:53.484 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:08:53.484 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": { 2024-06-18T02:08:53.484 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2, 2024-06-18T02:08:53.484 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 1 2024-06-18T02:08:53.484 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:08:53.484 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": { 2024-06-18T02:08:53.484 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 2 2024-06-18T02:08:53.484 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:08:53.484 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": { 2024-06-18T02:08:53.484 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-06-18T02:08:53.484 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:08:53.485 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": {}, 2024-06-18T02:08:53.485 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw": { 2024-06-18T02:08:53.485 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-06-18T02:08:53.485 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:08:53.485 INFO:teuthology.orchestra.run.smithi007.stdout: "overall": { 2024-06-18T02:08:53.485 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 14, 2024-06-18T02:08:53.485 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 3 2024-06-18T02:08:53.485 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-06-18T02:08:53.485 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:08:53.793 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:53 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:08:53.506Z caller=manager.go:609 level=warn component="rule manager" group=nodes msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on(instance) group_left(nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi007\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"cd9a3408-2d15-11ef-bc9d-c7b262605968\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-06-18T02:08:53.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:53 smithi130 ceph-mon[26123]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:08:53.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:53 smithi130 ceph-mon[26123]: Upgrade: Updating mgr.y 2024-06-18T02:08:53.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:53 smithi130 ceph-mon[26123]: Deploying daemon mgr.y on smithi007 2024-06-18T02:08:53.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:53 smithi130 ceph-mon[26123]: from='client.34146 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:08:53.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:53 smithi130 ceph-mon[26123]: from='client.25483 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:08:53.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:53 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:53.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:53 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:53.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:53 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:53.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:53 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/1574380352' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:08:53.841 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:53 smithi007 ceph-mon[29879]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:08:53.841 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:53 smithi007 ceph-mon[29879]: Upgrade: Updating mgr.y 2024-06-18T02:08:53.841 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:53 smithi007 ceph-mon[29879]: Deploying daemon mgr.y on smithi007 2024-06-18T02:08:53.841 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:53 smithi007 ceph-mon[29879]: from='client.34146 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:08:53.841 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:53 smithi007 ceph-mon[29879]: from='client.25483 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:08:53.841 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:53 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:53.841 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:53 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:53.841 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:53 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:53.841 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:53 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/1574380352' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:08:53.842 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:53 smithi007 ceph-mon[73500]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:08:53.842 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:53 smithi007 ceph-mon[73500]: Upgrade: Updating mgr.y 2024-06-18T02:08:53.842 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:53 smithi007 ceph-mon[73500]: Deploying daemon mgr.y on smithi007 2024-06-18T02:08:53.842 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:53 smithi007 ceph-mon[73500]: from='client.34146 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:08:53.842 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:53 smithi007 ceph-mon[73500]: from='client.25483 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:08:53.842 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:53 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:53.842 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:53 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:53.842 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:53 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:08:53.842 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:53 smithi007 ceph-mon[73500]: from='client.? 172.21.15.7:0/1574380352' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:08:53.843 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:08:53.843 INFO:teuthology.orchestra.run.smithi007.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00", 2024-06-18T02:08:53.843 INFO:teuthology.orchestra.run.smithi007.stdout: "in_progress": true, 2024-06-18T02:08:53.843 INFO:teuthology.orchestra.run.smithi007.stdout: "which": "Upgrading all daemon types on all hosts", 2024-06-18T02:08:53.843 INFO:teuthology.orchestra.run.smithi007.stdout: "services_complete": [ 2024-06-18T02:08:53.843 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr" 2024-06-18T02:08:53.843 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-06-18T02:08:53.843 INFO:teuthology.orchestra.run.smithi007.stdout: "progress": "3/23 daemons upgraded", 2024-06-18T02:08:53.843 INFO:teuthology.orchestra.run.smithi007.stdout: "message": "Currently upgrading mgr daemons", 2024-06-18T02:08:53.843 INFO:teuthology.orchestra.run.smithi007.stdout: "is_paused": false 2024-06-18T02:08:53.843 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:08:54.256 INFO:teuthology.orchestra.run.smithi007.stdout:HEALTH_WARN 1 failed cephadm daemon(s) 2024-06-18T02:08:54.257 INFO:teuthology.orchestra.run.smithi007.stdout:[WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2024-06-18T02:08:54.257 INFO:teuthology.orchestra.run.smithi007.stdout: daemon iscsi.foo.smithi007.xvdrwd on smithi007 is in unknown state 2024-06-18T02:08:54.885 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:54 smithi007 ceph-mon[73500]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 0 B/s wr, 20 op/s 2024-06-18T02:08:54.886 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:54 smithi007 ceph-mon[73500]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 893 B/s rd, 1 op/s 2024-06-18T02:08:54.886 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:54 smithi007 ceph-mon[73500]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 893 B/s rd, 1 op/s 2024-06-18T02:08:54.886 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:54 smithi007 ceph-mon[73500]: from='client.25495 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:08:54.886 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:54 smithi007 ceph-mon[73500]: from='client.? 172.21.15.7:0/621771132' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:08:54.886 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:54 smithi007 ceph-mon[29879]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 0 B/s wr, 20 op/s 2024-06-18T02:08:54.886 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:54 smithi007 ceph-mon[29879]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 893 B/s rd, 1 op/s 2024-06-18T02:08:54.886 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:54 smithi007 ceph-mon[29879]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 893 B/s rd, 1 op/s 2024-06-18T02:08:54.886 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:54 smithi007 ceph-mon[29879]: from='client.25495 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:08:54.886 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:54 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/621771132' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:08:55.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:54 smithi130 ceph-mon[26123]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 0 B/s wr, 20 op/s 2024-06-18T02:08:55.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:54 smithi130 ceph-mon[26123]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 893 B/s rd, 1 op/s 2024-06-18T02:08:55.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:54 smithi130 ceph-mon[26123]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 893 B/s rd, 1 op/s 2024-06-18T02:08:55.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:54 smithi130 ceph-mon[26123]: from='client.25495 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:08:55.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:54 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/621771132' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:08:55.547 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:55 smithi007 systemd[1]: Stopping Ceph mgr.y for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:08:56.335 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:56 smithi007 podman[76474]: 2024-06-18 02:08:56.074754 +0000 UTC m=+0.151608635 container died 820dafc9907dac934f2369c23610ae81366eb82608be1a408b5eb4c33864fae1 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240612, GIT_CLEAN=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-3781e3a, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-18T02:08:56.682 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:56 smithi007 podman[76474]: 2024-06-18 02:08:56.485330086 +0000 UTC m=+0.562184713 container cleanup 820dafc9907dac934f2369c23610ae81366eb82608be1a408b5eb4c33864fae1 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, RELEASE=squid-3781e3a, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240612, GIT_CLEAN=True) 2024-06-18T02:08:56.682 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:56 smithi007 bash[76474]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y 2024-06-18T02:08:57.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:56 smithi130 ceph-mon[26123]: pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 893 B/s rd, 1 op/s 2024-06-18T02:08:57.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:56 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:08:57.063 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:56 smithi007 ceph-mon[73500]: pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 893 B/s rd, 1 op/s 2024-06-18T02:08:57.063 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:56 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:08:57.064 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:56 smithi007 ceph-mon[29879]: pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 893 B/s rd, 1 op/s 2024-06-18T02:08:57.064 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:56 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:08:57.064 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:56 smithi007 podman[76504]: 2024-06-18 02:08:56.703898838 +0000 UTC m=+0.629985262 container remove 820dafc9907dac934f2369c23610ae81366eb82608be1a408b5eb4c33864fae1 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240612, RELEASE=squid-3781e3a, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-06-18T02:08:57.064 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:56 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-06-18T02:08:57.836 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:57 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mgr.y.service: Failed with result 'exit-code'. 2024-06-18T02:08:57.836 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:57 smithi007 systemd[1]: Stopped Ceph mgr.y for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:08:57.836 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:57 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mgr.y.service: Consumed 31.594s CPU time. 2024-06-18T02:08:57.836 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:57 smithi007 systemd[1]: Starting Ceph mgr.y for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:08:58.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:08:57 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:08:57] "GET /metrics HTTP/1.1" 200 38237 "" "Prometheus/2.33.4" 2024-06-18T02:08:58.723 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:58 smithi007 podman[76866]: 2024-06-18 02:08:58.369232688 +0000 UTC m=+0.019528733 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:08:58.723 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:58 smithi007 podman[76866]: 2024-06-18 02:08:58.528971309 +0000 UTC m=+0.179267351 container create 20b86ac6554cdaa95f97ce019d3cd7140c760c763c6c410a2c8db1bfebc401b7 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-3781e3a, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240612, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47) 2024-06-18T02:08:59.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:58 smithi130 ceph-mon[26123]: pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 661 B/s rd, 0 op/s 2024-06-18T02:08:59.043 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:08:58 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:08:58.659Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.7\", device_class=\"ssd\", hostname=\"smithi007\", instance=\"172.21.15.130:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.7\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"cd9a3408-2d15-11ef-bc9d-c7b262605968\", cluster_addr=\"172.21.15.7\", device_class=\"ssd\", hostname=\"smithi007\", instance=\"smithi130:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.7\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-06-18T02:08:59.105 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:58 smithi007 ceph-mon[73500]: pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 661 B/s rd, 0 op/s 2024-06-18T02:08:59.106 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:58 smithi007 podman[76866]: 2024-06-18 02:08:58.773727224 +0000 UTC m=+0.424023266 container init 20b86ac6554cdaa95f97ce019d3cd7140c760c763c6c410a2c8db1bfebc401b7 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240612, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-3781e3a, org.label-schema.vendor=CentOS) 2024-06-18T02:08:59.106 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:58 smithi007 podman[76866]: 2024-06-18 02:08:58.777087731 +0000 UTC m=+0.427383774 container start 20b86ac6554cdaa95f97ce019d3cd7140c760c763c6c410a2c8db1bfebc401b7 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y, org.label-schema.build-date=20240612, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3781e3a, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, ceph=True, GIT_BRANCH=HEAD) 2024-06-18T02:08:59.106 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:58 smithi007 ceph-mgr[76897]: -- 172.21.15.7:0/1703166103 <== mon.0 v2:172.21.15.7:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d04598f0e0 con 0x55d04596d400 2024-06-18T02:08:59.106 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:58 smithi007 bash[76866]: 20b86ac6554cdaa95f97ce019d3cd7140c760c763c6c410a2c8db1bfebc401b7 2024-06-18T02:08:59.106 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:58 smithi007 systemd[1]: Started Ceph mgr.y for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:08:59.106 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[76893]: 2024-06-18T02:08:58.909+0000 7f8abf2d1040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-18T02:08:59.106 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:59 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[76893]: 2024-06-18T02:08:59.105+0000 7f8abf2d1040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-18T02:08:59.107 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:58 smithi007 ceph-mon[29879]: pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 661 B/s rd, 0 op/s 2024-06-18T02:08:59.431 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:59 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[76893]: 2024-06-18T02:08:59.184+0000 7f8abf2d1040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-18T02:08:59.767 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:59 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[76893]: 2024-06-18T02:08:59.462+0000 7f8abf2d1040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-18T02:08:59.767 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:08:59 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[76893]: 2024-06-18T02:08:59.530+0000 7f8abf2d1040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-18T02:09:00.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:59 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:00.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:59 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:00.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:59 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:00.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:59 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:00.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:59 smithi130 ceph-mon[26123]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 518 B/s rd, 0 op/s 2024-06-18T02:09:00.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:59 smithi130 ceph-mon[26123]: pgmap v23: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:09:00.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:59 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:00.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:59 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:00.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:59 smithi130 ceph-mon[26123]: Reconfiguring iscsi.foo.smithi007.xvdrwd (dependencies changed)... 2024-06-18T02:09:00.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:59 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi007.xvdrwd", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-06-18T02:09:00.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:59 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi007.xvdrwd", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-06-18T02:09:00.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:59 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:00.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:59 smithi130 ceph-mon[26123]: Reconfiguring daemon iscsi.foo.smithi007.xvdrwd on smithi007 2024-06-18T02:09:00.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:59 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:00.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:59 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:00.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:08:59 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:00.138 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:59 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:00.139 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:59 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:00.139 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:59 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:00.139 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:59 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:00.139 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:59 smithi007 ceph-mon[73500]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 518 B/s rd, 0 op/s 2024-06-18T02:09:00.139 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:59 smithi007 ceph-mon[73500]: pgmap v23: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:09:00.139 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:59 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:00.139 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:59 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:00.139 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:59 smithi007 ceph-mon[73500]: Reconfiguring iscsi.foo.smithi007.xvdrwd (dependencies changed)... 2024-06-18T02:09:00.139 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:59 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi007.xvdrwd", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-06-18T02:09:00.139 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:59 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi007.xvdrwd", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-06-18T02:09:00.139 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:59 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:00.139 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:59 smithi007 ceph-mon[73500]: Reconfiguring daemon iscsi.foo.smithi007.xvdrwd on smithi007 2024-06-18T02:09:00.140 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:59 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:00.140 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:59 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:00.140 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:08:59 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:00.140 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:59 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:00.140 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:59 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:00.140 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:59 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:00.140 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:59 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:00.140 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:59 smithi007 ceph-mon[29879]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 518 B/s rd, 0 op/s 2024-06-18T02:09:00.140 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:59 smithi007 ceph-mon[29879]: pgmap v23: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:09:00.140 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:59 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:00.140 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:59 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:00.141 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:59 smithi007 ceph-mon[29879]: Reconfiguring iscsi.foo.smithi007.xvdrwd (dependencies changed)... 2024-06-18T02:09:00.141 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:59 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi007.xvdrwd", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-06-18T02:09:00.141 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:59 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi007.xvdrwd", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-06-18T02:09:00.141 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:59 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:00.141 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:59 smithi007 ceph-mon[29879]: Reconfiguring daemon iscsi.foo.smithi007.xvdrwd on smithi007 2024-06-18T02:09:00.141 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:59 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:00.141 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:59 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:00.141 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:08:59 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:00.778 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:00 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[76893]: 2024-06-18T02:09:00.562+0000 7f8abf2d1040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-18T02:09:00.778 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:00 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[76893]: 2024-06-18T02:09:00.717+0000 7f8abf2d1040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-18T02:09:01.029 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:00 smithi007 ceph-mon[73500]: pgmap v24: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:09:01.029 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:00 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[76893]: 2024-06-18T02:09:00.778+0000 7f8abf2d1040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-18T02:09:01.029 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:01 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[76893]: 2024-06-18T02:09:01.018+0000 7f8abf2d1040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-18T02:09:01.030 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:00 smithi007 ceph-mon[29879]: pgmap v24: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:09:01.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:00 smithi130 ceph-mon[26123]: pgmap v24: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:09:01.299 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:01 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[76893]: 2024-06-18T02:09:01.086+0000 7f8abf2d1040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-18T02:09:01.299 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:01 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[76893]: 2024-06-18T02:09:01.159+0000 7f8abf2d1040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-18T02:09:01.553 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:01 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[76893]: 2024-06-18T02:09:01.321+0000 7f8abf2d1040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-18T02:09:01.829 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:01 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[76893]: 2024-06-18T02:09:01.788+0000 7f8abf2d1040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-18T02:09:02.400 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:02 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[76893]: 2024-06-18T02:09:02.158+0000 7f8abf2d1040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-18T02:09:02.400 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:02 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[76893]: 2024-06-18T02:09:02.231+0000 7f8abf2d1040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-18T02:09:02.400 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:02 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[76893]: 2024-06-18T02:09:02.400+0000 7f8abf2d1040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-18T02:09:02.986 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:02 smithi007 ceph-mon[73500]: pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:09:02.986 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:02 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:02.986 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:02 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:02.986 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:02 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-06-18T02:09:02.986 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:02 smithi007 ceph-mon[73500]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-06-18T02:09:02.986 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:02 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-06-18T02:09:02.986 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:02 smithi007 ceph-mon[73500]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-06-18T02:09:02.987 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:02 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:02.987 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:02 smithi007 ceph-mon[73500]: from='client.? 172.21.15.7:0/1734240093' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-18T02:09:02.987 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:02 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[76893]: 2024-06-18T02:09:02.752+0000 7f8abf2d1040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-18T02:09:02.987 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:02 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[76893]: 2024-06-18T02:09:02.821+0000 7f8abf2d1040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-18T02:09:02.987 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:02 smithi007 ceph-mon[29879]: pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:09:02.987 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:02 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:02.987 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:02 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:02.987 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:02 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-06-18T02:09:02.987 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:02 smithi007 ceph-mon[29879]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-06-18T02:09:02.988 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:02 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-06-18T02:09:02.988 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:02 smithi007 ceph-mon[29879]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-06-18T02:09:02.988 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:02 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:02.988 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:02 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/1734240093' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-18T02:09:03.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:02 smithi130 ceph-mon[26123]: pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:09:03.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:02 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:03.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:02 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:03.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:02 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-06-18T02:09:03.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:02 smithi130 ceph-mon[26123]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-06-18T02:09:03.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:02 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-06-18T02:09:03.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:02 smithi130 ceph-mon[26123]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-06-18T02:09:03.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:02 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:03.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:02 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/1734240093' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-18T02:09:03.264 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:03 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[76893]: 2024-06-18T02:09:03.025+0000 7f8abf2d1040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-18T02:09:03.264 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:03 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[76893]: 2024-06-18T02:09:03.190+0000 7f8abf2d1040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-18T02:09:03.517 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:03 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[76893]: 2024-06-18T02:09:03.264+0000 7f8abf2d1040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-18T02:09:03.517 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:03 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[76893]: 2024-06-18T02:09:03.357+0000 7f8abf2d1040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-18T02:09:03.517 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:03 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[76893]: 2024-06-18T02:09:03.424+0000 7f8abf2d1040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-18T02:09:03.793 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:09:03 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:09:03.504Z caller=manager.go:609 level=warn component="rule manager" group=nodes msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on(instance) group_left(nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi007\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"cd9a3408-2d15-11ef-bc9d-c7b262605968\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-06-18T02:09:03.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:03 smithi130 ceph-mon[26123]: Upgrade: Updating mgr.y 2024-06-18T02:09:03.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:03 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-18T02:09:03.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:03 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-18T02:09:03.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:03 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-18T02:09:03.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:03 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:03.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:03 smithi130 ceph-mon[26123]: Deploying daemon mgr.y on smithi007 2024-06-18T02:09:03.931 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:03 smithi007 ceph-mon[29879]: Upgrade: Updating mgr.y 2024-06-18T02:09:03.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:03 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-18T02:09:03.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:03 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-18T02:09:03.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:03 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-18T02:09:03.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:03 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:03.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:03 smithi007 ceph-mon[29879]: Deploying daemon mgr.y on smithi007 2024-06-18T02:09:03.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:03 smithi007 ceph-mon[73500]: Upgrade: Updating mgr.y 2024-06-18T02:09:03.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:03 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-18T02:09:03.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:03 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-18T02:09:03.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:03 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-18T02:09:03.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:03 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:03.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:03 smithi007 ceph-mon[73500]: Deploying daemon mgr.y on smithi007 2024-06-18T02:09:04.302 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:04 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[76893]: 2024-06-18T02:09:04.021+0000 7f8abf2d1040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-18T02:09:04.302 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:04 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[76893]: 2024-06-18T02:09:04.195+0000 7f8abf2d1040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-18T02:09:04.302 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:04 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[76893]: [18/Jun/2024:02:09:04] ENGINE Bus STARTING 2024-06-18T02:09:04.302 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:04 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[76893]: CherryPy Checker: 2024-06-18T02:09:04.302 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:04 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[76893]: The Application mounted at '' has an empty config. 2024-06-18T02:09:04.302 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:04 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[76893]: 2024-06-18T02:09:04.302 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:04 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[76893]: [18/Jun/2024:02:09:04] ENGINE Serving on http://:::9283 2024-06-18T02:09:04.303 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:04 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[76893]: [18/Jun/2024:02:09:04] ENGINE Bus STARTED 2024-06-18T02:09:04.932 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:04 smithi007 systemd[1]: Stopping Ceph mgr.y for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:09:04.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:04 smithi007 ceph-mon[73500]: pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 128 B/s rd, 0 op/s 2024-06-18T02:09:04.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:04 smithi007 ceph-mon[73500]: Standby manager daemon y restarted 2024-06-18T02:09:04.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:04 smithi007 ceph-mon[73500]: Standby manager daemon y started 2024-06-18T02:09:04.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:04 smithi007 ceph-mon[73500]: from='mgr.? 172.21.15.7:0/2623554326' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-06-18T02:09:04.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:04 smithi007 ceph-mon[73500]: from='mgr.? 172.21.15.7:0/2623554326' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-18T02:09:04.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:04 smithi007 ceph-mon[73500]: from='mgr.? 172.21.15.7:0/2623554326' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-06-18T02:09:04.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:04 smithi007 ceph-mon[73500]: from='mgr.? 172.21.15.7:0/2623554326' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-18T02:09:04.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:04 smithi007 ceph-mon[29879]: pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 128 B/s rd, 0 op/s 2024-06-18T02:09:04.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:04 smithi007 ceph-mon[29879]: Standby manager daemon y restarted 2024-06-18T02:09:04.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:04 smithi007 ceph-mon[29879]: Standby manager daemon y started 2024-06-18T02:09:04.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:04 smithi007 ceph-mon[29879]: from='mgr.? 172.21.15.7:0/2623554326' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-06-18T02:09:04.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:04 smithi007 ceph-mon[29879]: from='mgr.? 172.21.15.7:0/2623554326' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-18T02:09:04.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:04 smithi007 ceph-mon[29879]: from='mgr.? 172.21.15.7:0/2623554326' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-06-18T02:09:04.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:04 smithi007 ceph-mon[29879]: from='mgr.? 172.21.15.7:0/2623554326' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-18T02:09:05.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:04 smithi130 ceph-mon[26123]: pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 128 B/s rd, 0 op/s 2024-06-18T02:09:05.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:04 smithi130 ceph-mon[26123]: Standby manager daemon y restarted 2024-06-18T02:09:05.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:04 smithi130 ceph-mon[26123]: Standby manager daemon y started 2024-06-18T02:09:05.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:04 smithi130 ceph-mon[26123]: from='mgr.? 172.21.15.7:0/2623554326' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-06-18T02:09:05.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:04 smithi130 ceph-mon[26123]: from='mgr.? 172.21.15.7:0/2623554326' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-18T02:09:05.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:04 smithi130 ceph-mon[26123]: from='mgr.? 172.21.15.7:0/2623554326' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-06-18T02:09:05.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:04 smithi130 ceph-mon[26123]: from='mgr.? 172.21.15.7:0/2623554326' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-18T02:09:05.232 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:04 smithi007 podman[77693]: 2024-06-18 02:09:04.954993437 +0000 UTC m=+0.149229270 container died 20b86ac6554cdaa95f97ce019d3cd7140c760c763c6c410a2c8db1bfebc401b7 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240612, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3781e3a, org.label-schema.name=CentOS Stream 9 Base Image) 2024-06-18T02:09:05.557 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:05 smithi007 podman[77693]: 2024-06-18 02:09:05.315058557 +0000 UTC m=+0.509294389 container cleanup 20b86ac6554cdaa95f97ce019d3cd7140c760c763c6c410a2c8db1bfebc401b7 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240612, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-3781e3a, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-18T02:09:05.557 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:05 smithi007 bash[77693]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y 2024-06-18T02:09:05.918 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:05 smithi007 ceph-mon[73500]: mgrmap e44: x(active, since 23s), standbys: y 2024-06-18T02:09:05.919 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:05 smithi007 ceph-mon[29879]: mgrmap e44: x(active, since 23s), standbys: y 2024-06-18T02:09:05.919 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:05 smithi007 podman[77705]: 2024-06-18 02:09:05.5579905 +0000 UTC m=+0.601079649 container remove 20b86ac6554cdaa95f97ce019d3cd7140c760c763c6c410a2c8db1bfebc401b7 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.36.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, CEPH_POINT_RELEASE=, RELEASE=squid-3781e3a, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240612) 2024-06-18T02:09:05.919 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:05 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-06-18T02:09:05.919 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:05 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mgr.y.service: Failed with result 'exit-code'. 2024-06-18T02:09:05.919 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:05 smithi007 systemd[1]: Stopped Ceph mgr.y for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:09:05.919 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:05 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mgr.y.service: Consumed 6.310s CPU time. 2024-06-18T02:09:06.007 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:05 smithi130 ceph-mon[26123]: mgrmap e44: x(active, since 23s), standbys: y 2024-06-18T02:09:06.181 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:05 smithi007 systemd[1]: Starting Ceph mgr.y for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:09:06.181 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:06 smithi007 podman[77836]: 2024-06-18 02:09:06.109061112 +0000 UTC m=+0.085949661 container create 27b4fd4b27c1c1e85737f5e61c8e5d579ae62e84201c0ad2e5272b823133b38c (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240612, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, RELEASE=squid-3781e3a, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, ceph=True) 2024-06-18T02:09:06.182 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:06 smithi007 podman[77836]: 2024-06-18 02:09:06.041437815 +0000 UTC m=+0.018326333 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:09:06.482 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:06 smithi007 podman[77836]: 2024-06-18 02:09:06.336713966 +0000 UTC m=+0.313602487 container init 27b4fd4b27c1c1e85737f5e61c8e5d579ae62e84201c0ad2e5272b823133b38c (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y, RELEASE=squid-3781e3a, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240612, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.36.0) 2024-06-18T02:09:06.482 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:06 smithi007 podman[77836]: 2024-06-18 02:09:06.339687095 +0000 UTC m=+0.316575605 container start 27b4fd4b27c1c1e85737f5e61c8e5d579ae62e84201c0ad2e5272b823133b38c (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, RELEASE=squid-3781e3a, org.label-schema.build-date=20240612, maintainer=Guillaume Abrioux ) 2024-06-18T02:09:06.482 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:06 smithi007 ceph-mgr[77855]: -- 172.21.15.7:0/1944754180 <== mon.0 v2:172.21.15.7:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d58fe170e0 con 0x55d58fdf5400 2024-06-18T02:09:06.482 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:06 smithi007 bash[77836]: 27b4fd4b27c1c1e85737f5e61c8e5d579ae62e84201c0ad2e5272b823133b38c 2024-06-18T02:09:06.482 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:06 smithi007 systemd[1]: Started Ceph mgr.y for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:09:06.739 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:06 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[77851]: 2024-06-18T02:09:06.482+0000 7fc7b8746040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-18T02:09:06.739 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:06 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[77851]: 2024-06-18T02:09:06.661+0000 7fc7b8746040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-18T02:09:06.739 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:06 smithi007 ceph-mon[73500]: pgmap v27: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 128 B/s rd, 0 op/s 2024-06-18T02:09:06.739 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:06 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:06.739 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:06 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:06.739 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:06 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:06.739 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:06 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:06.740 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:06 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:06.740 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:06 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:06.740 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:06 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:06.740 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:06 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:06.740 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:06 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-06-18T02:09:06.740 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:06 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-06-18T02:09:06.740 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:06 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2024-06-18T02:09:06.740 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:06 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-06-18T02:09:06.740 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:06 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-06-18T02:09:06.740 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:06 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-06-18T02:09:06.740 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:06 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:06.741 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:06 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:06.741 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:06 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:06.741 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:06 smithi007 ceph-mon[29879]: pgmap v27: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 128 B/s rd, 0 op/s 2024-06-18T02:09:06.741 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:06 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:06.741 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:06 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:06.741 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:06 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:06.741 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:06 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:06.741 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:06 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:06.741 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:06 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:06.741 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:06 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:06.742 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:06 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:06.742 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:06 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-06-18T02:09:06.742 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:06 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-06-18T02:09:06.742 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:06 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2024-06-18T02:09:06.742 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:06 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-06-18T02:09:06.742 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:06 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-06-18T02:09:06.742 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:06 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-06-18T02:09:06.742 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:06 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:06.742 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:06 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:06.743 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:06 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:06.985 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:06 smithi130 ceph-mon[26123]: pgmap v27: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 128 B/s rd, 0 op/s 2024-06-18T02:09:06.986 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:06 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:06.986 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:06 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:06.986 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:06 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:06.986 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:06 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:06.986 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:06 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:06.986 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:06 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:06.986 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:06 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:06.986 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:06 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:06.986 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:06 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-06-18T02:09:06.986 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:06 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-06-18T02:09:06.986 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:06 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2024-06-18T02:09:06.986 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:06 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-06-18T02:09:06.987 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:06 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-06-18T02:09:06.987 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:06 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-06-18T02:09:06.987 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:06 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:06.987 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:06 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:06.987 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:06 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:07.296 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:06 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[77851]: 2024-06-18T02:09:06.739+0000 7fc7b8746040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-18T02:09:07.296 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[77851]: 2024-06-18T02:09:07.008+0000 7fc7b8746040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-18T02:09:07.296 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[77851]: 2024-06-18T02:09:07.076+0000 7fc7b8746040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-18T02:09:07.963 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[29879]: pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 135 B/s rd, 0 op/s 2024-06-18T02:09:07.963 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:07.963 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[29879]: Upgrade: Setting container_image for all mgr 2024-06-18T02:09:07.963 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:07.963 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:07.963 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:07.963 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:07.963 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:07.963 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:07.963 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:07.963 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:07.964 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:07.964 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:07.964 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:07.964 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:07.964 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:07.964 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:07.964 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:07.964 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:07.964 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:07.964 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:07.964 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:07.964 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:07.964 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:07.964 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:07.965 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:07.965 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:07.965 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:07.965 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:07.965 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:07.965 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[73500]: pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 135 B/s rd, 0 op/s 2024-06-18T02:09:07.965 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:07.965 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[73500]: Upgrade: Setting container_image for all mgr 2024-06-18T02:09:07.965 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:07.965 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:07.966 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:07.966 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:07.966 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:07.966 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:07.966 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:07.966 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:07.966 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:07.966 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:07.966 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:07.966 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:07.966 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:07.966 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:07.966 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:07.966 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:07.967 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:07.967 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:07.967 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:07.967 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:07.967 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:07.967 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:07.967 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:07.967 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:07.967 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:07.967 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:07.967 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:07.968 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:07.968 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:07.968 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:07.968 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:07.968 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:07.968 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:07.968 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:07.968 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:07.968 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:07.968 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:07.968 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:07.968 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:07.968 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[29879]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-06-18T02:09:07.969 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[29879]: Cluster is now healthy 2024-06-18T02:09:07.969 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:07.969 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:07.969 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:07.969 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:07.969 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:07.969 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:07.969 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:07.969 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:07.969 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:07.969 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:07.969 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:07.970 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:07.970 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:07.970 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:07.970 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:07.970 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:07.970 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:07.970 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[73500]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-06-18T02:09:07.970 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[73500]: Cluster is now healthy 2024-06-18T02:09:07.970 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:07.970 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:07.970 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:07.970 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:07.970 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:07 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:07.986 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:09:07 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:09:07] "GET /metrics HTTP/1.1" 200 38237 "" "Prometheus/2.33.4" 2024-06-18T02:09:07.986 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:07 smithi130 ceph-mon[26123]: pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 135 B/s rd, 0 op/s 2024-06-18T02:09:07.987 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:07 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:07.987 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:07 smithi130 ceph-mon[26123]: Upgrade: Setting container_image for all mgr 2024-06-18T02:09:07.987 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:07 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:07.987 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:07 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:07.987 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:07 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:07.987 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:07 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:07.987 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:07 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:07.987 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:07 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:07.987 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:07 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:07.987 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:07 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:07.987 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:07 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:07.987 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:07 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:07.987 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:07 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:07.987 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:07 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:07.988 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:07 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:07.988 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:07 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:07.988 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:07 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:07.988 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:07 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:07.988 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:07 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:07.988 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:07 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:07.988 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:07 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:07.988 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:07 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:07.988 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:07 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:07.988 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:07 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:07.988 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:07 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:07.988 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:07 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:07.989 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:07 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:07.989 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:07 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:07.989 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:07 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:07.989 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:07 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:07.989 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:07 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:07.989 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:07 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:07.989 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:07 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:07.989 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:07 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:07.989 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:07 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:07.989 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:07 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:07.989 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:07 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:07.989 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:07 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:07.989 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:07 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:07.989 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:07 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:07.990 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:07 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:07.990 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:07 smithi130 ceph-mon[26123]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-06-18T02:09:07.990 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:07 smithi130 ceph-mon[26123]: Cluster is now healthy 2024-06-18T02:09:07.990 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:07 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:07.990 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:07 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:07.990 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:07 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:07.990 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:07 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:07.990 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:07 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:08.576 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[77851]: 2024-06-18T02:09:08.216+0000 7fc7b8746040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-18T02:09:08.576 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[77851]: 2024-06-18T02:09:08.355+0000 7fc7b8746040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-18T02:09:08.576 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[77851]: 2024-06-18T02:09:08.420+0000 7fc7b8746040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-18T02:09:08.837 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[77851]: 2024-06-18T02:09:08.673+0000 7fc7b8746040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-18T02:09:08.837 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[77851]: 2024-06-18T02:09:08.757+0000 7fc7b8746040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-18T02:09:08.837 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[77851]: 2024-06-18T02:09:08.837+0000 7fc7b8746040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-18T02:09:08.837 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:08.837 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:08.838 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:08.838 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:08.838 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:08.838 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:08.838 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:08.838 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:08.838 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:08.838 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:08.838 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:08.838 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:08.838 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:08.838 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:08.838 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:08.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:08.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:08.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:08.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:08.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:08.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:08.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:08.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:08.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:08.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:08.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:08.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:08.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:08.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:08.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:08.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:08.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:08.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:08.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:08.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:08.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:08.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:08.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:08.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:08.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:08.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:08.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:08.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:08.841 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:08.841 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:08.841 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:08.841 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:08.841 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:08.841 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:08.841 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:08.841 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:08.842 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:08.842 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:08.842 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:08.842 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:08.842 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:08.842 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:08.842 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:08.842 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:08.842 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:08.842 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:08.842 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:08.842 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:08.842 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:08.843 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:08.843 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:08.843 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:08.843 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:08.843 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:08.843 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:08.843 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:08.843 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:08.843 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:08.843 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:08.843 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:08.843 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:08.843 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:08.844 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:08.844 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:08.844 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:08.844 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:08.844 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:08.844 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:08.844 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:08.844 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:08.844 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:08.844 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:08.844 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:08.844 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:08.844 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:08.844 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:08.845 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:08.845 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:08.845 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:08.845 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:08.845 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:08 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:09.043 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:09:08 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:09:08.659Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.7\", device_class=\"ssd\", hostname=\"smithi007\", instance=\"172.21.15.130:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.7\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"cd9a3408-2d15-11ef-bc9d-c7b262605968\", cluster_addr=\"172.21.15.7\", device_class=\"ssd\", hostname=\"smithi007\", instance=\"smithi130:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.7\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-06-18T02:09:09.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:08 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:09.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:08 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:09.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:08 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:09.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:08 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:09.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:08 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:09.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:09.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:09.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:09.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:09.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:08 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:09.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:08 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:09.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:09.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:09.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:09.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:09.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:08 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:09.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:08 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:09.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:09.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:09.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:09.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:09.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:08 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:09.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:08 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:09.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:09.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:09.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:09.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:09.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:08 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:09.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:09.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:09.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:09.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:09.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:08 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:09.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:09.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:09.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:09.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:09.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:08 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:09.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:09.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:09.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:09.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:09.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:08 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:09.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:09.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:09.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:09.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:09.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:08 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:09.181 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[77851]: 2024-06-18T02:09:08.999+0000 7fc7b8746040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-18T02:09:09.885 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[77851]: 2024-06-18T02:09:09.496+0000 7fc7b8746040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-18T02:09:09.885 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[77851]: 2024-06-18T02:09:09.885+0000 7fc7b8746040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-18T02:09:09.886 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:09.886 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:09.886 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:09.886 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:09.886 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[73500]: pgmap v29: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 642 B/s rd, 0 op/s 2024-06-18T02:09:09.886 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:09.886 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:09.886 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:09.886 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:09.886 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:09.886 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:09.886 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:09.886 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:09.887 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:09.887 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:09.887 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:09.887 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:09.887 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:09.887 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:09.887 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:09.887 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:09.887 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:09.887 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:09.887 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:09.887 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:09.887 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:09.887 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:09.888 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:09.888 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:09.888 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:09.888 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:09.888 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:09.888 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:09.888 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:09.888 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:09.889 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:09.889 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:09.889 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:09.889 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:09.889 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:09.889 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:09.889 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:09.889 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:09.889 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:09.889 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:09.889 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:09.889 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:09.889 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:09.890 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:09.890 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:09.890 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:09.890 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:09.890 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:09.890 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:09.890 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:09.890 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:09.890 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:09.891 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:09.891 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:09.891 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:09.891 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:09.891 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[29879]: pgmap v29: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 642 B/s rd, 0 op/s 2024-06-18T02:09:09.891 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:09.891 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:09.891 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:09.891 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:09.891 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:09.891 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:09.891 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:09.892 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:09.892 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:09.892 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:09.892 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:09.892 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:09.892 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:09.892 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:09.892 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:09.892 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:09.892 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:09.892 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:09.892 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:09.892 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:09.892 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:09.893 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:09.893 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:09.893 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:09.893 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:09.893 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:09.893 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:09.893 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:09.893 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:09.893 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:09.893 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:09.893 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:09.893 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:09.893 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:09.893 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:09.894 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:09.894 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:09.894 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:09.894 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:09.894 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:09.894 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:09.894 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:09.894 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:09.894 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:09.894 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:09.894 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:09.894 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:09.894 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:09.895 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:09.895 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:09.895 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:09.895 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:10.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:09 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:10.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:09 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:10.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:09 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:10.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:09 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:10.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:09 smithi130 ceph-mon[26123]: pgmap v29: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 642 B/s rd, 0 op/s 2024-06-18T02:09:10.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:09 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:10.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:10.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:10.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:10.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:10.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:09 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:10.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:09 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:10.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:09 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:10.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:09 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:10.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:09 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:10.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:10.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:10.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:10.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:10.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:09 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:10.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:09 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:10.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:10.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:10.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:10.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:10.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:09 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:10.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:09 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:10.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:10.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:10.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:10.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:10.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:09 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:10.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:10.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:10.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:10.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:10.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:09 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:10.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:10.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:10.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:10.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:10.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:09 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:10.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:10.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:10.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:10.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:10.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:09 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:10.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:10.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:10.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:10.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:10.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:09 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:10.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:10.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:10.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:10.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:10.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:09 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:10.155 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:09 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[77851]: 2024-06-18T02:09:09.964+0000 7fc7b8746040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-18T02:09:10.431 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[77851]: 2024-06-18T02:09:10.157+0000 7fc7b8746040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-18T02:09:10.797 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[77851]: 2024-06-18T02:09:10.516+0000 7fc7b8746040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-18T02:09:10.797 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[77851]: 2024-06-18T02:09:10.586+0000 7fc7b8746040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-18T02:09:10.797 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:10.797 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:10.798 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:10.798 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:10.798 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:10.798 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:10.798 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:10.798 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:10.798 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:10.798 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:10.798 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:10.798 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:10.798 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:10.798 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:10.798 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:10.799 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:10.799 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:10.799 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:10.799 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:10.799 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:10.799 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:10.799 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:10.800 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:10.800 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:10.800 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:10.800 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:10.800 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:10.800 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:10.800 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:10.800 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:10.800 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:10.801 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:10.801 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:10.801 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:10.801 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:10.801 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:10.801 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:10.801 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:10.801 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:10.801 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:10.801 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:10.802 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:10.802 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:10.802 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:10.802 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:10.802 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:10.802 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:10.802 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:10.802 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:10.802 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:10.802 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:10.802 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:10.802 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:10.802 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:10.803 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:10.803 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:10.803 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:10.803 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:10.803 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:10.803 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:10.803 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:10.803 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:10.803 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:10.803 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:10.804 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:10.804 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:10.804 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:10.804 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:10.804 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:10.804 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:10.804 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:10.804 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:10.804 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:10.804 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:10.804 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:10.804 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:10.804 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:10.804 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:10.805 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:10.805 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:10.805 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:10.805 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:10.805 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:10.805 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:10.805 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:10.805 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:10.805 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:10.805 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:10.805 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:10.805 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:10.806 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:10.806 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:10.806 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:10.806 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:10.806 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:10.806 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:10.806 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:10.806 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:10.806 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:10.806 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:10.806 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:10.806 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:10.806 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:10.806 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:10.807 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:10.807 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:10.807 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:10.807 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:11.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:10 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:11.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:10 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:11.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:10 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:11.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:10 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:11.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:10 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:11.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:10 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:11.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:11.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:11.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:11.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:11.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:10 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:11.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:10 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:11.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:11.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:11.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:11.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:11.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:10 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:11.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:10 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:11.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:11.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:11.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:11.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:11.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:10 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:11.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:10 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:11.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:11.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:11.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:11.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:11.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:10 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:11.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:11.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:11.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:11.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:11.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:10 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:11.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:11.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:11.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:11.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:11.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:10 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:11.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:11.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:11.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:11.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:11.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:10 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:11.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:11.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:11.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:11.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:11.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:10 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:11.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:11.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:11.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:11.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:11.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:10 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:11.136 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[77851]: 2024-06-18T02:09:10.797+0000 7fc7b8746040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-18T02:09:11.136 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:10 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[77851]: 2024-06-18T02:09:10.964+0000 7fc7b8746040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-18T02:09:11.136 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[77851]: 2024-06-18T02:09:11.036+0000 7fc7b8746040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-18T02:09:11.136 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[77851]: 2024-06-18T02:09:11.136+0000 7fc7b8746040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-18T02:09:11.396 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[77851]: 2024-06-18T02:09:11.202+0000 7fc7b8746040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-18T02:09:12.006 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[77851]: 2024-06-18T02:09:11.828+0000 7fc7b8746040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-18T02:09:12.007 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[77851]: 2024-06-18T02:09:12.006+0000 7fc7b8746040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-18T02:09:12.007 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:12.007 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:12.007 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:12.007 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:12.007 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[29879]: pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 542 B/s rd, 0 op/s 2024-06-18T02:09:12.007 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:12.007 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:12.007 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:12.008 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:12.008 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:12.008 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:12.008 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:12.008 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:12.008 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:12.008 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:12.008 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:12.008 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:12.008 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:12.008 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:12.008 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:12.008 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:12.009 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:12.009 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:12.009 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:12.009 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:12.009 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:12.009 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:12.009 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:12.009 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:12.009 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:12.009 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:12.009 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:12.010 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:12.010 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:12.010 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:12.010 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[73500]: pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 542 B/s rd, 0 op/s 2024-06-18T02:09:12.010 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:12.010 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:12.010 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:12.010 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:12.010 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:12.010 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:12.010 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:12.010 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:12.010 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:12.011 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:12.011 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:12.011 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:12.011 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:12.011 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:12.011 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:12.011 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:12.011 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:12.011 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:12.011 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:12.011 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:12.012 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:12.012 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:12.012 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:12.012 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:12.012 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:12.012 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:12.012 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:09:12.012 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:12.012 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:12.013 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:12.013 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:12.013 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:12.013 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:12.013 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:12.013 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:12.013 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:12.013 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:12.013 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:12.013 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:12.013 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:12.013 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:12.013 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:12.013 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:12.014 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:12.014 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:12.014 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:12.014 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:12.014 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:09:12.014 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:12.014 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:12.014 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:12.014 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:12.014 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:12.014 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:12.015 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:12.015 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:12.015 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:12.015 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:12.015 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:12.015 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:12.015 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:12.015 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:12.015 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:12.015 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:12.015 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:12.015 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:12.015 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:12.015 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:11 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:12.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:11 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:12.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:11 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:12.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:11 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:12.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:11 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:12.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:11 smithi130 ceph-mon[26123]: pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 542 B/s rd, 0 op/s 2024-06-18T02:09:12.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:11 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:12.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:11 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:12.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:12.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:12.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:12.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:12.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:11 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:12.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:11 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:12.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:12.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:12.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:12.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:12.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:11 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:12.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:11 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:12.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:12.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:12.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:12.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:12.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:11 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:12.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:11 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:12.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:12.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:12.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:12.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:12.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:11 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:12.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:11 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:12.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:09:12.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:12.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:12.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:12.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:12.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:11 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:12.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:12.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:12.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:12.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:12.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:11 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:12.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:12.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:12.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:12.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:12.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:11 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:12.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:12.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:12.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:12.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:12.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:11 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:12.317 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[77851]: [18/Jun/2024:02:09:12] ENGINE Bus STARTING 2024-06-18T02:09:12.317 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[77851]: CherryPy Checker: 2024-06-18T02:09:12.317 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[77851]: The Application mounted at '' has an empty config. 2024-06-18T02:09:12.317 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[77851]: 2024-06-18T02:09:12.317 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[77851]: [18/Jun/2024:02:09:12] ENGINE Serving on http://:::9283 2024-06-18T02:09:12.317 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[77851]: [18/Jun/2024:02:09:12] ENGINE Bus STARTED 2024-06-18T02:09:12.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:12.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:12.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:12.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:12.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:12.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:12.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:12.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:12.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:12.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:12.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:12.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:12.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:12.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:12.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:12.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:12.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:12.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:09:12.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:12.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:12.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:12.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:12.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:12.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:12.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: Standby manager daemon y restarted 2024-06-18T02:09:12.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: Standby manager daemon y started 2024-06-18T02:09:12.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: from='mgr.? 172.21.15.7:0/1030363498' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-06-18T02:09:12.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: from='mgr.? 172.21.15.7:0/1030363498' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-18T02:09:12.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: from='mgr.? 172.21.15.7:0/1030363498' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-06-18T02:09:12.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: from='mgr.? 172.21.15.7:0/1030363498' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-18T02:09:12.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:12.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:12.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:12.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:12.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:12.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:12.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:12.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:12.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:12.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:12.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:12.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:12.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:12.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:12.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:12.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:12.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:12.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:12.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:12.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:12.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:12.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:12.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:12.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:12.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:12.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:12.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:12.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:12.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:12.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:12.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:12.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:12.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:12.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:12.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:12.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:12.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:12.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:12.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:12.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:12.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:12.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:12.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:12.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:12.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:12.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:12.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:12.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:09:12.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:12.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:12.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:12.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:12.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:12.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:12.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: Standby manager daemon y restarted 2024-06-18T02:09:12.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: Standby manager daemon y started 2024-06-18T02:09:12.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: from='mgr.? 172.21.15.7:0/1030363498' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-06-18T02:09:12.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: from='mgr.? 172.21.15.7:0/1030363498' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-18T02:09:12.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: from='mgr.? 172.21.15.7:0/1030363498' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-06-18T02:09:12.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: from='mgr.? 172.21.15.7:0/1030363498' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-18T02:09:12.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:12.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:12.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:12.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:12.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:12.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:12.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:12.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:12.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:12.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:12.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:12.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:12.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:12.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:12.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:12.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:12.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:12.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:12.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:12.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:12.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:12.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:12.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:12.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:12.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:12.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:12.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:12.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:12.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:12.942 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:12 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:13.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:13.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:13.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:13.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:13.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:13.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:13.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:13.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:13.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:13.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:13.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:13.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:13.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:13.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:13.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:13.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:13.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:13.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:09:13.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:13.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:13.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:13.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:13.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:13.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:13.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: Standby manager daemon y restarted 2024-06-18T02:09:13.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: Standby manager daemon y started 2024-06-18T02:09:13.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: from='mgr.? 172.21.15.7:0/1030363498' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-06-18T02:09:13.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: from='mgr.? 172.21.15.7:0/1030363498' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-18T02:09:13.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: from='mgr.? 172.21.15.7:0/1030363498' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-06-18T02:09:13.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: from='mgr.? 172.21.15.7:0/1030363498' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-18T02:09:13.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:13.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:13.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:13.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:13.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:13.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:13.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:13.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:13.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:13.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:13.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:13.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:13.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:13.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:13.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:13.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:13.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:13.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:13.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:13.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:13.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:13.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:13.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:13.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:13.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:13.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:13.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:13.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:13.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:13.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:12 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:13.793 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:09:13 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:09:13.505Z caller=manager.go:609 level=warn component="rule manager" group=nodes msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on(instance) group_left(nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi007\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"cd9a3408-2d15-11ef-bc9d-c7b262605968\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-06-18T02:09:13.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:13 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:13.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:13 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:13.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:13 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:13.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:13 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:13.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:13 smithi130 ceph-mon[26123]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 993 B/s rd, 1 op/s 2024-06-18T02:09:13.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:13 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:13.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:13 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:13.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:13.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:13.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:13.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:13.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:13 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:13.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:13 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:13.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:13.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:13.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:13.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:13.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:13 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:13.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:13 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:13.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:13 smithi130 ceph-mon[26123]: mgrmap e45: x(active, since 31s), standbys: y 2024-06-18T02:09:13.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:13.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:13.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:13.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:13.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:13 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:13.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:13 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:13.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:13.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:13.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:13.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:13.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:13 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:13.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:13.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:13.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:13.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:13.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:13 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:13.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:13.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:13.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:13.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:13.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:13 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:13.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:13.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:13.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:13.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:13.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:13 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:13.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:13.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:13.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:13.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:13.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:13 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:13.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:13.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:13.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:13.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:13.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:13 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:14.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:14.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:14.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:14.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:14.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[73500]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 993 B/s rd, 1 op/s 2024-06-18T02:09:14.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:14.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:14.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:14.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:14.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:14.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:14.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:14.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:14.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:14.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:14.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:14.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:14.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:14.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:14.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[73500]: mgrmap e45: x(active, since 31s), standbys: y 2024-06-18T02:09:14.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:14.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:14.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:14.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:14.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:14.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:14.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:14.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:14.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:14.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:14.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:14.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:14.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:14.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:14.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:14.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[29879]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 993 B/s rd, 1 op/s 2024-06-18T02:09:14.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:14.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:14.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:14.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:14.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:14.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:14.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:14.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:14.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:14.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:14.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:14.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:14.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:14.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:14.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[29879]: mgrmap e45: x(active, since 31s), standbys: y 2024-06-18T02:09:14.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:14.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:14.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:14.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:14.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:14.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:14.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:14.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:14.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:14.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:14.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:14.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:14.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:14.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:14.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:14.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:14.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:14.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:14.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:14.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:14.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:14.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:14.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:14.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:14.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:14.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:14.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:14.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:14.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:14.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:14.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:14.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:14.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:14.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:14.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:14.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:14.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:14.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:14.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:14.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:14.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:14.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:14.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:14.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:14.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:14.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:14.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:14.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:14.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:14.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:14.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:14.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:14.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:14.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:14.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:14.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:14.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:14.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:14.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:14.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:14.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:13 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:14.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:14.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:14.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:14.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:14.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:14.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:14.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:14.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:14.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:14.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:14.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:14.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:14.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:14.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:14.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:14.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:14.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:14.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:14.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:14.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:14.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:14.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:14.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:14.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:14.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:14.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:14.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:14.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:14.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:14.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:14.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:14.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:14.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:14.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:14.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:14.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:14.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:14.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:14.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:14.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:14.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:14.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:14.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:14.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:14.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:14.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:14.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:14.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:14.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:14.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:14.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:14.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:14.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:14.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:14.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:14.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:14.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:14.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:14.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:14.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:14.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:14.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:14.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:14.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:14.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:14.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:14.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:14.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:14.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:14.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:14.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:14.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:14.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:14.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:14.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:14.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:14.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:14.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:14.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:14.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:14.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:14.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:14.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:14.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:14.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:14.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:14.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:14.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:14.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:14.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:14.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:14.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:14.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:14.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:14.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:14.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:14.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:14.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:14 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:15.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:14 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:15.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:14 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:15.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:14 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:15.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:14 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:15.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:14 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:15.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:14 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:15.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:15.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:15.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:15.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:15.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:14 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:15.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:14 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:15.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:15.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:15.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:15.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:15.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:14 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:15.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:14 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:15.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:15.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:15.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:15.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:15.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:14 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:15.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:14 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:15.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:15.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:15.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:15.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:15.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:14 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:15.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:15.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:15.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:15.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:15.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:14 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:15.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:15.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:15.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:15.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:15.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:14 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:15.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:15.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:15.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:15.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:15.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:14 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:15.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:15.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:15.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:15.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:15.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:14 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:15.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:15.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:15.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:15.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:15.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[73500]: pgmap v32: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 903 B/s rd, 0 op/s 2024-06-18T02:09:15.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:15.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:15.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:15.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:15.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:15.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:15.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:15.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:15.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:15.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:15.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:15.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:15.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:15.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:15.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:15.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:15.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:15.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:15.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:15.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:15.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:15.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:15.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:15.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:15.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:15.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:15.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:15.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:15.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:15.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[29879]: pgmap v32: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 903 B/s rd, 0 op/s 2024-06-18T02:09:15.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:15.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:15.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:15.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:15.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:15.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:15.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:15.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:15.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:15.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:15.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:15.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:15.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:15.942 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:15.942 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:15.942 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:15.942 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:15.942 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:15.943 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:15.943 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:15.943 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:15.943 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:15.943 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:15.943 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:15.944 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:15.944 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:15.944 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:15.945 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:15.945 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:15.945 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:15.945 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:15.945 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:15.945 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:15.946 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:15.946 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:15.946 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:15.946 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:15.946 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:15.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:15.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:15.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:15.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:15.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:15.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:15.948 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:15.948 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:15.948 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:15.948 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:15.948 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:15.949 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:15.949 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:15.949 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:15.949 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:15.949 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:15.950 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:15.950 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:15.950 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:15.950 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:15.950 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:15.951 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:15.951 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:15.951 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:15.951 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:15.951 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:15.952 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:15.952 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:15.952 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:15.952 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:15.952 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:15.952 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:15.953 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:15.953 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:15.953 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:15 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:16.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:15 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:16.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:15 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:16.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:15 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:16.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:15 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:16.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:15 smithi130 ceph-mon[26123]: pgmap v32: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 903 B/s rd, 0 op/s 2024-06-18T02:09:16.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:15 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:16.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:16.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:16.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:16.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:16.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:15 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:16.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:15 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:16.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:16.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:16.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:16.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:16.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:15 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:16.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:15 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:16.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:16.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:16.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:16.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:16.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:15 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:16.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:15 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:16.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:16.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:16.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:16.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:16.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:15 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:16.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:16.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:16.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:16.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:16.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:15 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:16.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:16.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:16.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:16.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:16.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:15 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:16.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:16.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:16.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:16.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:16.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:15 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:16.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:16.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:16.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:16.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:16.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:15 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:16.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:16.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:16.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:16.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:16.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:15 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:17.019 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:17.019 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:17.019 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:17.019 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:17.019 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:17.019 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:17.019 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:17.019 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:17.019 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:17.020 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:17.020 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:17.020 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:17.020 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:17.020 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:17.020 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:17.020 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:17.020 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:17.020 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:17.020 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:17.020 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:17.020 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:17.020 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:17.020 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:17.021 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:17.021 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:17.021 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:17.021 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:17.021 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:17.021 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:17.021 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:17.021 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:17.021 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:17.021 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:17.022 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:17.022 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:17.022 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:17.022 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:17.022 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:17.023 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:17.023 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:17.023 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:17.023 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:17.023 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:17.023 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:17.023 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:17.024 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:17.024 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:17.024 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:17.024 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:17.024 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:17.024 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:17.024 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:17.025 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:17.025 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:17.025 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:17.025 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:17.026 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:17.026 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:17.026 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:17.026 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:17.026 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:17.026 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:17.026 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:17.027 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:17.027 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:17.027 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:17.027 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:17.027 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:17.028 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:17.028 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:17.028 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:17.028 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:17.028 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:17.028 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:17.029 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:17.029 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:17.029 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:17.029 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:17.029 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:17.029 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:17.029 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:17.029 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:17.029 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:17.030 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:17.030 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:17.030 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:17.030 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:17.030 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:17.030 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:17.030 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:17.030 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:17.030 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:17.030 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:17.030 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:17.030 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:17.031 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:17.031 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:17.031 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:17.031 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:17.031 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:17.031 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:17.031 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:17.031 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:17.031 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:17.031 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:17.031 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:17.031 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:17.031 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:16 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:17.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:16 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:17.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:16 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:17.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:16 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:17.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:16 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:17.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:16 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:17.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:16 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:17.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:17.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:17.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:17.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:17.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:16 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:17.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:16 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:17.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:17.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:17.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:17.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:17.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:16 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:17.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:16 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:17.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:17.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:17.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:17.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:17.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:16 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:17.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:16 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:17.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:17.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:17.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:17.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:17.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:16 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:17.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:17.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:17.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:17.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:17.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:16 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:17.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:17.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:17.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:17.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:17.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:16 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:17.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:17.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:17.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:17.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:17.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:16 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:17.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:17.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:17.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:17.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:17.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:16 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:17.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:17.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:17.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:17.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:17.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:16 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:17.984 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:09:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:09:17] "GET /metrics HTTP/1.1" 200 38238 "" "Prometheus/2.33.4" 2024-06-18T02:09:17.985 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:17 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:17.985 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:17 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:17.985 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:17 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:17.985 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:17 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:17.985 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:17 smithi130 ceph-mon[26123]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 903 B/s rd, 0 op/s 2024-06-18T02:09:17.985 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:17 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:17.985 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:17 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:17.985 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:17.985 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:17.985 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:17.985 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:17.986 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:17 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:17.986 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:17 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:17.986 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:17.986 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:17.986 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:17.986 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:17.986 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:17 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:17.986 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:17 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:17.986 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:17.986 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:17.986 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:17.986 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:17.987 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:17 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:17.987 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:17 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:17.987 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:17.987 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:17.987 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:17.987 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:17.987 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:17 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:17.987 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:17.987 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:17.987 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:17.987 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:17.987 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:17 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:17.987 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:17.988 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:17.988 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:17.988 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:17.988 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:17 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:17.988 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:17.988 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:17.988 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:17.988 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:17.988 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:17 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:17.989 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:17.989 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:17.989 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:17.989 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:17.989 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:17 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:17.989 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:17.989 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:17.989 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:17.989 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:17.989 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:17 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:18.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:18.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:18.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:18.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:18.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[73500]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 903 B/s rd, 0 op/s 2024-06-18T02:09:18.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:18.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:18.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:18.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:18.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:18.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:18.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:18.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:18.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:18.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:18.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:18.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:18.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:18.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:18.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:18.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:18.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:18.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:18.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:18.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:18.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:18.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:18.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:18.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:18.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:18.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:18.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:18.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:18.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:18.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[29879]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 903 B/s rd, 0 op/s 2024-06-18T02:09:18.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:18.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:18.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:18.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:18.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:18.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:18.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:18.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:18.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:18.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:18.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:18.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:18.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:18.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:18.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:18.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:18.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:18.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:18.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:18.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:18.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:18.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:18.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:18.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:18.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:18.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:18.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:18.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:18.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:18.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:18.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:18.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:18.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:18.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:18.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:18.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:18.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:18.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:18.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:18.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:18.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:18.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:18.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:18.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:18.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:18.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:18.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:18.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:18.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:18.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:18.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:18.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:18.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:18.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:18.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:18.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:18.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:18.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:18.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:18.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:18.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:18.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:18.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:18.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:18.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:18.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:18.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:18.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:18.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:18.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:18.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:18.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:18.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:18.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:18.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:17 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:18.984 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:18.984 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:18.985 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:18.985 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:18.985 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:18.985 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:18.985 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:18.985 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:18.985 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:18.985 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:18.985 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:18.985 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:18.985 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:18.985 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:18.985 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:18.986 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:18.986 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:18.986 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:18.986 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:18.986 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:18.986 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:18.986 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:18.986 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:18.986 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:18.986 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:18.986 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:18.986 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:18.986 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:18.987 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:18.987 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:18.987 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:18.987 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:18.987 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:18.987 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:18.987 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:18.987 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:18.987 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:18.988 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:18.988 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:18.988 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:18.988 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:18.988 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:18.988 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:18.988 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:18.988 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:18.988 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:18.988 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:18.988 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:18.988 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:18.988 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:18.988 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:18.989 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:18.989 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:18.989 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:18.989 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:18.989 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:18.989 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:18.989 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:18.989 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:18.989 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:18.989 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:18.989 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:18.990 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:18.990 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:18.990 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:18.990 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:18.990 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:18.990 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:18.990 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:18.990 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:18.990 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:18.990 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:18.990 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:18.990 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:18.990 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:18.991 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:18.991 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:18.991 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:18.991 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:18.991 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:18.991 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:18.991 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:18.991 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:18.991 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:18.991 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:18.992 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:18.992 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:18.992 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:18.992 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:18.992 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:18.992 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:18.992 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:18.992 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:18.992 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:18.992 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:18.992 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:18.993 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:18.993 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:18.993 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:18.993 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:18.993 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:18.993 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:18.993 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:18.993 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:18.993 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:18.993 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:18.993 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:18.993 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:18 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:19.043 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:09:18 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:09:18.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.7\", device_class=\"ssd\", hostname=\"smithi007\", instance=\"172.21.15.130:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.7\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"cd9a3408-2d15-11ef-bc9d-c7b262605968\", cluster_addr=\"172.21.15.7\", device_class=\"ssd\", hostname=\"smithi007\", instance=\"smithi130:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.7\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-06-18T02:09:19.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:18 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:19.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:18 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:19.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:18 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:19.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:18 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:19.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:18 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:19.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:18 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:19.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:19.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:19.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:19.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:19.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:18 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:19.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:18 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:19.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:19.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:19.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:19.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:19.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:18 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:19.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:18 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:19.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:19.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:19.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:19.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:19.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:18 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:19.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:18 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:19.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:19.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:19.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:19.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:19.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:18 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:19.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:19.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:19.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:19.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:19.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:18 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:19.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:19.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:19.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:19.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:19.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:18 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:19.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:19.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:19.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:19.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:19.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:18 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:19.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:19.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:19.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:19.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:19.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:18 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:19.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:19.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:19.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:19.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:19.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:18 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:19.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:19.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:19.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:19.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:19.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[73500]: pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:09:19.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:19.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:19.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:19.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:19.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:19.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:19.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:19.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:19.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:19.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:19.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:19.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:19.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:19.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:19.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:19.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:19.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:19.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:19.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:19.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:19.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:19.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:19.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:19.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:19.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:19.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:19.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:19.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:19.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[73500]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-06-18T02:09:19.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:19.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:19.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:19.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:19.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[29879]: pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:09:19.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:19.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:19.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:19.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:19.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:19.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:19.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:19.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:19.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:19.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:19.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:19.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:19.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:19.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:19.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:19.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:19.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:19.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:19.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:19.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:19.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:19.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:19.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:19.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:19.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:19.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:19.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:19.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:19.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:19 smithi007 ceph-mon[29879]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-06-18T02:09:20.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:19 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:20.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:19 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:20.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:19 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:20.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:19 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:20.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:19 smithi130 ceph-mon[26123]: pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:09:20.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:19 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:20.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:19 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:20.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:19 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:20.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:19 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:20.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:19 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:20.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:19 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:20.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:19 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:20.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:19 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:20.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:19 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:20.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:19 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:20.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:19 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:20.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:19 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:20.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:19 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:20.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:19 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:20.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:19 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:20.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:19 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:20.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:19 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:20.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:19 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:20.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:19 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:20.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:19 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:20.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:19 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:20.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:19 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:20.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:19 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:20.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:19 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:20.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:19 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:20.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:19 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:20.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:19 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:20.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:19 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:20.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:19 smithi130 ceph-mon[26123]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-06-18T02:09:20.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:20 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:20.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:20 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:20.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:20 smithi007 ceph-mon[73500]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 947 B/s rd, 0 op/s 2024-06-18T02:09:20.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:20 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:20.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:20 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:20.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:20 smithi007 ceph-mon[29879]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 947 B/s rd, 0 op/s 2024-06-18T02:09:21.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:20 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:21.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:20 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:21.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:20 smithi130 ceph-mon[26123]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 947 B/s rd, 0 op/s 2024-06-18T02:09:22.931 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:22 smithi007 ceph-mon[29879]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 947 B/s rd, 0 op/s 2024-06-18T02:09:22.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:22 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:22.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:22 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:22.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:22 smithi007 ceph-mon[29879]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:09:22.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:22 smithi007 ceph-mon[29879]: pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 548 B/s rd, 0 op/s 2024-06-18T02:09:22.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:22 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:22.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:22 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-18T02:09:22.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:22 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-18T02:09:22.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:22 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-18T02:09:22.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:22 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:22.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:22 smithi007 ceph-mon[73500]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 947 B/s rd, 0 op/s 2024-06-18T02:09:22.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:22 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:22.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:22 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:22.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:22 smithi007 ceph-mon[73500]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:09:22.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:22 smithi007 ceph-mon[73500]: pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 548 B/s rd, 0 op/s 2024-06-18T02:09:22.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:22 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:22.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:22 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-18T02:09:22.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:22 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-18T02:09:22.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:22 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-18T02:09:22.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:22 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:23.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:22 smithi130 ceph-mon[26123]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 947 B/s rd, 0 op/s 2024-06-18T02:09:23.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:22 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:23.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:22 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:23.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:22 smithi130 ceph-mon[26123]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:09:23.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:22 smithi130 ceph-mon[26123]: pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 548 B/s rd, 0 op/s 2024-06-18T02:09:23.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:22 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:23.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:22 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-18T02:09:23.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:22 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-18T02:09:23.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:22 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-18T02:09:23.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:22 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:23.793 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:09:23 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:09:23.505Z caller=manager.go:609 level=warn component="rule manager" group=nodes msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on(instance) group_left(nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi007\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"cd9a3408-2d15-11ef-bc9d-c7b262605968\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-06-18T02:09:24.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:23 smithi007 ceph-mon[73500]: Upgrade: Updating mgr.y 2024-06-18T02:09:24.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:23 smithi007 ceph-mon[73500]: Deploying daemon mgr.y on smithi007 2024-06-18T02:09:24.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:23 smithi007 ceph-mon[73500]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-06-18T02:09:24.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:23 smithi007 ceph-mon[73500]: Cluster is now healthy 2024-06-18T02:09:24.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:23 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:24.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:23 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:24.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:23 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:24.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:23 smithi007 ceph-mon[29879]: Upgrade: Updating mgr.y 2024-06-18T02:09:24.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:23 smithi007 ceph-mon[29879]: Deploying daemon mgr.y on smithi007 2024-06-18T02:09:24.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:23 smithi007 ceph-mon[29879]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-06-18T02:09:24.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:23 smithi007 ceph-mon[29879]: Cluster is now healthy 2024-06-18T02:09:24.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:23 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:24.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:23 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:24.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:23 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:24.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:23 smithi130 ceph-mon[26123]: Upgrade: Updating mgr.y 2024-06-18T02:09:24.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:23 smithi130 ceph-mon[26123]: Deploying daemon mgr.y on smithi007 2024-06-18T02:09:24.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:23 smithi130 ceph-mon[26123]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-06-18T02:09:24.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:23 smithi130 ceph-mon[26123]: Cluster is now healthy 2024-06-18T02:09:24.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:23 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:24.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:23 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:24.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:23 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:24.650 INFO:teuthology.orchestra.run.smithi007.stdout:true 2024-06-18T02:09:24.860 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:24 smithi007 systemd[1]: Stopping Ceph mgr.y for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:09:25.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:24 smithi007 ceph-mon[73500]: pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-06-18T02:09:25.182 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:24 smithi007 podman[83017]: 2024-06-18 02:09:24.897078584 +0000 UTC m=+0.129505056 container died 27b4fd4b27c1c1e85737f5e61c8e5d579ae62e84201c0ad2e5272b823133b38c (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y, RELEASE=squid-3781e3a, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.build-date=20240612, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0) 2024-06-18T02:09:25.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:24 smithi007 ceph-mon[29879]: pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-06-18T02:09:25.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:24 smithi130 ceph-mon[26123]: pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-06-18T02:09:25.360 INFO:teuthology.orchestra.run.smithi007.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-18T02:09:25.361 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi007 smithi007 running 2s ago 12m - - 2024-06-18T02:09:25.361 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi130 smithi130 running 16s ago 12m - - 2024-06-18T02:09:25.361 INFO:teuthology.orchestra.run.smithi007.stdout:alertmanager.a smithi007 *:9093,9094 running (2m) 2s ago 7m 15.6M - 0.23.0 ba2b418f427c 5994e8525c64 2024-06-18T02:09:25.361 INFO:teuthology.orchestra.run.smithi007.stdout:grafana.a smithi130 *:3000 running (115s) 16s ago 6m 41.2M - 8.3.5 dad864ee21e9 70ba81d97c8e 2024-06-18T02:09:25.361 INFO:teuthology.orchestra.run.smithi007.stdout:iscsi.foo.smithi007.xvdrwd smithi007 running (24s) 2s ago 5m 46.2M - 3.5 e1d6a67b021e 94121ad2702c 2024-06-18T02:09:25.361 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.x smithi130 *:8443,9283,8765 running (82s) 16s ago 11m 495M - 19.0.0-3124-g3781e3a5 af93c036e016 01017e37bdbe 2024-06-18T02:09:25.362 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.y smithi007 *:8443,9283,8765 running (19s) 2s ago 13m 440M - 19.0.0-3124-g3781e3a5 af93c036e016 27b4fd4b27c1 2024-06-18T02:09:25.362 INFO:teuthology.orchestra.run.smithi007.stdout:mon.a smithi007 running (51s) 2s ago 13m 45.5M 2048M 19.0.0-3124-g3781e3a5 af93c036e016 670d7777ae9b 2024-06-18T02:09:25.362 INFO:teuthology.orchestra.run.smithi007.stdout:mon.b smithi130 running (12m) 16s ago 12m 64.9M 2048M 17.2.0 e1d6a67b021e a0b38a9a595f 2024-06-18T02:09:25.362 INFO:teuthology.orchestra.run.smithi007.stdout:mon.c smithi007 running (12m) 2s ago 12m 49.3M 2048M 17.2.0 e1d6a67b021e 1d1e2628656b 2024-06-18T02:09:25.362 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.a smithi007 *:9100 running (2m) 2s ago 7m 16.8M - 1.3.1 1dbe0e931976 8128e558f099 2024-06-18T02:09:25.363 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.b smithi130 *:9100 running (119s) 16s ago 7m 16.8M - 1.3.1 1dbe0e931976 bab93b43cf16 2024-06-18T02:09:25.363 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0 smithi007 running (11m) 2s ago 11m 54.5M 4096M 17.2.0 e1d6a67b021e 1ef6e23afd55 2024-06-18T02:09:25.363 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1 smithi007 running (11m) 2s ago 11m 56.1M 4096M 17.2.0 e1d6a67b021e a967706523cb 2024-06-18T02:09:25.363 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2 smithi007 running (10m) 2s ago 10m 50.6M 4096M 17.2.0 e1d6a67b021e 2c1b76bd0876 2024-06-18T02:09:25.363 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3 smithi007 running (10m) 2s ago 10m 54.6M 4096M 17.2.0 e1d6a67b021e 8b91b2a07564 2024-06-18T02:09:25.363 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4 smithi130 running (9m) 16s ago 9m 55.5M 4096M 17.2.0 e1d6a67b021e c428dccffdf0 2024-06-18T02:09:25.364 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5 smithi130 running (9m) 16s ago 9m 54.1M 4096M 17.2.0 e1d6a67b021e f645d7f12378 2024-06-18T02:09:25.364 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6 smithi130 running (9m) 16s ago 9m 50.2M 4096M 17.2.0 e1d6a67b021e c7af86c14959 2024-06-18T02:09:25.364 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7 smithi130 running (8m) 16s ago 8m 53.7M 4096M 17.2.0 e1d6a67b021e 3688af8b2c46 2024-06-18T02:09:25.364 INFO:teuthology.orchestra.run.smithi007.stdout:prometheus.a smithi130 *:9095 running (56s) 16s ago 8m 60.7M - 2.33.4 514e6a882f6e e905fb2eb4a6 2024-06-18T02:09:25.364 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi007.dvbvbk smithi007 *:8000 running (6m) 2s ago 6m 75.8M - 17.2.0 e1d6a67b021e 1344b55b763c 2024-06-18T02:09:25.365 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi130.aakmof smithi130 *:8000 running (6m) 16s ago 6m 73.5M - 17.2.0 e1d6a67b021e e257e3230c6c 2024-06-18T02:09:25.365 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi007.hgrnmk smithi007 *:80 running (6m) 2s ago 6m 74.0M - 17.2.0 e1d6a67b021e 2173947bc4d6 2024-06-18T02:09:25.367 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi130.wwebfk smithi130 *:80 running (5m) 16s ago 5m 75.5M - 17.2.0 e1d6a67b021e 8662706b2231 2024-06-18T02:09:25.557 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:25 smithi007 podman[83017]: 2024-06-18 02:09:25.265013442 +0000 UTC m=+0.497439904 container cleanup 27b4fd4b27c1c1e85737f5e61c8e5d579ae62e84201c0ad2e5272b823133b38c (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-3781e3a, org.label-schema.build-date=20240612, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47) 2024-06-18T02:09:25.557 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:25 smithi007 bash[83017]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y 2024-06-18T02:09:25.831 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:25 smithi007 podman[83030]: 2024-06-18 02:09:25.558182128 +0000 UTC m=+0.662737234 container remove 27b4fd4b27c1c1e85737f5e61c8e5d579ae62e84201c0ad2e5272b823133b38c (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y, io.buildah.version=1.36.0, org.label-schema.build-date=20240612, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-3781e3a, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.vendor=CentOS) 2024-06-18T02:09:25.831 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:25 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-06-18T02:09:25.832 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:25 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mgr.y.service: Failed with result 'exit-code'. 2024-06-18T02:09:25.832 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:25 smithi007 systemd[1]: Stopped Ceph mgr.y for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:09:25.832 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:25 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mgr.y.service: Consumed 6.591s CPU time. 2024-06-18T02:09:25.832 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:09:25.832 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": { 2024-06-18T02:09:25.832 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2, 2024-06-18T02:09:25.832 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 1 2024-06-18T02:09:25.832 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:09:25.832 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": { 2024-06-18T02:09:25.833 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 2 2024-06-18T02:09:25.833 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:09:25.833 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": { 2024-06-18T02:09:25.833 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-06-18T02:09:25.833 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:09:25.833 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw": { 2024-06-18T02:09:25.833 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-06-18T02:09:25.833 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:09:25.833 INFO:teuthology.orchestra.run.smithi007.stdout: "overall": { 2024-06-18T02:09:25.833 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 14, 2024-06-18T02:09:25.833 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 3 2024-06-18T02:09:25.833 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-06-18T02:09:25.834 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:09:26.171 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:25 smithi007 systemd[1]: Starting Ceph mgr.y for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:09:26.171 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:25 smithi007 ceph-mon[73500]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:09:26.171 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:25 smithi007 ceph-mon[73500]: from='client.34218 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:09:26.171 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:25 smithi007 ceph-mon[73500]: from='client.? 172.21.15.7:0/64830453' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:26.171 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:25 smithi007 ceph-mon[29879]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:09:26.172 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:25 smithi007 ceph-mon[29879]: from='client.34218 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:09:26.172 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:25 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/64830453' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:26.192 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:09:26.193 INFO:teuthology.orchestra.run.smithi007.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00", 2024-06-18T02:09:26.193 INFO:teuthology.orchestra.run.smithi007.stdout: "in_progress": true, 2024-06-18T02:09:26.193 INFO:teuthology.orchestra.run.smithi007.stdout: "which": "Upgrading all daemon types on all hosts", 2024-06-18T02:09:26.193 INFO:teuthology.orchestra.run.smithi007.stdout: "services_complete": [ 2024-06-18T02:09:26.193 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr" 2024-06-18T02:09:26.193 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-06-18T02:09:26.193 INFO:teuthology.orchestra.run.smithi007.stdout: "progress": "3/23 daemons upgraded", 2024-06-18T02:09:26.193 INFO:teuthology.orchestra.run.smithi007.stdout: "message": "Currently upgrading mgr daemons", 2024-06-18T02:09:26.193 INFO:teuthology.orchestra.run.smithi007.stdout: "is_paused": false 2024-06-18T02:09:26.193 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:09:26.215 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:25 smithi130 ceph-mon[26123]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:09:26.215 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:25 smithi130 ceph-mon[26123]: from='client.34218 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:09:26.215 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:25 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/64830453' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:26.431 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:26 smithi007 podman[83226]: 2024-06-18 02:09:26.075948827 +0000 UTC m=+0.019418875 image pull e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9 quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a 2024-06-18T02:09:26.431 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:26 smithi007 podman[83226]: 2024-06-18 02:09:26.22621127 +0000 UTC m=+0.169681311 container create 24409b02b1aff160df36ace83d50559fa95ddfcd2aabb3dd0e0a352ca323f977 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y, io.openshift.expose-services=, RELEASE=HEAD, vcs-type=git, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., maintainer=Guillaume Abrioux , vendor=Red Hat, Inc., GIT_BRANCH=HEAD, build-date=2022-05-03T08:36:31.336870, distribution-scope=public, version=8, release=754, io.openshift.tags=base centos centos-stream, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, architecture=x86_64, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_REPO=https://github.com/ceph/ceph-container.git, CEPH_POINT_RELEASE=-17.2.0, name=centos-stream, GIT_CLEAN=True, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.k8s.display-name=CentOS Stream 8, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, ceph=True, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, com.redhat.component=centos-stream-container, io.buildah.version=1.19.8) 2024-06-18T02:09:26.617 INFO:teuthology.orchestra.run.smithi007.stdout:HEALTH_OK 2024-06-18T02:09:26.790 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:26 smithi007 podman[83226]: 2024-06-18 02:09:26.472910483 +0000 UTC m=+0.416380526 container init 24409b02b1aff160df36ace83d50559fa95ddfcd2aabb3dd0e0a352ca323f977 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.openshift.tags=base centos centos-stream, CEPH_POINT_RELEASE=-17.2.0, release=754, distribution-scope=public, com.redhat.component=centos-stream-container, name=centos-stream, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, architecture=x86_64, version=8, build-date=2022-05-03T08:36:31.336870, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, ceph=True, vcs-type=git, io.openshift.expose-services=, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=HEAD, io.k8s.display-name=CentOS Stream 8, io.buildah.version=1.19.8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , vendor=Red Hat, Inc., summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly.) 2024-06-18T02:09:26.791 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:26 smithi007 podman[83226]: 2024-06-18 02:09:26.476957875 +0000 UTC m=+0.420427907 container start 24409b02b1aff160df36ace83d50559fa95ddfcd2aabb3dd0e0a352ca323f977 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y, GIT_BRANCH=HEAD, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, build-date=2022-05-03T08:36:31.336870, com.redhat.component=centos-stream-container, architecture=x86_64, GIT_REPO=https://github.com/ceph/ceph-container.git, CEPH_POINT_RELEASE=-17.2.0, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, release=754, distribution-scope=public, io.openshift.tags=base centos centos-stream, maintainer=Guillaume Abrioux , io.buildah.version=1.19.8, RELEASE=HEAD, vcs-type=git, vendor=Red Hat, Inc., ceph=True, GIT_CLEAN=True, version=8, io.k8s.display-name=CentOS Stream 8, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, name=centos-stream, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.openshift.expose-services=, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly.) 2024-06-18T02:09:26.791 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:26 smithi007 ceph-mgr[83267]: -- 172.21.15.7:0/3485241805 <== mon.1 v2:172.21.15.7:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x559f03ede340 con 0x559f03eb6800 2024-06-18T02:09:26.791 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:26 smithi007 bash[83226]: 24409b02b1aff160df36ace83d50559fa95ddfcd2aabb3dd0e0a352ca323f977 2024-06-18T02:09:26.791 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:26 smithi007 systemd[1]: Started Ceph mgr.y for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:09:26.791 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:26 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[83263]: 2024-06-18T02:09:26.644+0000 7fcea5c16000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-18T02:09:26.791 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:26 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[83263]: 2024-06-18T02:09:26.790+0000 7fcea5c16000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-18T02:09:27.049 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:26 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[83263]: 2024-06-18T02:09:26.897+0000 7fcea5c16000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-18T02:09:27.049 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:26 smithi007 ceph-mon[73500]: from='client.25555 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:09:27.049 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:26 smithi007 ceph-mon[73500]: pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-06-18T02:09:27.049 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:26 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:09:27.049 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:26 smithi007 ceph-mon[73500]: from='client.? 172.21.15.7:0/1457918664' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:09:27.049 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:26 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:27.049 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:26 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:27.049 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:26 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:27.049 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:26 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:27.050 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:26 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:27.050 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:26 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:27.050 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:26 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:27.050 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:26 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:27.050 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:26 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:27.050 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:26 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:27.050 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:26 smithi007 ceph-mon[29879]: from='client.25555 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:09:27.050 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:26 smithi007 ceph-mon[29879]: pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-06-18T02:09:27.050 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:26 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:09:27.050 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:26 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/1457918664' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:09:27.050 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:26 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:27.051 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:26 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:27.051 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:26 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:27.051 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:26 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:27.051 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:26 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:27.051 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:26 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:27.051 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:26 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:27.051 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:26 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:27.051 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:26 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:27.051 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:26 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:27.255 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:26 smithi130 ceph-mon[26123]: from='client.25555 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:09:27.256 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:26 smithi130 ceph-mon[26123]: pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-06-18T02:09:27.256 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:26 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:09:27.256 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:26 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/1457918664' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:09:27.256 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:26 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:27.256 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:26 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:27.256 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:26 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:27.256 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:26 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:27.256 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:26 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:27.256 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:26 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:27.256 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:26 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:27.256 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:26 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:27.256 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:26 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:27.256 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:26 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:27.339 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[83263]: 2024-06-18T02:09:27.245+0000 7fcea5c16000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-18T02:09:27.339 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[83263]: 2024-06-18T02:09:27.339+0000 7fcea5c16000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-18T02:09:28.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[73500]: from='client.25567 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:09:28.129 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:28.129 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:28.129 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:28.129 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:28.129 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:28.129 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:28.129 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:28.129 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:28.129 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:28.129 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:28.129 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:28.129 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:28.130 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:28.130 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:28.130 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:28.130 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:28.130 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:28.130 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:28.130 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:28.130 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:28.130 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:28.130 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:28.130 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:28.130 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:28.130 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:28.131 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:28.131 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:28.131 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:28.131 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:28.131 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:28.131 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:28.131 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:28.131 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:28.131 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:28.131 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:28.131 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:28.131 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:28.131 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:28.131 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:28.131 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:28.132 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:28.132 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:28.132 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:28.132 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:28.132 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[29879]: from='client.25567 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:09:28.132 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:28.132 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:28.132 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:28.132 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:28.133 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:28.133 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:28.133 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:28.133 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:28.133 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:28.133 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:28.133 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:28.133 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:28.133 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:28.133 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:28.133 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:28.133 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:28.133 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:28.133 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:28.134 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:28.134 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:28.134 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:28.134 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:28.134 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:28.134 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:28.134 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:28.134 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:28.134 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:28.134 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:28.134 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:28.135 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:28.135 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:28.135 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:28.135 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:28.135 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:28.135 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:28.135 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:28.135 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:28.135 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:28.135 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:28.135 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:28.135 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:28.136 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:28.136 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:28.136 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:27 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:28.233 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:09:27 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:09:27] "GET /metrics HTTP/1.1" 200 38237 "" "Prometheus/2.33.4" 2024-06-18T02:09:28.234 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:27 smithi130 ceph-mon[26123]: from='client.25567 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:09:28.234 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:27 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:28.234 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:27 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:28.235 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:27 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:28.235 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:27 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:28.235 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:27 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:28.235 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:27 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:28.235 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:27 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:28.235 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:27 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:28.235 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:27 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:28.235 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:27 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:28.235 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:27 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:28.235 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:27 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:28.235 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:27 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:28.235 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:27 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:28.235 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:27 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:28.236 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:27 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:28.236 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:27 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:28.236 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:27 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:28.236 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:27 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:28.236 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:27 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:28.236 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:27 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:28.236 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:27 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:28.236 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:27 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:28.236 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:27 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:28.236 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:27 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:28.236 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:27 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:28.236 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:27 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:28.236 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:27 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:28.236 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:27 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:28.237 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:27 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:28.237 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:27 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:28.237 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:27 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:28.237 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:27 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:28.237 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:27 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:28.237 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:27 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:28.237 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:27 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:28.237 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:27 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:28.237 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:27 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:28.237 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:27 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:28.237 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:27 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:28.237 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:27 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:28.237 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:27 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:28.238 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:27 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:28.238 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:27 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:28.865 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:09:28 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:09:28.659Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.7\", device_class=\"ssd\", hostname=\"smithi007\", instance=\"172.21.15.130:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.7\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"cd9a3408-2d15-11ef-bc9d-c7b262605968\", cluster_addr=\"172.21.15.7\", device_class=\"ssd\", hostname=\"smithi007\", instance=\"smithi130:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.7\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-06-18T02:09:28.942 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[83263]: 2024-06-18T02:09:28.685+0000 7fcea5c16000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-18T02:09:28.942 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[83263]: 2024-06-18T02:09:28.871+0000 7fcea5c16000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-18T02:09:28.943 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:28.943 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:28.943 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:28.943 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:28.943 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:28.943 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:28.943 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[29879]: pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-06-18T02:09:28.943 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:28.943 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:28.943 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:28.943 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:28.943 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:28.944 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:28.944 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:28.944 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:28.944 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:28.944 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:28.944 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:28.944 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:28.944 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:28.944 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:28.944 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:28.944 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:28.944 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:28.944 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:28.944 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:28.944 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:28.945 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:28.945 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:28.945 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:28.945 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:28.945 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:28.945 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:28.945 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:28.945 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:28.945 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:28.945 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[73500]: pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-06-18T02:09:28.946 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:28.946 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:28.946 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:28.946 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:28.946 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:28.946 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:28.946 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:28.946 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:28.946 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:28.946 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:28.946 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:28.946 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:28.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:28.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:28.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:28.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:28.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:28.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:28.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:28.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:28.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:28.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:28.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:28.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:28.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:28.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:28.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:28.948 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:28.948 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:28.948 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:28.948 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:28.948 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:28.948 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:28.948 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:28.948 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:28.948 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:28.948 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:28.948 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:28.948 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:28.948 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:28.948 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:28.948 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:28.949 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:28.949 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:28.949 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:28.949 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:28.949 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:28.949 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:28.949 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:28.949 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:28.949 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:28.949 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:28.949 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:28.949 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:28.949 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:28.949 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:28.950 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:28.950 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:28.950 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:28.950 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:28.950 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:29.189 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:28 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:29.189 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:28 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:29.189 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:28 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:29.189 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:28 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:29.189 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:28 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:29.189 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:28 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:29.189 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:28 smithi130 ceph-mon[26123]: pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-06-18T02:09:29.189 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:28 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:29.189 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:28 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:29.189 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:28 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:29.190 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:28 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:29.190 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:28 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:29.190 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:28 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:29.190 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:28 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:29.190 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:28 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:29.190 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:28 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:29.190 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:28 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:29.190 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:28 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:29.190 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:28 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:29.190 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:28 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:29.190 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:28 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:29.190 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:28 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:29.190 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:28 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:29.191 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:28 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:29.191 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:28 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:29.191 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:28 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:29.191 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:28 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:29.191 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:28 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:29.191 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:28 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:29.191 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:28 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:29.191 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:28 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:29.191 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:28 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:29.191 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:28 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:29.191 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:28 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:29.191 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:28 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:29.192 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:28 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:29.192 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:28 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:29.192 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:28 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:29.193 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:28 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:29.194 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:28 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:29.194 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:28 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:29.194 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:28 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:29.194 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:28 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:29.194 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:28 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:29.194 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:28 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:29.194 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:28 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:29.194 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:28 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:29.194 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:28 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:29.194 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:28 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:29.308 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:28 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[83263]: 2024-06-18T02:09:28.972+0000 7fcea5c16000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-18T02:09:29.309 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[83263]: 2024-06-18T02:09:29.308+0000 7fcea5c16000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-18T02:09:29.614 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[83263]: 2024-06-18T02:09:29.405+0000 7fcea5c16000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-18T02:09:29.614 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[83263]: 2024-06-18T02:09:29.510+0000 7fcea5c16000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-18T02:09:29.871 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[83263]: 2024-06-18T02:09:29.773+0000 7fcea5c16000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-18T02:09:30.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:30.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:30.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:30.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:30.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:30.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:30.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:30.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:30.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:30.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:30.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:30.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:30.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:30.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:30.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:30.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:30.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:30.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:30.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:30.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:30.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:30.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:30.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:30.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:30.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:30.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:30.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:30.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:30.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:30.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:30.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:30.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:30.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:30.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:30.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:30.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:30.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:30.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:30.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:30.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:30.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:30.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:30.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:30.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:30.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:30.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:30.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:30.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:30.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:30.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:30.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:30.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:30.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:30.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:30.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:30.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:30.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:30.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:30.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:30.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:30.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:30.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:30.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:30.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:30.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:30.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:30.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:30.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:30.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:30.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:30.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:30.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:30.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:30.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:30.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:30.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:30.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:30.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:30.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:30.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:30.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:30.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:30.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:30.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:30.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:30.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:30.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:30.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:30.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:30.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:30.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:30.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:30.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:30.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:30.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:30.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:30.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:30.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:30.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:30.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:30.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:30.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:30.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:30.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:30.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:30.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:30.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:30.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:30.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:30.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:30.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:30.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:29 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:30.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:29 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:30.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:29 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:30.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:29 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:30.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:29 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:30.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:29 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:30.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:29 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:30.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:30.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:30.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:30.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:30.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:29 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:30.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:29 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:30.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:29 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:30.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:29 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:30.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:29 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:30.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:30.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:30.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:30.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:30.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:29 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:30.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:29 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:30.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:30.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:30.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:30.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:30.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:29 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:30.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:30.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:30.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:30.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:30.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:29 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:30.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:30.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:30.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:30.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:30.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:29 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:30.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:30.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:30.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:30.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:30.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:29 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:30.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:30.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:30.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:30.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:30.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:29 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:30.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:30.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:30.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:30.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:30.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:29 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:30.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:30.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:30.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:30.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:30.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:29 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:30.517 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[83263]: 2024-06-18T02:09:30.256+0000 7fcea5c16000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-18T02:09:31.081 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[83263]: 2024-06-18T02:09:30.809+0000 7fcea5c16000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-18T02:09:31.081 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[83263]: 2024-06-18T02:09:30.913+0000 7fcea5c16000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-18T02:09:31.081 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:31.082 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:31.082 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:31.082 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:31.082 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:31.082 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:31.082 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:31.082 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[73500]: pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 972 B/s rd, 0 op/s 2024-06-18T02:09:31.082 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:31.082 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:31.082 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:31.082 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:31.082 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:31.082 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:31.083 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:31.083 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:31.083 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:31.083 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:31.083 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:31.083 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:31.083 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:31.083 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:31.083 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:31.083 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:31.083 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:31.083 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:31.083 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:31.083 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:31.083 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:31.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:31.084 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:31.084 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:31.084 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:31.084 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:31.084 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:31.084 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:31.084 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:31.084 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[29879]: pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 972 B/s rd, 0 op/s 2024-06-18T02:09:31.084 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:31.084 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:31.085 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:31.085 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:31.085 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:31.085 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:31.085 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:31.085 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:31.085 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:31.085 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:31.085 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:31.085 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:31.085 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:31.085 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:31.085 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:31.086 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:31.086 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:31.086 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:31.086 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:31.086 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:31.086 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:31.086 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:31.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:31.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:31.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:31.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:31.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:31.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:31.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:31.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:31.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:31.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:31.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:31.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:31.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:31.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:31.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:31.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:31.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:31.088 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:31.088 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:31.088 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:31.088 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:31.088 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:31.088 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:31.088 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:31.088 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:31.088 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:31.088 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:31.088 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:31.088 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:31.089 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:31.089 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:31.089 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:31.089 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:31.089 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:31.089 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:31.089 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:31.089 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:31.089 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:30 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:31.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:30 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:31.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:30 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:31.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:30 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:31.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:30 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:31.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:30 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:31.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:30 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:31.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:30 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:31.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:30 smithi130 ceph-mon[26123]: pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 972 B/s rd, 0 op/s 2024-06-18T02:09:31.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:31.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:31.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:31.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:31.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:30 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:31.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:30 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:31.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:31.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:31.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:31.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:31.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:30 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:31.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:31.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:31.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:31.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:31.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:30 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:31.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:31.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:31.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:31.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:31.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:30 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:31.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:31.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:31.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:31.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:31.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:30 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:31.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:31.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:31.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:31.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:31.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:30 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:31.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:31.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:31.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:31.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:31.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:30 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:31.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:31.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:31.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:31.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:31.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:30 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:31.340 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[83263]: 2024-06-18T02:09:31.263+0000 7fcea5c16000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-18T02:09:31.681 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[83263]: 2024-06-18T02:09:31.361+0000 7fcea5c16000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-18T02:09:31.983 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[83263]: 2024-06-18T02:09:31.804+0000 7fcea5c16000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-18T02:09:31.984 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[83263]: 2024-06-18T02:09:31.951+0000 7fcea5c16000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-18T02:09:31.984 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:31.984 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:31.984 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:31.984 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:31.984 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:31.985 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:31.985 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:31.985 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:31.985 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:31.985 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:31.985 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:31.985 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:31.985 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:31.985 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:31.985 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:31.985 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:31.985 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:31.985 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:31.985 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:31.985 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:31.986 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:31.986 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:31.986 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:31.986 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:31.986 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:31.986 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:31.986 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:31.986 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:31.986 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:31.986 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:31.986 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:31.987 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:31.987 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:31.987 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:31.987 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:31.987 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:31.987 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:31.987 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:31.987 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:31.987 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:31.987 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:31.987 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:31.987 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:31.987 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:31.988 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:31.988 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:31.988 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:31.988 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:31.988 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:31.988 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:31.988 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:31.988 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:31.988 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:31.988 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:31.988 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:31.988 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:31.989 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:31.989 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:31.989 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:31.989 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:31.989 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:31.989 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:31.989 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:31.989 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:31.989 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:31.989 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:31.990 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:31.990 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:31.990 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:31.990 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:31.990 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:31.990 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:31.990 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:31.990 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:31.990 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:31.990 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:31.990 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:31.990 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:31.990 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:31.991 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:31.991 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:31.991 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:31.991 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:31.991 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:31.991 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:31.991 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:31.991 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:31.991 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:31.991 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:31.991 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:31.991 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:31.992 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:31.992 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:31.992 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:31.992 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:31.992 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:31.992 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:31.992 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:31.992 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:31.992 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:31.992 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:31.992 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:31.992 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:31.992 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:31.992 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:31.993 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:31.993 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:31.994 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:31 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:32.272 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[83263]: 2024-06-18T02:09:32.064+0000 7fcea5c16000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-18T02:09:32.273 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[83263]: 2024-06-18T02:09:32.192+0000 7fcea5c16000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-18T02:09:32.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:31 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:32.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:31 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:32.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:31 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:32.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:31 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:32.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:31 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:32.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:31 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:32.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:31 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:32.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:32.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:32.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:32.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:32.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:31 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:32.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:31 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:32.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:32.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:32.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:32.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:32.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:31 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:32.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:31 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:32.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:32.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:32.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:32.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:32.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:31 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:32.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:32.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:32.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:32.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:32.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:31 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:32.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:32.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:32.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:32.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:32.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:31 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:32.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:32.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:32.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:32.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:32.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:31 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:32.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:32.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:32.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:32.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:32.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:31 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:32.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:32.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:32.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:32.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:32.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:31 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:32.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:32.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:32.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:32.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:32.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:31 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:32.681 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[83263]: 2024-06-18T02:09:32.292+0000 7fcea5c16000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-18T02:09:33.150 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[83263]: 2024-06-18T02:09:32.903+0000 7fcea5c16000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-18T02:09:33.151 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:33.151 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:33.151 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:33.151 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:33.151 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:33.152 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:33.152 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:33.152 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[29879]: pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 972 B/s rd, 0 op/s 2024-06-18T02:09:33.152 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[29879]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:09:33.152 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:33.152 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:33.152 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:33.152 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:33.152 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:33.152 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:33.152 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:33.152 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:33.152 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:33.152 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:33.153 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:33.153 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:33.153 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:33.153 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:33.153 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:33.153 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:33.153 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:33.153 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:33.153 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:33.153 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:33.153 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:33.153 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:33.154 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:33.154 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:33.154 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:33.154 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:33.154 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:33.154 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:33.154 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[73500]: pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 972 B/s rd, 0 op/s 2024-06-18T02:09:33.154 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[73500]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:09:33.154 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:33.154 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:33.154 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:33.154 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:33.155 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:33.155 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:33.155 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:33.155 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:33.155 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:33.155 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:33.155 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:33.155 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:33.155 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:33.155 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:33.155 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:33.155 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:33.155 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:33.156 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:33.156 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:33.156 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:33.156 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:33.156 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:33.156 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:33.156 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:33.156 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:33.156 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:33.156 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:33.156 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:33.157 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:33.157 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:33.157 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:33.157 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:33.157 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:33.157 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:33.157 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:33.157 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:33.157 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:33.157 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:33.157 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:33.157 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:33.157 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:33.158 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:33.158 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:33.158 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:33.158 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:33.158 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:33.158 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:33.158 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:33.158 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:33.158 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:33.158 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:33.158 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:33.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:33.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:33.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:33.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:33.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:33.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:33.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:33.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:33.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:33.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:33.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:33.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:33.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:33.160 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:33.160 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:33.160 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:33.160 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:33.160 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:33.160 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:32 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:33.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:32 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:33.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:32 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:33.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:32 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:33.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:32 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:33.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:32 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:33.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:32 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:33.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:32 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:33.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:32 smithi130 ceph-mon[26123]: pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 972 B/s rd, 0 op/s 2024-06-18T02:09:33.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:32 smithi130 ceph-mon[26123]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:09:33.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:33.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:33.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:33.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:33.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:32 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:33.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:32 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:33.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:33.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:33.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:33.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:33.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:32 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:33.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:33.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:33.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:33.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:33.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:32 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:33.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:33.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:33.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:33.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:33.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:32 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:33.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:33.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:33.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:33.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:33.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:32 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:33.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:33.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:33.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:33.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:33.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:32 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:33.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:33.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:33.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:33.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:33.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:32 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:33.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:33.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:33.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:33.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:33.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:32 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:33.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:33.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:33.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:33.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:33.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:32 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:33.424 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[83263]: 2024-06-18T02:09:33.316+0000 7fcea5c16000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-18T02:09:33.424 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[83263]: [18/Jun/2024:02:09:33] ENGINE Bus STARTING 2024-06-18T02:09:33.424 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[83263]: CherryPy Checker: 2024-06-18T02:09:33.681 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[83263]: The Application mounted at '' has an empty config. 2024-06-18T02:09:33.682 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[83263]: 2024-06-18T02:09:33.682 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[83263]: [18/Jun/2024:02:09:33] ENGINE Serving on http://:::9283 2024-06-18T02:09:33.682 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[83263]: [18/Jun/2024:02:09:33] ENGINE Bus STARTED 2024-06-18T02:09:33.793 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:09:33 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:09:33.506Z caller=manager.go:609 level=warn component="rule manager" group=nodes msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on(instance) group_left(nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi007\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"cd9a3408-2d15-11ef-bc9d-c7b262605968\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-06-18T02:09:34.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:34.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:34.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:34.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:34.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:34.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:34.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:34.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:34.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:34.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:34.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:34.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:34.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:34.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:34.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:34.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:34.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:34.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:34.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:34.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:34.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:34.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:34.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:34.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:34.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[73500]: Standby manager daemon y restarted 2024-06-18T02:09:34.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[73500]: Standby manager daemon y started 2024-06-18T02:09:34.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[73500]: from='mgr.? 172.21.15.7:0/2' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-06-18T02:09:34.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[73500]: from='mgr.? 172.21.15.7:0/2' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-18T02:09:34.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[73500]: from='mgr.? 172.21.15.7:0/2' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-06-18T02:09:34.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[73500]: from='mgr.? 172.21.15.7:0/2' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-18T02:09:34.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:34.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:34.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:34.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:34.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:34.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:34.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:34.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:34.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:34.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:34.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:34.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:34.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:34.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:34.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:34.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:34.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:34.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:34.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:34.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:34.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:34.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:34.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:34.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:34.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:34.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[29879]: Standby manager daemon y restarted 2024-06-18T02:09:34.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[29879]: Standby manager daemon y started 2024-06-18T02:09:34.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[29879]: from='mgr.? 172.21.15.7:0/2' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-06-18T02:09:34.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[29879]: from='mgr.? 172.21.15.7:0/2' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-18T02:09:34.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[29879]: from='mgr.? 172.21.15.7:0/2' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-06-18T02:09:34.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[29879]: from='mgr.? 172.21.15.7:0/2' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-18T02:09:34.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:34.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:34.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:34.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:34.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:34.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:34.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:34.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:34.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:34.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:34.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:34.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:34.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:34.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:34.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:34.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:34.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:34.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:34.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:34.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:34.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:34.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:34.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:34.191 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:34.191 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:34.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:34.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:34.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:34.192 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:34.192 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:34.192 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:34.192 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:34.192 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:34.192 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:34.192 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:34.192 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:34.193 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:34.193 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:34.193 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:34.193 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:34.193 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:34.193 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:34.193 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:34.193 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:34.194 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:34.194 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:34.194 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:34.194 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:34.194 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:33 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:34.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:33 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:34.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:33 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:34.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:33 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:34.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:33 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:34.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:33 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:34.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:33 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:34.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:33 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:34.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:33 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:34.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:34.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:34.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:34.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:34.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:33 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:34.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:33 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:34.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:34.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:34.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:34.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:34.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:33 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:34.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:34.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:34.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:34.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:34.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:33 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:34.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:33 smithi130 ceph-mon[26123]: Standby manager daemon y restarted 2024-06-18T02:09:34.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:33 smithi130 ceph-mon[26123]: Standby manager daemon y started 2024-06-18T02:09:34.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:33 smithi130 ceph-mon[26123]: from='mgr.? 172.21.15.7:0/2' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-06-18T02:09:34.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:33 smithi130 ceph-mon[26123]: from='mgr.? 172.21.15.7:0/2' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-18T02:09:34.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:33 smithi130 ceph-mon[26123]: from='mgr.? 172.21.15.7:0/2' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-06-18T02:09:34.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:33 smithi130 ceph-mon[26123]: from='mgr.? 172.21.15.7:0/2' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-18T02:09:34.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:34.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:34.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:34.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:34.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:33 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:34.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:34.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:34.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:34.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:34.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:33 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:34.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:34.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:34.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:34.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:34.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:33 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:34.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:34.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:34.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:34.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:34.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:33 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:34.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:34.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:34.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:34.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:34.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:33 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:35.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:35.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:35.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:35.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:35.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:35.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:35.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:35.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[29879]: pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:09:35.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:35.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:35.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:35.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:35.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:35.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:35.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:35.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:35.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:35.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:35.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:35.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:35.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:35.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:35.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:35.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:35.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:35.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[29879]: mgrmap e46: x(active, since 53s), standbys: y 2024-06-18T02:09:35.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:35.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:35.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:35.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:35.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:35.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:35.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:35.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:35.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:35.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:35.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:35.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:35.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[73500]: pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:09:35.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:35.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:35.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:35.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:35.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:35.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:35.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:35.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:35.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:35.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:35.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:35.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:35.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:35.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:35.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:35.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:35.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:35.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[73500]: mgrmap e46: x(active, since 53s), standbys: y 2024-06-18T02:09:35.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:35.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:35.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:35.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:35.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:35.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:35.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:35.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:35.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:35.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:35.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:35.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:35.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:35.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:35.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:35.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:35.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:35.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:35.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:35.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:35.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:35.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:35.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:35.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:35.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:35.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:35.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:35.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:35.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:35.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:35.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:35.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:35.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:35.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:35.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:35.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:35.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:35.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:35.191 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:35.191 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:35.191 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:35.191 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:35.191 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:35.191 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:35.191 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:35.191 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:35.191 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:35.191 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:35.191 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:35.191 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:35.191 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:35.191 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:35.192 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:35.192 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:35.192 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:34 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:35.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:34 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:35.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:34 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:35.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:34 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:35.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:34 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:35.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:34 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:35.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:34 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:35.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:34 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:35.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:34 smithi130 ceph-mon[26123]: pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:09:35.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:35.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:35.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:35.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:35.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:34 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:35.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:34 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:35.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:35.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:35.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:35.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:35.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:34 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:35.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:34 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:35.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:35.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:35.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:35.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:35.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:34 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:35.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:34 smithi130 ceph-mon[26123]: mgrmap e46: x(active, since 53s), standbys: y 2024-06-18T02:09:35.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:35.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:35.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:35.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:35.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:34 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:35.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:35.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:35.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:35.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:35.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:34 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:35.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:35.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:35.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:35.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:35.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:34 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:35.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:35.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:35.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:35.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:35.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:34 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:35.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:35.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:35.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:35.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:35.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:34 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:35.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:35.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:35.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:35.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:35.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:34 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:35.997 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:35.998 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:35.998 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:35.998 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:35.998 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:35.998 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:35.998 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:35.998 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:35.998 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:35.998 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:35.998 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:35.998 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:35.998 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:35.999 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:35.999 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:35.999 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:35.999 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:35.999 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:35.999 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:35.999 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:35.999 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:35.999 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:35.999 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:35.999 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:35.999 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:36.000 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:36.000 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:36.000 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:36.000 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:36.000 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:36.000 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:36.000 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:36.000 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:36.000 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:36.001 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:36.001 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:36.001 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:36.001 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:36.001 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:36.001 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:36.001 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:36.001 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:36.001 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:36.001 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:36.001 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:36.001 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:36.001 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:36.001 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:36.001 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:36.002 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:36.002 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:36.002 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:36.002 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:36.002 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:36.002 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:36.002 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:36.002 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:36.002 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:36.002 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:36.002 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:36.002 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:36.005 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:36.005 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:36.005 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:36.006 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:36.006 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:36.006 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:36.006 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:36.006 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:36.006 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:36.006 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:36.006 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:36.007 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:36.007 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:36.007 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:36.007 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:36.007 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:36.007 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:36.007 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:36.007 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:36.007 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:36.007 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:36.007 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:36.007 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:36.007 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:36.007 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:36.008 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:36.008 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:36.008 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:36.008 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:36.008 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:36.008 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:36.008 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:36.008 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:36.008 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:36.008 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:36.008 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:36.009 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:36.009 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:36.009 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:36.009 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:36.009 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:36.009 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:36.009 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:36.009 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:36.009 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:36.009 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:36.009 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:36.009 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:36.009 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:36.009 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:36.010 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:36.010 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:36.010 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:36.010 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:36.010 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:36.010 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:36.010 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:36.010 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:36.010 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:35 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:36.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:36.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:36.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:36.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:36.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:36.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:36.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:36.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:36.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:36.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:36.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:36.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:36.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:36.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:36.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:36.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:36.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:36.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:36.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:36.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:36.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:36.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:36.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:36.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:36.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:36.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:36.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:36.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:36.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:36.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:36.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:36.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:36.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:36.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:36.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:36.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:36.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:36.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:36.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:36.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:36.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:36.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:36.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:36.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:36.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:36.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:36.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:36.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:36.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:36.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:36.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:36.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:36.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:36.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:36.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:36.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:36.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:36.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:36.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:36.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:35 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:37.071 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:37.071 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:37.071 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:37.071 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:37.071 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:37.071 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:37.071 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:37.071 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:37.071 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:37.071 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:37.071 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:37.071 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:37.071 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:37.072 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:37.072 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:37.072 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:09:37.072 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:37.072 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:37.072 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:37.072 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:37.072 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:37.072 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:37.072 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:37.072 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:37.072 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:37.072 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:37.073 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:37.073 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:37.073 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:37.073 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:37.073 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:37.073 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:37.073 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:37.073 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:37.073 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:37.073 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:37.073 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:37.074 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:37.074 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:37.074 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:37.074 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:37.074 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:37.074 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:37.074 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:37.074 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:37.074 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:37.074 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:37.074 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:09:37.074 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:37.074 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:37.074 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:37.075 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:37.075 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:37.075 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:37.075 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:37.075 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:37.075 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:37.075 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:37.075 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:37.075 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:37.075 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:37.075 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:37.075 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:37.075 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:37.076 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:37.076 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:37.076 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:37.076 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:37.076 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:37.076 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:37.076 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:37.076 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:37.076 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:37.076 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:37.076 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:37.077 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:37.077 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:37.077 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:37.077 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:37.077 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:37.077 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:37.077 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:37.077 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:37.077 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:37.077 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:37.077 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:37.077 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:37.077 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:37.077 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:37.078 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:37.078 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:37.078 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:37.078 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:37.078 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:37.078 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:37.078 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:37.078 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:37.078 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:37.078 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:37.078 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:37.078 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:37.079 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:37.079 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:37.079 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:37.079 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:37.079 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:37.079 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:37.079 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:37.079 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:37.079 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:37.079 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:37.079 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:37.079 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:37.079 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:37.080 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:37.080 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:37.080 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:37.080 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:36 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:37.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:37.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:37.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:37.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:37.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:37.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:37.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:37.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:37.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:37.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:37.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:37.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:37.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:37.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:37.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:37.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:09:37.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:37.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:37.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:37.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:37.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:37.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:37.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:37.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:37.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:37.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:37.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:37.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:37.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:37.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:37.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:37.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:37.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:37.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:37.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:37.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:37.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:37.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:37.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:37.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:37.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:37.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:37.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:37.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:37.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:37.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:37.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:37.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:37.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:37.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:37.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:37.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:37.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:37.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:37.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:37.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:37.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:37.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:37.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:36 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:38.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:38.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:38.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:38.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:38.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:38.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:38.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:38.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:38.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:38.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:38.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:38.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:38.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:38.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:38.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:38.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:38.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:38.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:38.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:38.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:38.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:38.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:38.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:38.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:38.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:38.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:38.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:38.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:38.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:38.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:38.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:38.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:38.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:38.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:38.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:38.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:38.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:38.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:38.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:38.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:38.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:38.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:38.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:38.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:38.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:38.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:38.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:38.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:38.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:38.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:38.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:38.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:38.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:38.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:38.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:38.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:38.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:38.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:38.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:38.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:38.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:38.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:38.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:38.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:38.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:38.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:38.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:38.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:38.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:38.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:38.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:38.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:38.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:38.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:38.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:38.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:38.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:38.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:38.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:38.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:38.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:38.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:38.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:38.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:38.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:38.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:38.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:38.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:38.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:38.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:38.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:38.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:38.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:38.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:38.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:38.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:38.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:38.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:38.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:38.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:38.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:38.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:38.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:38.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:38.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:38.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:38.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:38.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:38.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:38.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:38.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:38.192 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:38.192 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:38.192 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:38.192 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:38.192 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:38.192 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:38.192 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:38.192 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:38.192 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:38.192 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:38.192 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:38.192 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:38.192 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:38.192 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:38.192 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:37 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:38.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:09:37] "GET /metrics HTTP/1.1" 200 38237 "" "Prometheus/2.33.4" 2024-06-18T02:09:38.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:38.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:38.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:38.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:38.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:38.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:38.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:38.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:38.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:38.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:38.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:38.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:38.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:38.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:38.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:38.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:38.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:38.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:38.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:38.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:38.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:38.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:38.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:38.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:38.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:38.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:38.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:38.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:38.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:38.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:38.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:38.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:38.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:38.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:38.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:38.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:38.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:38.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:38.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:38.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:38.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:38.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:38.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:38.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:38.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:38.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:38.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:38.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:38.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:38.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:38.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:38.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:38.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:38.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:38.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:38.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:38.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:38.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:38.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:38.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:38.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:38.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:38.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:37 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:38.886 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:38.886 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:38.886 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:38.886 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:38.886 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:38.887 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:38.887 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:38.887 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:38.887 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:38.887 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:38.887 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:38.888 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:38.888 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:38.888 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:38.888 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[29879]: pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:09:38.888 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:38.888 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:38.889 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:38.889 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:38.889 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:38.890 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:38.890 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:38.890 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:38.890 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:38.890 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:38.891 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:38.891 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:38.891 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:38.891 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:38.891 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:38.892 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:38.892 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:38.892 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[73500]: pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:09:38.892 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:38.892 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:38.892 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:38.892 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:38.893 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:38.893 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:38.893 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:38.893 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:38.893 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:38.893 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:38.893 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:38.894 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:38.894 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:38.894 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:38.894 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:38.894 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:38.894 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:38.895 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:38.895 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:38.895 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:38.895 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:38.895 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:38.895 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:38.895 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:38.895 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:38.895 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:38.895 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:38.895 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:38.896 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:38.896 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:38.896 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:38.896 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:38.896 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:38.896 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:38.896 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:38.896 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:38.896 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:39.043 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:09:38 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:09:38.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.7\", device_class=\"ssd\", hostname=\"smithi007\", instance=\"172.21.15.130:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.7\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"cd9a3408-2d15-11ef-bc9d-c7b262605968\", cluster_addr=\"172.21.15.7\", device_class=\"ssd\", hostname=\"smithi007\", instance=\"smithi130:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.7\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-06-18T02:09:39.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:38 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:39.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:38 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:39.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:38 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:39.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:38 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:39.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:38 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:39.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:38 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:39.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:38 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:39.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:38 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:39.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:38 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:39.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:38 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:39.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:38 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:39.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:38 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:39.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:38 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:39.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:38 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:39.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:38 smithi130 ceph-mon[26123]: pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:09:39.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:39.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:39.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:38 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:39.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:39.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:39.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:38 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:39.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:38 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:39.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:39.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:39.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:38 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:39.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:39.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:39.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:38 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:39.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:39.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:39.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:39.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:39.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:38 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:39.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:39.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:39.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:39.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:39.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:38 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:39.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:39.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:39.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:39.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:39.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:38 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:39.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:39.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:39.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:39.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:39.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:38 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:39.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:38 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:39.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:38 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:39.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:38 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:39.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:39.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:39.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:39.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:39.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:39.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:39.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:39.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:39.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:39.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:39.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:39.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:39.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:39.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:39.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:39.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:39.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:39.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:39.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:39.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:39.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:39.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:39.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:39.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:39.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:39.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:39.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:39.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:39.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:39.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:39.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:39.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:39.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:39.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:39.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:38 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:40.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:39 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:40.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:39 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:40.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:39 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:40.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:39 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:40.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:39 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:40.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:39 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:40.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:39 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:40.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:39 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:40.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:39 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:40.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:39 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:40.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:39 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:40.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:39 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:40.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:39 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:40.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:39 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:40.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:39 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:40.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:39 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:40.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:39 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:40.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:39 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:40.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:39 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:40.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:39 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:40.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:39 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:40.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:39 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:40.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:39 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:40.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:39 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:40.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:39 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:40.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:39 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:40.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:39 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:41.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:40 smithi007 ceph-mon[73500]: pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:09:41.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:40 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:41.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:40 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:41.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:40 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:41.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:40 smithi007 ceph-mon[29879]: pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:09:41.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:40 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:41.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:40 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:41.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:40 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:41.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:40 smithi130 ceph-mon[26123]: pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:09:41.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:40 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:41.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:40 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:41.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:40 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:42.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:41 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:09:42.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:41 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:42.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:41 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-18T02:09:42.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:41 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-18T02:09:42.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:41 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-18T02:09:42.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:41 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:42.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:41 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:09:42.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:41 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:42.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:41 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-18T02:09:42.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:41 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-18T02:09:42.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:41 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-18T02:09:42.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:41 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:42.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:41 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:09:42.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:41 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:42.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:41 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-18T02:09:42.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:41 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-18T02:09:42.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:41 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-18T02:09:42.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:41 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:43.154 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:42 smithi130 ceph-mon[26123]: Upgrade: Updating mgr.y 2024-06-18T02:09:43.154 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:42 smithi130 ceph-mon[26123]: Deploying daemon mgr.y on smithi007 2024-06-18T02:09:43.154 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:42 smithi130 ceph-mon[26123]: pgmap v47: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:09:43.154 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:42 smithi130 ceph-mon[26123]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:09:43.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:42 smithi007 ceph-mon[73500]: Upgrade: Updating mgr.y 2024-06-18T02:09:43.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:42 smithi007 ceph-mon[73500]: Deploying daemon mgr.y on smithi007 2024-06-18T02:09:43.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:42 smithi007 ceph-mon[73500]: pgmap v47: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:09:43.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:42 smithi007 ceph-mon[73500]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:09:43.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:42 smithi007 ceph-mon[29879]: Upgrade: Updating mgr.y 2024-06-18T02:09:43.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:42 smithi007 ceph-mon[29879]: Deploying daemon mgr.y on smithi007 2024-06-18T02:09:43.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:42 smithi007 ceph-mon[29879]: pgmap v47: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:09:43.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:42 smithi007 ceph-mon[29879]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:09:43.793 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:09:43 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:09:43.505Z caller=manager.go:609 level=warn component="rule manager" group=nodes msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on(instance) group_left(nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi007\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"cd9a3408-2d15-11ef-bc9d-c7b262605968\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-06-18T02:09:44.786 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:44 smithi007 systemd[1]: Stopping Ceph mgr.y for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:09:45.062 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:44 smithi007 ceph-mon[73500]: pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:09:45.062 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:44 smithi007 podman[88262]: 2024-06-18 02:09:44.786698566 +0000 UTC m=+0.139800214 container died 24409b02b1aff160df36ace83d50559fa95ddfcd2aabb3dd0e0a352ca323f977 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, version=8, RELEASE=HEAD, maintainer=Guillaume Abrioux , io.k8s.display-name=CentOS Stream 8, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.openshift.expose-services=, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., release=754, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, architecture=x86_64, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_REPO=https://github.com/ceph/ceph-container.git, vcs-type=git, vendor=Red Hat, Inc., ceph=True, GIT_CLEAN=True, build-date=2022-05-03T08:36:31.336870, com.redhat.component=centos-stream-container, io.openshift.tags=base centos centos-stream, GIT_BRANCH=HEAD, distribution-scope=public, CEPH_POINT_RELEASE=-17.2.0, name=centos-stream, io.buildah.version=1.19.8, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac) 2024-06-18T02:09:45.063 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:44 smithi007 ceph-mon[29879]: pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:09:45.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:44 smithi130 ceph-mon[26123]: pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:09:45.431 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:45 smithi007 podman[88262]: 2024-06-18 02:09:45.063299151 +0000 UTC m=+0.416400795 container cleanup 24409b02b1aff160df36ace83d50559fa95ddfcd2aabb3dd0e0a352ca323f977 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y, release=754, io.buildah.version=1.19.8, io.openshift.tags=base centos centos-stream, GIT_BRANCH=HEAD, io.k8s.display-name=CentOS Stream 8, vcs-type=git, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, architecture=x86_64, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, GIT_CLEAN=True, RELEASE=HEAD, distribution-scope=public, build-date=2022-05-03T08:36:31.336870, GIT_REPO=https://github.com/ceph/ceph-container.git, io.openshift.expose-services=, CEPH_POINT_RELEASE=-17.2.0, version=8, maintainer=Guillaume Abrioux , ceph=True, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, vendor=Red Hat, Inc., GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, name=centos-stream, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, com.redhat.component=centos-stream-container, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754) 2024-06-18T02:09:45.432 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:45 smithi007 bash[88262]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y 2024-06-18T02:09:45.432 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:45 smithi007 podman[88277]: 2024-06-18 02:09:45.306873914 +0000 UTC m=+0.519730957 container remove 24409b02b1aff160df36ace83d50559fa95ddfcd2aabb3dd0e0a352ca323f977 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y, CEPH_POINT_RELEASE=-17.2.0, io.buildah.version=1.19.8, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, build-date=2022-05-03T08:36:31.336870, release=754, io.openshift.expose-services=, GIT_BRANCH=HEAD, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, architecture=x86_64, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, com.redhat.component=centos-stream-container, io.openshift.tags=base centos centos-stream, ceph=True, GIT_REPO=https://github.com/ceph/ceph-container.git, name=centos-stream, version=8, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, distribution-scope=public, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, vcs-type=git, GIT_CLEAN=True, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, maintainer=Guillaume Abrioux , io.k8s.display-name=CentOS Stream 8, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vendor=Red Hat, Inc., RELEASE=HEAD) 2024-06-18T02:09:45.432 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:45 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-06-18T02:09:45.882 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:45 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mgr.y.service: Failed with result 'exit-code'. 2024-06-18T02:09:45.882 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:45 smithi007 systemd[1]: Stopped Ceph mgr.y for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:09:45.882 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:45 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mgr.y.service: Consumed 8.217s CPU time. 2024-06-18T02:09:45.882 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:45 smithi007 systemd[1]: Starting Ceph mgr.y for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:09:46.154 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:45 smithi007 podman[88402]: 2024-06-18 02:09:45.8830986 +0000 UTC m=+0.097328545 container create 2141e131e89678ef21692327f7ec7a11557741da08a20ec389a7587ee7bc83ba (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y, io.buildah.version=1.36.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240612, org.label-schema.schema-version=1.0, RELEASE=squid-3781e3a, GIT_BRANCH=HEAD, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-06-18T02:09:46.154 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:45 smithi007 podman[88402]: 2024-06-18 02:09:45.803407901 +0000 UTC m=+0.017625182 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:09:46.154 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:46 smithi007 podman[88402]: 2024-06-18 02:09:46.127602571 +0000 UTC m=+0.341819844 container init 2141e131e89678ef21692327f7ec7a11557741da08a20ec389a7587ee7bc83ba (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y, maintainer=Guillaume Abrioux , RELEASE=squid-3781e3a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240612, io.buildah.version=1.36.0, ceph=True, GIT_BRANCH=HEAD) 2024-06-18T02:09:46.155 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:46 smithi007 podman[88402]: 2024-06-18 02:09:46.130703942 +0000 UTC m=+0.344921214 container start 2141e131e89678ef21692327f7ec7a11557741da08a20ec389a7587ee7bc83ba (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240612, RELEASE=squid-3781e3a, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-06-18T02:09:46.431 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mgr[88421]: -- 172.21.15.7:0/451779260 <== mon.1 v2:172.21.15.7:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d3285db0e0 con 0x55d3285b8800 2024-06-18T02:09:46.431 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:46 smithi007 bash[88402]: 2141e131e89678ef21692327f7ec7a11557741da08a20ec389a7587ee7bc83ba 2024-06-18T02:09:46.431 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:46 smithi007 systemd[1]: Started Ceph mgr.y for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:09:46.432 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[88417]: 2024-06-18T02:09:46.268+0000 7fbec25c9040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-18T02:09:46.775 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[88417]: 2024-06-18T02:09:46.435+0000 7fbec25c9040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-18T02:09:46.775 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[88417]: 2024-06-18T02:09:46.509+0000 7fbec25c9040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-18T02:09:46.775 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[88417]: 2024-06-18T02:09:46.775+0000 7fbec25c9040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-18T02:09:47.164 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:46 smithi130 ceph-mon[26123]: pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:09:47.164 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:46 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:47.164 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:46 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:47.164 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:46 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:47.164 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:46 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:47.164 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:46 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:47.164 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:46 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:47.164 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:46 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:47.164 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:46 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-06-18T02:09:47.164 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:46 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-06-18T02:09:47.164 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:46 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-06-18T02:09:47.165 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:46 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:47.165 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:46 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:47.165 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:46 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:47.165 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:46 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:47.165 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:46 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:47.165 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:46 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:47.165 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:46 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:47.165 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:46 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:47.165 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:46 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:47.165 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:46 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:47.165 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:46 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:47.165 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:46 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:47.165 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:46 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:47.166 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:46 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:47.166 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:46 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:47.166 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:46 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:47.166 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:46 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:47.166 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:46 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:47.166 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:46 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:47.166 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:46 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:47.166 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:46 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:47.166 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:46 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:47.181 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[88417]: 2024-06-18T02:09:46.841+0000 7fbec25c9040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-18T02:09:47.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[29879]: pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:09:47.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:47.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:47.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:47.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:47.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:47.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:47.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:47.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-06-18T02:09:47.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-06-18T02:09:47.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-06-18T02:09:47.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:47.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:47.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:47.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:47.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:47.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:47.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:47.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:47.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:47.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:47.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:47.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:47.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:47.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:47.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:47.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:47.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:47.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:47.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[73500]: pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:09:47.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:47.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:47.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:47.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:47.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:47.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:47.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:47.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-06-18T02:09:47.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-06-18T02:09:47.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-06-18T02:09:47.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:47.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:47.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:47.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:47.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:47.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:47.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:47.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:47.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:47.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:47.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:47.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:47.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:47.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:47.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:47.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:47.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:47.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:47.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:47.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:47.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:47.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:47.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:47.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:47.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:47.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:46 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:48.181 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[88417]: 2024-06-18T02:09:47.910+0000 7fbec25c9040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-18T02:09:48.182 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[88417]: 2024-06-18T02:09:48.044+0000 7fbec25c9040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-18T02:09:48.182 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[88417]: 2024-06-18T02:09:48.110+0000 7fbec25c9040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-18T02:09:48.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:48.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:48.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:48.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:48.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:48.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:48.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:48.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:48.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:48.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:48.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:48.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:48.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:48.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:48.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:48.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:48.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:48.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:48.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:48.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:48.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:48.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:48.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:48.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:48.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:48.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:48.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:48.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:48.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:48.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:48.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:48.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:48.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:48.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:48.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:48.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:48.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:48.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:48.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:48.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:48.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:48.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:48.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:48.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:48.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:48.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:48.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:48.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:48.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:48.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:48.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:48.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:48.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:48.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:48.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:48.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:48.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:48.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:48.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:48.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:48.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:48.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:48.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:48.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:48.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:48.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:48.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:48.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:48.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:48.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:48.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:48.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:48.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:48.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:48.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:48.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:48.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:48.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:48.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:48.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:48.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:48.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:48.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:48.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:48.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:48.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:48.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:48.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:48.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:48.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:48.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:48.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:48.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:48.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:48.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:48.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:48.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:48.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:48.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:48.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:48.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:48.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:48.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:48.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:48.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:48.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:48.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:48.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:47 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:48.269 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:09:47 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:09:47] "GET /metrics HTTP/1.1" 200 38238 "" "Prometheus/2.33.4" 2024-06-18T02:09:48.270 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:47 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:48.270 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:47 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:48.270 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:47 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:48.270 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:47 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:48.270 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:47 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:48.270 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:47 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:48.270 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:47 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:48.270 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:47 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:48.270 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:47 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:48.270 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:47 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:48.271 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:47 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:48.271 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:47 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:48.271 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:47 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:48.271 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:47 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:48.271 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:47 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:48.271 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:47 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:48.271 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:47 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:48.271 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:47 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:48.271 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:47 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:48.271 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:47 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:48.271 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:47 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:48.271 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:47 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:48.271 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:47 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:48.272 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:47 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:48.272 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:47 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:48.272 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:47 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:48.272 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:47 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:48.272 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:47 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:48.272 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:47 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:48.272 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:47 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:48.272 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:47 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:48.272 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:47 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:48.272 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:47 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:48.273 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:47 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:48.273 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:47 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:48.273 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:47 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:48.273 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:47 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:48.273 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:47 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:48.273 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:47 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:48.273 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:47 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:48.273 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:47 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:48.273 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:47 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:48.273 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:47 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:48.273 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:47 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:48.273 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:47 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:48.273 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:47 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:48.274 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:47 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:48.274 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:47 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:48.274 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:47 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:48.274 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:47 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:48.274 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:47 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:48.274 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:47 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:48.274 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:47 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:48.274 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:47 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:48.620 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[88417]: 2024-06-18T02:09:48.348+0000 7fbec25c9040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-18T02:09:48.621 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[88417]: 2024-06-18T02:09:48.415+0000 7fbec25c9040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-18T02:09:48.621 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[88417]: 2024-06-18T02:09:48.490+0000 7fbec25c9040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-18T02:09:48.882 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[88417]: 2024-06-18T02:09:48.661+0000 7fbec25c9040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-18T02:09:49.032 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:09:48.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.7\", device_class=\"ssd\", hostname=\"smithi007\", instance=\"172.21.15.130:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.7\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"cd9a3408-2d15-11ef-bc9d-c7b262605968\", cluster_addr=\"172.21.15.7\", device_class=\"ssd\", hostname=\"smithi007\", instance=\"smithi130:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.7\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-06-18T02:09:49.032 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:49.032 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:49.032 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:49.033 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:49.033 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:49.033 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:49.033 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:49.033 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:49.033 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:49.033 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:49.033 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:49.033 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:49.033 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:49.033 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:49.033 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-mon[26123]: pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:09:49.033 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:49.034 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:49.034 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:49.034 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:49.034 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:49.034 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:49.034 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:49.034 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:49.034 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:49.034 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:49.034 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:49.034 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:49.035 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:49.035 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:49.035 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:49.035 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:49.035 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:49.035 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:49.035 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:49.035 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:49.035 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:49.035 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:49.036 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:49.036 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:49.036 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:49.036 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:49.036 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:49.036 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:49.036 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:49.036 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:49.036 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:49.036 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:49.036 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:49.036 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:49.036 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:49.037 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:49.037 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:49.037 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:49.037 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:49.037 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:49.037 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:49.037 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:48 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:49.162 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:49.163 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:49.163 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:49.163 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:49.163 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:49.163 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:49.163 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:49.163 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:49.163 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:49.163 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:49.163 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:49.163 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:49.163 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:49.163 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:49.164 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[73500]: pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:09:49.164 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:49.164 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:49.164 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:49.164 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:49.164 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:49.164 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:49.164 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:49.164 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:49.164 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:49.164 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:49.165 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:49.165 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:49.165 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:49.165 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:49.165 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:49.165 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:49.165 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:49.166 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:49.166 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:49.166 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:49.166 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:49.166 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:49.166 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:49.166 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:49.166 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:49.166 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:49.166 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:49.166 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:49.166 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:49.167 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:49.167 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:49.167 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[29879]: pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:09:49.167 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:49.167 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:49.167 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:49.167 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:49.167 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:49.167 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:49.167 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:49.167 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:49.167 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:49.167 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:49.168 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:49.168 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:49.168 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:49.168 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:49.168 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:49.168 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:49.168 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:49.168 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:49.168 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:49.168 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:49.168 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:49.169 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:49.169 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:49.169 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:49.169 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:49.169 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:49.169 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:49.169 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:49.169 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:49.169 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:49.169 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:49.169 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:49.169 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:49.169 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:49.169 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:49.170 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:49.170 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:49.170 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:49.170 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:49.170 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:49.170 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:49.170 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:49.170 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:49.170 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:49.170 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:49.170 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:49.171 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:49.171 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:49.171 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:49.171 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:49.171 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:49.171 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:49.171 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:49.171 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:49.171 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:49.171 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:49.171 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:49.171 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:49.171 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:49.171 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:49.172 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:49.172 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:49.172 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:49.172 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:49.172 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:49.172 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:49.172 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:48 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:49.431 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[88417]: 2024-06-18T02:09:49.162+0000 7fbec25c9040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-18T02:09:49.789 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[88417]: 2024-06-18T02:09:49.552+0000 7fbec25c9040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-18T02:09:49.789 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[88417]: 2024-06-18T02:09:49.629+0000 7fbec25c9040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-18T02:09:50.125 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[88417]: 2024-06-18T02:09:49.801+0000 7fbec25c9040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-18T02:09:50.125 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:50.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:50.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:50.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:50.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:50.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:50.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:50.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:50.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:50.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:50.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:50.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:50.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:50.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:50.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:50.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:50.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:50.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:50.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:50.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:50.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:50.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:50.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:50.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:50.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:50.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:50.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:50.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:50.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:50.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:50.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:50.129 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:50.129 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:50.129 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:50.130 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:50.130 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:50.130 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:50.130 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:50.130 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:50.130 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:50.130 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:50.130 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:50.130 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:50.130 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:50.131 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:50.131 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:50.131 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:50.131 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:50.131 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:50.131 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:50.131 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:50.131 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:50.131 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:50.131 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:50.131 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:50.131 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:50.131 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:50.132 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:50.132 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:50.132 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:50.132 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:50.132 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:50.132 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:50.132 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:50.132 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:50.132 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:50.132 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:50.132 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:50.133 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:50.133 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:50.133 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:50.133 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:50.133 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:50.133 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:50.133 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:50.133 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:50.133 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:50.133 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:50.134 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:50.134 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:50.134 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:50.134 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:50.134 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:50.134 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:50.134 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:50.134 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:50.134 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:50.134 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:50.134 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:50.134 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:50.134 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:50.135 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:50.135 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:50.135 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:50.135 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:50.135 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:50.135 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:50.135 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:50.135 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:50.135 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:50.135 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:50.135 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:50.135 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:50.136 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:50.136 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:50.136 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:50.136 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:50.136 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:50.136 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:50.136 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:50.136 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:50.136 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:50.136 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:50.136 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:50.136 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:50.136 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:50.136 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:50.137 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:50.137 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:50.137 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:50.137 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:50.137 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:49 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:50.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:50.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:50.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:50.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:50.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:50.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:50.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:50.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:50.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:50.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:50.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:50.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:50.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:50.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:50.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:50.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:50.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:50.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:50.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:50.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:50.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:50.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:50.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:50.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:50.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:50.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:50.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:50.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:50.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:50.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:50.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:50.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:50.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:50.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:50.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:50.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:50.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:50.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:50.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:50.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:50.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:50.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:50.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:50.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:50.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:50.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:50.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:50.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:50.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:50.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:50.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:50.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:50.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:50.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:50.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:50.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:50.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:50.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:50.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:50.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:50.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:49 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:50.431 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[88417]: 2024-06-18T02:09:50.162+0000 7fbec25c9040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-18T02:09:50.431 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[88417]: 2024-06-18T02:09:50.230+0000 7fbec25c9040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-18T02:09:50.692 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[88417]: 2024-06-18T02:09:50.434+0000 7fbec25c9040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-18T02:09:50.692 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[88417]: 2024-06-18T02:09:50.620+0000 7fbec25c9040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-18T02:09:50.964 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[88417]: 2024-06-18T02:09:50.692+0000 7fbec25c9040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-18T02:09:50.965 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[88417]: 2024-06-18T02:09:50.787+0000 7fbec25c9040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-18T02:09:50.965 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[88417]: 2024-06-18T02:09:50.854+0000 7fbec25c9040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-18T02:09:50.965 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:50.965 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:50.966 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:50.966 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:50.966 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:50.966 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:50.966 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:50.966 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:50.966 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:50.966 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:50.966 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:50.966 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:50.966 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:09:50.966 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:50.966 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:50.967 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:50.967 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:50.967 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:50.967 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:50.967 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:50.967 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:50.967 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:50.967 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:50.967 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:50.967 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:50.967 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:50.967 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:50.967 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:50.968 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:50.968 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:50.968 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:50.968 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:50.968 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:50.968 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:50.968 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:50.968 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:50.968 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:50.968 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:50.968 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:50.968 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:50.968 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:50.969 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:50.969 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:50.969 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:50.969 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:50.969 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:50.969 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:50.969 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:50.969 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:50.969 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:50.969 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:50.969 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:50.969 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:50.969 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:50.970 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:50.970 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:50.970 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:50.970 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:50.970 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:50.970 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:50.970 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:50.970 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:50.971 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:50.971 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:50.971 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:50.971 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:50.971 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:50.971 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:50.971 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:50.971 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:50.971 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:50.971 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:50.971 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:50.971 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:50.972 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:09:50.972 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:50.972 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:50.972 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:50.972 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:50.972 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:50.972 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:50.972 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:50.972 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:50.972 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:50.972 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:50.972 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:50.972 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:50.973 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:50.973 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:50.973 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:50.973 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:50.973 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:50.973 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:50.973 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:50.973 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:50.973 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:50.973 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:50.973 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:50.973 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:50.973 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:50.973 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:50.974 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:50.974 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:50.974 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:50.974 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:50.974 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:50.974 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:50.974 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:50.974 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:50.974 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:50.974 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:50.975 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:50.975 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:50.975 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:50.975 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:50.975 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:50.975 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:50.975 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:50.975 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:50.975 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:50.975 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:50.975 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:50.975 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:50.975 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:50 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:51.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:51.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:51.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:51.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:51.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:51.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:51.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:51.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:51.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:51.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:51.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:51.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:51.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:09:51.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:51.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:51.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:51.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:51.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:51.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:51.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:51.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:51.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:51.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:51.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:51.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:51.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:51.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:51.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:51.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:51.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:51.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:51.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:51.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:51.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:51.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:51.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:51.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:51.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:51.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:51.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:51.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:51.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:51.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:51.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:51.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:51.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:51.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:51.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:51.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:51.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:51.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:51.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:51.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:51.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:51.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:51.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:51.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:51.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:51.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:51.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:51.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:51.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:50 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:51.747 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[88417]: 2024-06-18T02:09:51.455+0000 7fbec25c9040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-18T02:09:51.748 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[88417]: 2024-06-18T02:09:51.639+0000 7fbec25c9040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-18T02:09:51.748 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[88417]: [18/Jun/2024:02:09:51] ENGINE Bus STARTING 2024-06-18T02:09:51.748 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[88417]: CherryPy Checker: 2024-06-18T02:09:51.748 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[88417]: The Application mounted at '' has an empty config. 2024-06-18T02:09:51.748 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[88417]: 2024-06-18T02:09:51.748 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[88417]: [18/Jun/2024:02:09:51] ENGINE Serving on http://:::9283 2024-06-18T02:09:51.748 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y[88417]: [18/Jun/2024:02:09:51] ENGINE Bus STARTED 2024-06-18T02:09:52.065 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:52.066 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:52.066 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:52.066 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:52.066 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:52.066 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:52.066 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:52.066 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:52.066 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:52.066 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:52.066 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:52.066 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:52.067 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:52.067 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:52.067 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:52.067 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:52.067 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:52.067 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:52.067 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:52.067 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:52.067 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:52.067 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:52.067 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:52.067 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:52.067 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:52.067 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:52.068 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:52.068 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:52.068 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:52.068 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:52.068 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:52.068 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:52.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:52.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:52.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:52.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:52.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:52.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:52.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:52.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:52.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:52.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:52.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:52.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:52.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:52.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:52.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:52.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:52.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:52.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:52.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:52.070 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:52.070 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:52.070 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:52.070 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:52.070 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:52.070 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:52.070 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:52.070 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:52.070 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:52.070 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:52.070 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:52.070 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:52.070 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:52.071 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:52.071 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:52.071 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:52.071 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:52.071 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:52.071 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:52.071 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:52.071 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:52.071 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:52.071 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:52.071 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:52.072 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:52.072 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:52.072 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:52.072 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:52.072 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:52.072 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:52.072 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:52.072 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:52.072 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:52.072 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: Standby manager daemon y restarted 2024-06-18T02:09:52.072 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: Standby manager daemon y started 2024-06-18T02:09:52.072 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: from='mgr.? 172.21.15.7:0/1101413843' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-06-18T02:09:52.072 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: from='mgr.? 172.21.15.7:0/1101413843' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-18T02:09:52.072 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: from='mgr.? 172.21.15.7:0/1101413843' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-06-18T02:09:52.072 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: from='mgr.? 172.21.15.7:0/1101413843' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-18T02:09:52.073 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:52.073 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:52.073 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:52.073 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:52.073 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:52.073 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:52.073 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:52.073 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:52.073 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:52.073 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:52.073 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:52.073 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:52.074 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:52.074 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:52.074 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:52.074 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:52.074 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:52.074 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:52.074 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:52.074 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:52.074 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:52.074 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:52.074 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:52.074 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:52.074 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:52.075 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:52.075 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:52.075 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:52.075 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:52.075 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:52.075 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: Standby manager daemon y restarted 2024-06-18T02:09:52.075 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: Standby manager daemon y started 2024-06-18T02:09:52.075 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: from='mgr.? 172.21.15.7:0/1101413843' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-06-18T02:09:52.075 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: from='mgr.? 172.21.15.7:0/1101413843' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-18T02:09:52.075 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: from='mgr.? 172.21.15.7:0/1101413843' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-06-18T02:09:52.075 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: from='mgr.? 172.21.15.7:0/1101413843' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-18T02:09:52.075 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:52.075 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:52.076 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:52.076 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:52.076 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:52.076 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:52.076 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:52.076 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:52.076 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:52.076 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:51 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:52.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:52.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:52.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:52.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:52.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:52.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:52.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:52.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:52.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:52.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:52.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:52.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:52.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:52.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:52.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:52.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:52.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:52.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:52.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:52.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:52.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:52.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:52.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:52.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:52.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:52.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:52.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:52.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:52.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:52.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:52.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:52.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:52.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:52.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:52.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:52.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:52.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:52.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:52.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:52.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:52.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:52.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:52.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:52.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:52.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:52.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:52.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:52.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:52.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:52.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:52.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:52.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:52.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: Standby manager daemon y restarted 2024-06-18T02:09:52.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: Standby manager daemon y started 2024-06-18T02:09:52.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: from='mgr.? 172.21.15.7:0/1101413843' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-06-18T02:09:52.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: from='mgr.? 172.21.15.7:0/1101413843' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-18T02:09:52.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: from='mgr.? 172.21.15.7:0/1101413843' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-06-18T02:09:52.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: from='mgr.? 172.21.15.7:0/1101413843' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-18T02:09:52.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:52.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:52.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:52.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:52.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:52.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:52.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:52.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:52.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:52.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:51 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:53.142 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:53.142 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:53.142 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:53.142 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:53.143 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:53.143 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:53.143 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:53.143 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:53.143 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:53.143 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:53.143 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:53.143 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:53.143 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:53.143 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:53.143 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:53.143 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:09:53.143 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:09:53.143 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:53.144 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:53.144 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:53.144 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:53.144 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:53.144 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:53.144 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:53.144 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:53.144 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:53.144 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:53.144 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:53.144 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:53.144 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:53.144 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:53.145 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:53.145 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:53.145 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:53.145 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:53.145 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:53.145 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:53.145 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:53.145 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:53.145 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:53.145 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:53.146 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:53.146 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:53.146 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:53.146 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:53.146 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:53.146 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:53.146 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:09:53.146 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:09:53.146 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:53.146 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:53.146 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:53.146 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:53.146 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:53.147 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:53.147 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:53.147 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:53.147 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:53.147 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:53.147 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:53.147 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:53.147 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:53.147 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:53.147 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:53.148 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:53.148 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:53.148 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:53.148 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:53.148 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:53.148 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:53.148 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:53.148 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:53.148 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:53.148 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:53.148 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:53.148 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:53.149 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:53.149 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:53.149 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:53.149 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:53.149 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:53.149 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: mgrmap e47: x(active, since 71s), standbys: y 2024-06-18T02:09:53.149 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:53.149 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:53.149 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:53.149 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:53.149 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:53.149 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:53.149 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:53.149 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:53.150 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:53.150 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:53.150 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:53.150 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:53.150 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:53.150 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:53.150 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:53.150 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:53.151 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:53.151 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:53.151 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:53.151 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:53.151 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:53.151 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:53.151 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:53.151 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:53.151 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:53.151 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:53.151 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:53.151 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:53.151 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:53.151 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:53.152 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: mgrmap e47: x(active, since 71s), standbys: y 2024-06-18T02:09:53.152 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:53.152 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:53.152 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:53.152 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:53.152 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:53.152 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:53.152 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:53.152 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:53.152 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:53.152 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:53.152 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:53.152 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:53.152 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:52 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:53.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:53.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:53.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:53.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:53.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:53.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:53.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:53.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:53.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:53.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:53.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:53.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:53.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:53.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:53.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:53.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:09:53.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:09:53.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:53.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:53.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:53.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:53.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:53.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:53.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:53.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:53.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:53.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:53.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:53.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:53.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:53.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:53.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:53.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:53.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:53.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:53.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:53.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:53.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:53.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:53.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:53.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:53.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:53.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:53.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:53.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:53.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:53.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:53.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:53.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:53.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: mgrmap e47: x(active, since 71s), standbys: y 2024-06-18T02:09:53.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:53.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:53.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:53.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:53.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:53.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:53.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:53.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:53.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:53.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:53.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:53.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:53.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:52 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:53.793 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:09:53 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:09:53.505Z caller=manager.go:609 level=warn component="rule manager" group=nodes msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on(instance) group_left(nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi007\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"cd9a3408-2d15-11ef-bc9d-c7b262605968\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-06-18T02:09:54.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:54.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:54.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:54.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:54.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:54.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:54.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:54.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:54.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[73500]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:54.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:54.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:54.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:54.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:54.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:54.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:54.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:54.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:54.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:54.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:54.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:54.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:54.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:54.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:54.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:54.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:54.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:54.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:54.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:54.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:54.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:54.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:54.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:54.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:54.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:54.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:54.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:54.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:54.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:54.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:54.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:54.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:54.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:54.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:54.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:54.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:54.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:54.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:54.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:54.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:54.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:54.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:54.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:54.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:54.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:54.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:54.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:54.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:54.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:54.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:54.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:54.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:54.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:54.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:54.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:54.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[29879]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:54.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:54.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:54.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:54.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:54.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:54.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:54.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:54.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:54.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:54.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:54.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:54.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:54.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:54.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:54.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:54.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:54.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:54.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:54.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:54.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:54.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:54.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:54.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:54.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:54.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:54.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:54.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:54.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:54.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:54.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:54.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:54.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:54.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:54.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:54.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:54.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:54.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:54.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:54.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:54.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:54.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:54.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:54.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:54.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:54.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:54.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:54.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:53 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:54.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:53 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:54.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:53 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:54.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:53 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:54.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:53 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:54.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:53 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:54.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:53 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:54.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:53 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:54.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:53 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:54.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:53 smithi130 ceph-mon[26123]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-3124-g3781e3a5 2024-06-18T02:09:54.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:53 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:54.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:53 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:54.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:53 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:54.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:53 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:54.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:53 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:54.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:53 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:54.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:53 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:54.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:53 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:54.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:53 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:54.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:53 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:54.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:53 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:54.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:53 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:54.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:53 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:54.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:53 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:54.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:53 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:54.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:53 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:54.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:53 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:54.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:53 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:54.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:53 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:54.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:53 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:54.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:53 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:54.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:53 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:54.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:53 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:54.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:53 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:54.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:53 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:54.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:53 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:54.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:53 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:54.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:53 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:54.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:53 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:54.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:53 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:54.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:53 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:54.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:53 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:54.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:53 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:54.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:53 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:54.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:53 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:54.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:53 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:54.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:53 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:54.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:53 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:54.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:53 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:54.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:53 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:54.300 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:53 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:54.300 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:53 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:54.300 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:53 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:54.300 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:53 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:54.300 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:53 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:54.300 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:53 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:54.300 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:53 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:55.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:55.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:55.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:55.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:55.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:55.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:55.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:55.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[73500]: pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:09:55.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:55.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:55.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:55.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:55.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:55.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:55.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:55.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:55.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:55.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:55.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:55.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:55.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:55.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:55.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:55.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:55.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:55.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:55.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:55.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:55.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:55.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:55.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:55.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:55.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:55.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:55.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:55.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:55.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:55.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[29879]: pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:09:55.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:55.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:55.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:55.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:55.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:55.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:55.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:55.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:55.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:55.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:55.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:55.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:55.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:55.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:55.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:55.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:55.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:55.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:55.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:55.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:55.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:55.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:55.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:55.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:55.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:55.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:55.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:55.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:55.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:55.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:55.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:55.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:55.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:55.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:55.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:55.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:55.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:55.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:55.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:55.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:55.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:55.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:55.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:55.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:55.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:55.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:55.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:55.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:55.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:55.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:55.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:55.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:55.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:55.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:55.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:55.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:55.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:55.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:55.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:55.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:55.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:55.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:55.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:55.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:55.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:55.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:55.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:55.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:55.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:55.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:54 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:55.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:54 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:55.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:54 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:55.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:54 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:55.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:54 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:55.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:54 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:55.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:54 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:55.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:54 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:55.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:54 smithi130 ceph-mon[26123]: pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:09:55.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:54 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:55.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:54 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:55.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:54 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:55.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:54 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:55.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:54 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:55.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:54 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:55.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:54 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:55.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:54 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:55.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:54 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:55.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:54 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:55.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:54 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:55.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:54 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:55.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:54 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:55.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:54 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:55.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:54 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:55.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:54 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:55.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:54 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:55.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:54 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:55.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:54 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:55.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:54 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:55.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:54 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:55.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:54 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:55.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:54 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:55.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:54 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:55.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:54 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:55.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:54 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:55.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:54 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:55.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:54 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:55.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:54 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:55.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:54 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:55.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:54 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:55.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:54 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:55.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:54 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:55.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:54 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:55.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:54 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:55.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:54 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:55.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:54 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:55.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:54 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:55.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:54 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:55.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:54 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:55.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:54 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:55.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:54 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:55.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:54 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:55.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:54 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:55.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:54 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:55.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:54 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:56.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:56.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:56.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:56.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:56.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:56.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:56.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:56.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:56.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:56.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:56.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:56.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:56.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:56.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:56.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:56.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:56.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:56.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:56.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:56.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:56.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:56.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:56.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:56.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:56.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:56.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:56.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:56.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:56.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:56.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:56.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:56.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:56.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:56.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:56.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:56.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:56.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:56.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:56.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:56.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:56.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:56.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:56.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:56.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:56.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:56.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:56.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:56.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:56.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:56.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:56.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:56.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:56.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:56.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:56.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:56.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:56.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:56.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:56.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:56.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:56.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:56.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:56.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:56.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:56.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:56.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:56.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:56.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:56.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:56.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:56.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:56.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:56.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:56.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:56.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:56.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:56.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:56.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:56.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:56.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:56.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:56.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:56.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:56.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:56.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:56.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:56.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:56.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:56.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:56.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:56.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:56.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:56.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:56.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:56.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:56.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:56.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:56.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:56.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:56.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:56.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:56.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:56.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:56.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:56.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:56.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:56.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:56.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:55 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:56.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:55 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:56.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:55 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:56.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:55 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:56.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:55 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:56.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:55 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:56.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:55 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:56.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:55 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:56.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:55 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:56.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:55 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:56.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:55 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:56.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:55 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:56.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:55 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:56.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:55 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:56.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:55 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:56.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:55 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:56.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:55 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:56.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:55 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:56.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:55 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:56.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:55 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:56.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:55 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:56.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:55 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:56.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:55 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:56.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:55 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:56.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:55 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:56.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:55 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:56.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:55 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:56.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:55 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:56.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:55 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:56.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:55 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:56.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:55 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:56.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:55 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:56.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:55 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:56.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:55 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:56.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:55 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:56.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:55 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:56.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:55 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:56.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:55 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:56.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:55 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:56.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:55 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:56.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:55 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:56.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:55 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:56.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:55 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:56.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:55 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:56.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:55 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:56.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:55 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:56.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:55 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:56.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:55 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:56.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:55 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:56.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:55 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:56.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:55 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:56.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:55 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:56.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:55 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:56.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:55 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:56.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:55 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:57.003 INFO:teuthology.orchestra.run.smithi007.stdout:true 2024-06-18T02:09:57.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:57.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:57.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:57.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:57.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:57.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:57.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:57.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[73500]: pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:09:57.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:57.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:57.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:57.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:57.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:57.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:57.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:57.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:57.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:57.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:57.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:57.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:57.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:09:57.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:57.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:57.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:57.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:57.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:57.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:57.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:57.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:57.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:57.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:57.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:57.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:57.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:57.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:57.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:57.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:57.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[29879]: pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:09:57.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:57.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:57.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:57.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:57.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:57.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:57.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:57.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:57.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:57.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:57.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:57.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:57.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:09:57.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:57.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:57.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:57.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:57.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:57.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:57.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:57.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:57.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:57.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:57.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:57.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:57.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:57.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:57.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:57.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:57.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:57.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:57.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:57.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:57.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:57.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:57.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:57.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:57.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:57.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:57.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:57.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:57.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:57.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:57.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:57.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:57.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:57.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:57.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:57.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:57.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:57.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:57.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:57.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:57.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:57.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:57.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:57.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:57.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:57.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:57.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:57.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:57.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:57.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:57.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:56 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:57.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:56 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:57.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:56 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:57.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:56 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:57.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:56 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:57.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:56 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:57.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:56 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:57.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:56 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:57.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:56 smithi130 ceph-mon[26123]: pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:09:57.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:56 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:57.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:56 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:57.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:56 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:57.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:56 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:57.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:56 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:57.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:56 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:57.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:56 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:57.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:56 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:57.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:56 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:57.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:56 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:57.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:56 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:57.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:56 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:57.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:56 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:09:57.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:56 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:57.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:56 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:57.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:56 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:57.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:56 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:57.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:56 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:57.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:56 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:57.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:56 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:57.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:56 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:57.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:56 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:57.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:56 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:57.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:56 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:57.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:56 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:57.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:56 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:57.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:56 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:57.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:56 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:57.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:56 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:57.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:56 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:57.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:56 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:57.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:56 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:57.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:56 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:57.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:56 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:57.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:56 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:57.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:56 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:57.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:56 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:57.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:56 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:57.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:56 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:57.300 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:56 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:57.300 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:56 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:57.300 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:56 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:57.300 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:56 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:57.701 INFO:teuthology.orchestra.run.smithi007.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-18T02:09:57.701 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi007 smithi007 running 16s ago 13m - - 2024-06-18T02:09:57.701 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi130 smithi130 running 8s ago 12m - - 2024-06-18T02:09:57.701 INFO:teuthology.orchestra.run.smithi007.stdout:alertmanager.a smithi007 *:9093,9094 running (2m) 16s ago 7m 18.1M - 0.23.0 ba2b418f427c 5994e8525c64 2024-06-18T02:09:57.701 INFO:teuthology.orchestra.run.smithi007.stdout:grafana.a smithi130 *:3000 running (2m) 8s ago 7m 47.9M - 8.3.5 dad864ee21e9 70ba81d97c8e 2024-06-18T02:09:57.701 INFO:teuthology.orchestra.run.smithi007.stdout:iscsi.foo.smithi007.xvdrwd smithi007 running (56s) 16s ago 6m 46.2M - 3.5 e1d6a67b021e 94121ad2702c 2024-06-18T02:09:57.702 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.x smithi130 *:8443,9283,8765 running (115s) 8s ago 12m 503M - 19.0.0-3124-g3781e3a5 af93c036e016 01017e37bdbe 2024-06-18T02:09:57.702 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.y smithi007 *:8443,9283,8765 starting - - - - 2024-06-18T02:09:57.702 INFO:teuthology.orchestra.run.smithi007.stdout:mon.a smithi007 running (83s) 16s ago 14m 49.1M 2048M 19.0.0-3124-g3781e3a5 af93c036e016 670d7777ae9b 2024-06-18T02:09:57.702 INFO:teuthology.orchestra.run.smithi007.stdout:mon.b smithi130 running (12m) 8s ago 12m 59.2M 2048M 17.2.0 e1d6a67b021e a0b38a9a595f 2024-06-18T02:09:57.702 INFO:teuthology.orchestra.run.smithi007.stdout:mon.c smithi007 running (12m) 16s ago 12m 52.4M 2048M 17.2.0 e1d6a67b021e 1d1e2628656b 2024-06-18T02:09:57.702 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.a smithi007 *:9100 running (2m) 16s ago 8m 16.5M - 1.3.1 1dbe0e931976 8128e558f099 2024-06-18T02:09:57.702 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.b smithi130 *:9100 running (2m) 8s ago 8m 16.8M - 1.3.1 1dbe0e931976 bab93b43cf16 2024-06-18T02:09:57.702 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0 smithi007 running (12m) 16s ago 12m 54.7M 4096M 17.2.0 e1d6a67b021e 1ef6e23afd55 2024-06-18T02:09:57.702 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1 smithi007 running (11m) 16s ago 11m 56.3M 4096M 17.2.0 e1d6a67b021e a967706523cb 2024-06-18T02:09:57.702 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2 smithi007 running (11m) 16s ago 11m 50.8M 4096M 17.2.0 e1d6a67b021e 2c1b76bd0876 2024-06-18T02:09:57.702 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3 smithi007 running (10m) 16s ago 10m 54.8M 4096M 17.2.0 e1d6a67b021e 8b91b2a07564 2024-06-18T02:09:57.702 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4 smithi130 running (10m) 8s ago 10m 56.1M 4096M 17.2.0 e1d6a67b021e c428dccffdf0 2024-06-18T02:09:57.702 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5 smithi130 running (10m) 8s ago 10m 54.4M 4096M 17.2.0 e1d6a67b021e f645d7f12378 2024-06-18T02:09:57.703 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6 smithi130 running (9m) 8s ago 9m 50.4M 4096M 17.2.0 e1d6a67b021e c7af86c14959 2024-06-18T02:09:57.703 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7 smithi130 running (9m) 8s ago 9m 53.9M 4096M 17.2.0 e1d6a67b021e 3688af8b2c46 2024-06-18T02:09:57.703 INFO:teuthology.orchestra.run.smithi007.stdout:prometheus.a smithi130 *:9095 running (88s) 8s ago 8m 62.0M - 2.33.4 514e6a882f6e e905fb2eb4a6 2024-06-18T02:09:57.703 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi007.dvbvbk smithi007 *:8000 running (6m) 16s ago 6m 75.9M - 17.2.0 e1d6a67b021e 1344b55b763c 2024-06-18T02:09:57.703 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi130.aakmof smithi130 *:8000 running (6m) 8s ago 6m 73.7M - 17.2.0 e1d6a67b021e e257e3230c6c 2024-06-18T02:09:57.703 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi007.hgrnmk smithi007 *:80 running (6m) 16s ago 6m 74.2M - 17.2.0 e1d6a67b021e 2173947bc4d6 2024-06-18T02:09:57.703 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi130.wwebfk smithi130 *:80 running (6m) 8s ago 6m 75.7M - 17.2.0 e1d6a67b021e 8662706b2231 2024-06-18T02:09:58.140 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:09:58.140 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": { 2024-06-18T02:09:58.140 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2, 2024-06-18T02:09:58.140 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 1 2024-06-18T02:09:58.140 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:09:58.140 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": { 2024-06-18T02:09:58.140 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 2 2024-06-18T02:09:58.140 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:09:58.140 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": { 2024-06-18T02:09:58.140 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-06-18T02:09:58.141 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:09:58.141 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": {}, 2024-06-18T02:09:58.141 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw": { 2024-06-18T02:09:58.141 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-06-18T02:09:58.141 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:09:58.141 INFO:teuthology.orchestra.run.smithi007.stdout: "overall": { 2024-06-18T02:09:58.141 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 14, 2024-06-18T02:09:58.141 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 3 2024-06-18T02:09:58.141 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-06-18T02:09:58.141 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:09:58.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:58.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:58.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:58.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:58.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:58.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:58.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:58.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:58.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:58.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:58.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:58.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:58.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:58.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[29879]: from='client.25591 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:09:58.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:58.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:58.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:58.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:58.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:58.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:58.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:58.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:58.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:58.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:58.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:58.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:58.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:58.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:58.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:58.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:58.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:58.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:58.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:58.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:58.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:58.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:58.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:58.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:58.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:58.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:58.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:58.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:58.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:58.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:58.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:58.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:58.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:58.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:58.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:58.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:58.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:58.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:58.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:58.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:58.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:58.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:58.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:58.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:58.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:58.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:58.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:58.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:58.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:58.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:58.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:58.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:58.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:58.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[73500]: from='client.25591 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:09:58.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:58.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:58.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:58.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:58.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:58.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:58.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:58.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:58.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:58.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:58.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:58.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:58.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:58.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:58.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:58.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:58.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:58.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:58.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:58.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:58.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:58.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:58.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:58.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:58.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:58.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:58.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:58.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:58.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:58.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:58.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:58.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:58.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:58.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:58.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:58.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:58.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:58.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:58.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:58.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:57 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:58.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:09:57 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:09:57] "GET /metrics HTTP/1.1" 200 38237 "" "Prometheus/2.33.4" 2024-06-18T02:09:58.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:57 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:58.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:57 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:58.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:57 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:58.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:57 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:58.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:57 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:58.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:57 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:58.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:57 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:58.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:57 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:58.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:57 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:58.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:57 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:58.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:57 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:58.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:57 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:58.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:57 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:58.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:57 smithi130 ceph-mon[26123]: from='client.25591 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:09:58.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:57 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:58.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:57 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:58.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:57 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:58.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:57 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:58.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:57 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:58.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:57 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:58.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:57 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:58.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:57 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:58.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:57 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:58.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:57 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:58.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:57 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:58.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:57 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:58.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:57 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:58.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:57 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:58.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:57 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:58.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:57 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:58.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:57 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:58.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:57 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:58.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:57 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:58.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:57 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:58.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:57 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:58.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:57 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:58.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:57 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:58.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:57 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:58.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:57 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:58.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:57 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:58.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:57 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:58.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:57 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:58.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:57 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:58.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:57 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:58.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:57 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:58.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:57 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:58.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:57 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:58.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:57 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:58.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:57 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:58.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:57 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:58.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:57 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:58.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:57 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:58.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:57 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:58.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:57 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:58.515 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:09:58.515 INFO:teuthology.orchestra.run.smithi007.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00", 2024-06-18T02:09:58.515 INFO:teuthology.orchestra.run.smithi007.stdout: "in_progress": true, 2024-06-18T02:09:58.515 INFO:teuthology.orchestra.run.smithi007.stdout: "which": "Upgrading all daemon types on all hosts", 2024-06-18T02:09:58.515 INFO:teuthology.orchestra.run.smithi007.stdout: "services_complete": [], 2024-06-18T02:09:58.515 INFO:teuthology.orchestra.run.smithi007.stdout: "progress": "", 2024-06-18T02:09:58.515 INFO:teuthology.orchestra.run.smithi007.stdout: "message": "Currently upgrading mgr daemons", 2024-06-18T02:09:58.515 INFO:teuthology.orchestra.run.smithi007.stdout: "is_paused": false 2024-06-18T02:09:58.515 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:09:58.918 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:09:58.659Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.7\", device_class=\"ssd\", hostname=\"smithi007\", instance=\"172.21.15.130:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.7\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"cd9a3408-2d15-11ef-bc9d-c7b262605968\", cluster_addr=\"172.21.15.7\", device_class=\"ssd\", hostname=\"smithi007\", instance=\"smithi130:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.7\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-06-18T02:09:58.949 INFO:teuthology.orchestra.run.smithi007.stdout:HEALTH_OK 2024-06-18T02:09:59.163 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:59.163 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:59.163 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:59.163 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: from='client.34266 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:09:59.163 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:59.163 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:59.163 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:59.164 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:09:59.164 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:59.164 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:59.164 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:09:59.164 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:59.164 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:59.164 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:59.164 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:59.164 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:59.164 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:59.164 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:59.164 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:59.164 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:59.165 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:59.165 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:59.165 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: from='client.? 172.21.15.7:0/3171643246' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:59.165 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:59.165 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:59.165 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:59.165 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:59.165 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:59.165 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:59.165 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:59.166 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:59.166 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:59.166 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:59.166 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: from='client.34266 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:09:59.166 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:59.166 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:59.166 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:59.166 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:09:59.166 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:59.166 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:59.166 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:09:59.166 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:59.167 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:59.167 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:59.167 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:59.167 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:59.167 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:59.167 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:59.167 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:59.167 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:59.167 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:59.167 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:59.167 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/3171643246' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:59.167 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:59.167 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:59.167 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:59.168 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:59.168 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:59.168 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:59.168 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:59.168 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:59.168 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:59.168 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:59.168 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:59.168 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:59.168 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:59.168 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:59.169 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:59.169 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:59.169 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:59.169 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:59.169 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:59.169 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:59.169 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:59.169 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:59.169 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:59.169 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:59.169 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:59.169 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:59.169 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:59.169 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:59.169 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:59.170 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:59.170 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:59.170 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:59.170 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:59.170 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:59.170 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:59.170 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:59.170 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:59.170 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:59.170 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:59.170 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:59.171 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:59.171 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:59.171 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:59.171 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:59.171 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:59.171 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:59.171 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:59.171 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:59.171 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:59.171 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:59.171 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:59.171 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:59.171 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:59.171 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:59.171 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:59.172 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:59.172 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:59.172 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:59.172 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:59.172 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:59.172 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:59.172 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:59.172 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:58 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:59.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:59.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:59.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:59.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: from='client.34266 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:09:59.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:59.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:59.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:59.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:09:59.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:59.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:59.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:09:59.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:59.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:59.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:59.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:59.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:59.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:09:59.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:59.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:59.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:59.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:59.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:59.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/3171643246' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:59.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:59.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:59.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:59.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:59.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:59.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:59.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:59.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:59.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:59.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:59.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:59.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:59.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:59.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:59.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:59.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:59.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:59.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:59.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:59.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:59.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:59.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:59.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:59.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:59.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:59.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:59.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:59.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:59.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:59.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:09:59.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:09:59.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:09:59.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:09:59.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:09:59.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:58 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:00.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:00.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:00.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:00.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:00.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[73500]: from='client.25615 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:10:00.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:00.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:00.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:00.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:00.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[73500]: from='client.? 172.21.15.7:0/394274262' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:10:00.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:00.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:00.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:00.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:00.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:00.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:00.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:00.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:00.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:00.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:00.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:00.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:00.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:00.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:00.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:00.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:00.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:00.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:00.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:00.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:00.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:00.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:00.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:00.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:00.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:00.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:00.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:00.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:00.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:00.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:00.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:00.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:00.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:00.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:00.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:00.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-06-18T02:10:00.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2024-06-18T02:10:00.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:00.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:00.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:00.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:00.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:00.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[29879]: from='client.25615 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:10:00.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:00.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:00.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:00.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:00.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[29879]: from='client.? 172.21.15.7:0/394274262' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:10:00.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:00.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:00.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:00.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:00.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:00.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:00.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:00.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:00.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:00.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:00.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:00.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:00.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:00.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:00.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:00.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:00.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:00.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:00.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:00.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:00.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:00.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:00.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:00.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:00.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:00.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:00.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:00.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:00.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:00.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:00.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:00.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:00.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:00.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:00.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:00.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-06-18T02:10:00.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2024-06-18T02:10:00.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:09:59 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:00.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:59 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:00.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:59 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:00.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:59 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:00.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:59 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:00.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:59 smithi130 ceph-mon[26123]: from='client.25615 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:10:00.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:59 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:00.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:59 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:00.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:59 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:00.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:59 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:00.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:59 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/394274262' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:10:00.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:59 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:00.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:59 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:00.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:59 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:00.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:59 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:00.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:59 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:00.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:59 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:00.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:59 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:00.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:59 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:00.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:59 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:00.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:59 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:00.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:59 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:00.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:59 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:00.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:59 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:00.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:59 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:00.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:59 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:00.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:59 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:00.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:59 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:00.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:59 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:00.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:59 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:00.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:59 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:00.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:59 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:00.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:59 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:00.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:59 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:00.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:59 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:00.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:59 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:00.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:59 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:00.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:59 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:00.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:59 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:00.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:59 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:00.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:59 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:00.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:59 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:00.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:59 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:00.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:59 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:00.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:59 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:00.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:59 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:00.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:59 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-06-18T02:10:00.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:59 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2024-06-18T02:10:00.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:09:59 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:01.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:00 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:01.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:00 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:01.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:00 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:01.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:00 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:01.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:00 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:01.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:00 smithi007 ceph-mon[73500]: Upgrade: It appears safe to stop mon.c 2024-06-18T02:10:01.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:00 smithi007 ceph-mon[73500]: pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:10:01.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:00 smithi007 ceph-mon[73500]: overall HEALTH_OK 2024-06-18T02:10:01.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:00 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:01.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:00 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:01.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:00 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:01.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:00 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:01.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:00 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:01.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:00 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:01.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:00 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:01.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:00 smithi007 ceph-mon[29879]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:01.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:00 smithi007 ceph-mon[29879]: Upgrade: It appears safe to stop mon.c 2024-06-18T02:10:01.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:00 smithi007 ceph-mon[29879]: pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:10:01.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:00 smithi007 ceph-mon[29879]: overall HEALTH_OK 2024-06-18T02:10:01.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:00 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:01.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:00 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:01.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:00 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:01.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:00 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:01.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:00 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:01.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:00 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:01.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:00 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:01.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:00 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:01.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:00 smithi130 ceph-mon[26123]: Upgrade: It appears safe to stop mon.c 2024-06-18T02:10:01.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:00 smithi130 ceph-mon[26123]: pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:10:01.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:00 smithi130 ceph-mon[26123]: overall HEALTH_OK 2024-06-18T02:10:01.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:00 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:01.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:00 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:01.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:00 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:03.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:02 smithi007 ceph-mon[73500]: pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:10:03.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:02 smithi007 ceph-mon[73500]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:10:03.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:02 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:03.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:02 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-18T02:10:03.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:02 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-18T02:10:03.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:02 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:03.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:02 smithi007 ceph-mon[29879]: pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:10:03.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:02 smithi007 ceph-mon[29879]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:10:03.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:02 smithi007 ceph-mon[29879]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:03.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:02 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-18T02:10:03.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:02 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-18T02:10:03.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:02 smithi007 ceph-mon[29879]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:03.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:02 smithi130 ceph-mon[26123]: pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:10:03.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:02 smithi130 ceph-mon[26123]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:10:03.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:02 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:03.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:02 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-18T02:10:03.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:02 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-18T02:10:03.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:02 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:03.793 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:10:03 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:10:03.505Z caller=manager.go:609 level=warn component="rule manager" group=nodes msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on(instance) group_left(nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi007\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"cd9a3408-2d15-11ef-bc9d-c7b262605968\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-06-18T02:10:04.176 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:03 smithi007 ceph-mon[73500]: Upgrade: Updating mon.c 2024-06-18T02:10:04.176 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:03 smithi007 ceph-mon[73500]: Deploying daemon mon.c on smithi007 2024-06-18T02:10:04.177 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:03 smithi007 ceph-mon[29879]: Upgrade: Updating mon.c 2024-06-18T02:10:04.177 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:03 smithi007 ceph-mon[29879]: Deploying daemon mon.c on smithi007 2024-06-18T02:10:04.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:03 smithi130 ceph-mon[26123]: Upgrade: Updating mon.c 2024-06-18T02:10:04.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:03 smithi130 ceph-mon[26123]: Deploying daemon mon.c on smithi007 2024-06-18T02:10:05.007 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:04 smithi007 ceph-mon[73500]: pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:10:05.007 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:04 smithi007 ceph-mon[29879]: pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:10:05.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:04 smithi130 ceph-mon[26123]: pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:10:05.598 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:05 smithi007 systemd[1]: Stopping Ceph mon.c for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:10:05.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:05 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-c[29857]: 2024-06-18T02:10:05.598+0000 7f75199e6700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-06-18T02:10:05.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:05 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-c[29857]: 2024-06-18T02:10:05.598+0000 7f75199e6700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-06-18T02:10:05.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:05 smithi007 podman[93964]: 2024-06-18 02:10:05.763566675 +0000 UTC m=+0.277583833 container died 1d1e2628656b1787737107fc80d20f513a8bebe984e2b9f8c498eb5dbc63e30b (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-c, release=754, io.k8s.display-name=CentOS Stream 8, GIT_CLEAN=True, RELEASE=HEAD, io.openshift.expose-services=, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.openshift.tags=base centos centos-stream, vendor=Red Hat, Inc., GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., architecture=x86_64, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, version=8, distribution-scope=public, name=centos-stream, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, com.redhat.component=centos-stream-container, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.buildah.version=1.19.8, maintainer=Guillaume Abrioux , vcs-type=git, CEPH_POINT_RELEASE=-17.2.0, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, build-date=2022-05-03T08:36:31.336870) 2024-06-18T02:10:06.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:06 smithi007 podman[93964]: 2024-06-18 02:10:06.104097177 +0000 UTC m=+0.618114326 container cleanup 1d1e2628656b1787737107fc80d20f513a8bebe984e2b9f8c498eb5dbc63e30b (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-c, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, vendor=Red Hat, Inc., io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, com.redhat.component=centos-stream-container, GIT_BRANCH=HEAD, io.openshift.tags=base centos centos-stream, maintainer=Guillaume Abrioux , version=8, io.k8s.display-name=CentOS Stream 8, GIT_REPO=https://github.com/ceph/ceph-container.git, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, distribution-scope=public, release=754, io.openshift.expose-services=, CEPH_POINT_RELEASE=-17.2.0, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.buildah.version=1.19.8, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, build-date=2022-05-03T08:36:31.336870, GIT_CLEAN=True, RELEASE=HEAD, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, architecture=x86_64, vcs-type=git, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, ceph=True, name=centos-stream) 2024-06-18T02:10:06.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:06 smithi007 bash[93964]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-c 2024-06-18T02:10:06.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:06 smithi007 podman[93978]: 2024-06-18 02:10:06.272266301 +0000 UTC m=+0.498186695 container remove 1d1e2628656b1787737107fc80d20f513a8bebe984e2b9f8c498eb5dbc63e30b (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-c, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.openshift.tags=base centos centos-stream, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, GIT_BRANCH=HEAD, io.openshift.expose-services=, io.buildah.version=1.19.8, com.redhat.component=centos-stream-container, GIT_CLEAN=True, vendor=Red Hat, Inc., GIT_REPO=https://github.com/ceph/ceph-container.git, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, name=centos-stream, RELEASE=HEAD, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.k8s.display-name=CentOS Stream 8, architecture=x86_64, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., ceph=True, build-date=2022-05-03T08:36:31.336870, maintainer=Guillaume Abrioux , release=754, vcs-type=git, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, distribution-scope=public, CEPH_POINT_RELEASE=-17.2.0, version=8) 2024-06-18T02:10:06.752 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:06 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mon.c.service: Deactivated successfully. 2024-06-18T02:10:06.752 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:06 smithi007 systemd[1]: Stopped Ceph mon.c for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:10:06.752 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:06 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mon.c.service: Consumed 11.681s CPU time. 2024-06-18T02:10:07.057 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:06 smithi007 systemd[1]: Starting Ceph mon.c for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:10:07.058 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:06 smithi007 podman[94104]: 2024-06-18 02:10:06.956756699 +0000 UTC m=+0.100910041 container create 273d99b73b247dff8ea33340d2391721b6ff746335085517976b9c17f427d34a (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-c, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240612, CEPH_POINT_RELEASE=, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-3781e3a, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-06-18T02:10:07.058 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:06 smithi007 podman[94104]: 2024-06-18 02:10:06.874460438 +0000 UTC m=+0.018613800 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:10:07.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 podman[94104]: 2024-06-18 02:10:07.226709086 +0000 UTC m=+0.370862435 container init 273d99b73b247dff8ea33340d2391721b6ff746335085517976b9c17f427d34a (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-c, ceph=True, org.label-schema.build-date=20240612, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-3781e3a, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-18T02:10:07.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 podman[94104]: 2024-06-18 02:10:07.230283458 +0000 UTC m=+0.374436809 container start 273d99b73b247dff8ea33340d2391721b6ff746335085517976b9c17f427d34a (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-c, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, RELEASE=squid-3781e3a, maintainer=Guillaume Abrioux , GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240612, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-06-18T02:10:07.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: set uid:gid to 167:167 (ceph:ceph) 2024-06-18T02:10:07.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc), process ceph-mon, pid 2 2024-06-18T02:10:07.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: pidfile_write: ignore empty --pid-file 2024-06-18T02:10:07.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: load: jerasure load: lrc 2024-06-18T02:10:07.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: RocksDB version: 7.9.2 2024-06-18T02:10:07.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Git sha 0 2024-06-18T02:10:07.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Compile date 2024-06-17 15:21:02 2024-06-18T02:10:07.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: DB SUMMARY 2024-06-18T02:10:07.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: DB Session ID: G9W4FV7OKRPEH4PPLGVW 2024-06-18T02:10:07.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: CURRENT file: CURRENT 2024-06-18T02:10:07.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: IDENTITY file: IDENTITY 2024-06-18T02:10:07.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: MANIFEST file: MANIFEST-000009 size: 1851 Bytes 2024-06-18T02:10:07.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 1, files: 000039.sst 2024-06-18T02:10:07.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000037.log size: 945103 ; 2024-06-18T02:10:07.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.error_if_exists: 0 2024-06-18T02:10:07.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.create_if_missing: 0 2024-06-18T02:10:07.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.paranoid_checks: 1 2024-06-18T02:10:07.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.flush_verify_memtable_count: 1 2024-06-18T02:10:07.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-06-18T02:10:07.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-06-18T02:10:07.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.env: 0x55ce18c48740 2024-06-18T02:10:07.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.fs: PosixFileSystem 2024-06-18T02:10:07.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.info_log: 0x55ce1addd000 2024-06-18T02:10:07.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.max_file_opening_threads: 16 2024-06-18T02:10:07.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.statistics: (nil) 2024-06-18T02:10:07.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.use_fsync: 0 2024-06-18T02:10:07.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.max_log_file_size: 0 2024-06-18T02:10:07.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-06-18T02:10:07.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.log_file_time_to_roll: 0 2024-06-18T02:10:07.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.keep_log_file_num: 1000 2024-06-18T02:10:07.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.recycle_log_file_num: 0 2024-06-18T02:10:07.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.allow_fallocate: 1 2024-06-18T02:10:07.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.allow_mmap_reads: 0 2024-06-18T02:10:07.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.allow_mmap_writes: 0 2024-06-18T02:10:07.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.use_direct_reads: 0 2024-06-18T02:10:07.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-06-18T02:10:07.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.create_missing_column_families: 0 2024-06-18T02:10:07.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.db_log_dir: 2024-06-18T02:10:07.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.wal_dir: 2024-06-18T02:10:07.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.table_cache_numshardbits: 6 2024-06-18T02:10:07.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.WAL_ttl_seconds: 0 2024-06-18T02:10:07.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.WAL_size_limit_MB: 0 2024-06-18T02:10:07.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-06-18T02:10:07.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-06-18T02:10:07.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.is_fd_close_on_exec: 1 2024-06-18T02:10:07.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.advise_random_on_open: 1 2024-06-18T02:10:07.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.db_write_buffer_size: 0 2024-06-18T02:10:07.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.write_buffer_manager: 0x55ce1adec1e0 2024-06-18T02:10:07.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-06-18T02:10:07.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-06-18T02:10:07.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.use_adaptive_mutex: 0 2024-06-18T02:10:07.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.rate_limiter: (nil) 2024-06-18T02:10:07.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-06-18T02:10:07.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.wal_recovery_mode: 2 2024-06-18T02:10:07.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.enable_thread_tracking: 0 2024-06-18T02:10:07.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.enable_pipelined_write: 0 2024-06-18T02:10:07.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.unordered_write: 0 2024-06-18T02:10:07.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-06-18T02:10:07.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-06-18T02:10:07.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-06-18T02:10:07.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-06-18T02:10:07.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.row_cache: None 2024-06-18T02:10:07.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.wal_filter: None 2024-06-18T02:10:07.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-06-18T02:10:07.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.allow_ingest_behind: 0 2024-06-18T02:10:07.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.two_write_queues: 0 2024-06-18T02:10:07.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.manual_wal_flush: 0 2024-06-18T02:10:07.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.wal_compression: 0 2024-06-18T02:10:07.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.atomic_flush: 0 2024-06-18T02:10:07.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-06-18T02:10:07.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.persist_stats_to_disk: 0 2024-06-18T02:10:07.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.write_dbid_to_manifest: 0 2024-06-18T02:10:07.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.log_readahead_size: 0 2024-06-18T02:10:07.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-06-18T02:10:07.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.best_efforts_recovery: 0 2024-06-18T02:10:07.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-06-18T02:10:07.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-06-18T02:10:07.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.allow_data_in_errors: 0 2024-06-18T02:10:07.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.db_host_id: __hostname__ 2024-06-18T02:10:07.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.enforce_single_del_contracts: true 2024-06-18T02:10:07.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.max_background_jobs: 2 2024-06-18T02:10:07.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.max_background_compactions: -1 2024-06-18T02:10:07.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.max_subcompactions: 1 2024-06-18T02:10:07.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-06-18T02:10:07.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-06-18T02:10:07.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.delayed_write_rate : 16777216 2024-06-18T02:10:07.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.max_total_wal_size: 0 2024-06-18T02:10:07.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-06-18T02:10:07.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.stats_dump_period_sec: 600 2024-06-18T02:10:07.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.stats_persist_period_sec: 600 2024-06-18T02:10:07.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-06-18T02:10:07.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.max_open_files: -1 2024-06-18T02:10:07.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.bytes_per_sync: 0 2024-06-18T02:10:07.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.wal_bytes_per_sync: 0 2024-06-18T02:10:07.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.strict_bytes_per_sync: 0 2024-06-18T02:10:07.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.compaction_readahead_size: 0 2024-06-18T02:10:07.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.max_background_flushes: -1 2024-06-18T02:10:07.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Compression algorithms supported: 2024-06-18T02:10:07.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: kZSTD supported: 0 2024-06-18T02:10:07.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: kXpressCompression supported: 0 2024-06-18T02:10:07.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: kBZip2Compression supported: 0 2024-06-18T02:10:07.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-06-18T02:10:07.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: kLZ4Compression supported: 1 2024-06-18T02:10:07.442 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: kZlibCompression supported: 1 2024-06-18T02:10:07.442 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: kLZ4HCCompression supported: 1 2024-06-18T02:10:07.442 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: kSnappyCompression supported: 1 2024-06-18T02:10:07.442 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Fast CRC32 supported: Supported on x86 2024-06-18T02:10:07.442 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: DMutex implementation: pthread_mutex_t 2024-06-18T02:10:07.442 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000009 2024-06-18T02:10:07.442 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-06-18T02:10:07.442 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-06-18T02:10:07.442 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.merge_operator: 2024-06-18T02:10:07.442 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.compaction_filter: None 2024-06-18T02:10:07.442 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.compaction_filter_factory: None 2024-06-18T02:10:07.442 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.sst_partitioner_factory: None 2024-06-18T02:10:07.442 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.memtable_factory: SkipListFactory 2024-06-18T02:10:07.442 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.table_factory: BlockBasedTable 2024-06-18T02:10:07.443 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55ce1addcd00) 2024-06-18T02:10:07.443 INFO:journalctl@ceph.mon.c.smithi007.stdout: cache_index_and_filter_blocks: 1 2024-06-18T02:10:07.443 INFO:journalctl@ceph.mon.c.smithi007.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-06-18T02:10:07.443 INFO:journalctl@ceph.mon.c.smithi007.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-06-18T02:10:07.443 INFO:journalctl@ceph.mon.c.smithi007.stdout: pin_top_level_index_and_filter: 1 2024-06-18T02:10:07.443 INFO:journalctl@ceph.mon.c.smithi007.stdout: index_type: 0 2024-06-18T02:10:07.443 INFO:journalctl@ceph.mon.c.smithi007.stdout: data_block_index_type: 0 2024-06-18T02:10:07.443 INFO:journalctl@ceph.mon.c.smithi007.stdout: index_shortening: 1 2024-06-18T02:10:07.443 INFO:journalctl@ceph.mon.c.smithi007.stdout: data_block_hash_table_util_ratio: 0.750000 2024-06-18T02:10:07.443 INFO:journalctl@ceph.mon.c.smithi007.stdout: checksum: 4 2024-06-18T02:10:07.443 INFO:journalctl@ceph.mon.c.smithi007.stdout: no_block_cache: 0 2024-06-18T02:10:07.443 INFO:journalctl@ceph.mon.c.smithi007.stdout: block_cache: 0x55ce1add3090 2024-06-18T02:10:07.443 INFO:journalctl@ceph.mon.c.smithi007.stdout: block_cache_name: BinnedLRUCache 2024-06-18T02:10:07.444 INFO:journalctl@ceph.mon.c.smithi007.stdout: block_cache_options: 2024-06-18T02:10:07.444 INFO:journalctl@ceph.mon.c.smithi007.stdout: capacity : 536870912 2024-06-18T02:10:07.444 INFO:journalctl@ceph.mon.c.smithi007.stdout: num_shard_bits : 4 2024-06-18T02:10:07.444 INFO:journalctl@ceph.mon.c.smithi007.stdout: strict_capacity_limit : 0 2024-06-18T02:10:07.444 INFO:journalctl@ceph.mon.c.smithi007.stdout: high_pri_pool_ratio: 0.000 2024-06-18T02:10:07.444 INFO:journalctl@ceph.mon.c.smithi007.stdout: block_cache_compressed: (nil) 2024-06-18T02:10:07.444 INFO:journalctl@ceph.mon.c.smithi007.stdout: persistent_cache: (nil) 2024-06-18T02:10:07.444 INFO:journalctl@ceph.mon.c.smithi007.stdout: block_size: 4096 2024-06-18T02:10:07.444 INFO:journalctl@ceph.mon.c.smithi007.stdout: block_size_deviation: 10 2024-06-18T02:10:07.444 INFO:journalctl@ceph.mon.c.smithi007.stdout: block_restart_interval: 16 2024-06-18T02:10:07.444 INFO:journalctl@ceph.mon.c.smithi007.stdout: index_block_restart_interval: 1 2024-06-18T02:10:07.444 INFO:journalctl@ceph.mon.c.smithi007.stdout: metadata_block_size: 4096 2024-06-18T02:10:07.444 INFO:journalctl@ceph.mon.c.smithi007.stdout: partition_filters: 0 2024-06-18T02:10:07.444 INFO:journalctl@ceph.mon.c.smithi007.stdout: use_delta_encoding: 1 2024-06-18T02:10:07.444 INFO:journalctl@ceph.mon.c.smithi007.stdout: filter_policy: bloomfilter 2024-06-18T02:10:07.445 INFO:journalctl@ceph.mon.c.smithi007.stdout: whole_key_filtering: 1 2024-06-18T02:10:07.445 INFO:journalctl@ceph.mon.c.smithi007.stdout: verify_compression: 0 2024-06-18T02:10:07.445 INFO:journalctl@ceph.mon.c.smithi007.stdout: read_amp_bytes_per_bit: 0 2024-06-18T02:10:07.445 INFO:journalctl@ceph.mon.c.smithi007.stdout: format_version: 5 2024-06-18T02:10:07.445 INFO:journalctl@ceph.mon.c.smithi007.stdout: enable_index_compression: 1 2024-06-18T02:10:07.445 INFO:journalctl@ceph.mon.c.smithi007.stdout: block_align: 0 2024-06-18T02:10:07.445 INFO:journalctl@ceph.mon.c.smithi007.stdout: max_auto_readahead_size: 262144 2024-06-18T02:10:07.445 INFO:journalctl@ceph.mon.c.smithi007.stdout: prepopulate_block_cache: 0 2024-06-18T02:10:07.445 INFO:journalctl@ceph.mon.c.smithi007.stdout: initial_auto_readahead_size: 8192 2024-06-18T02:10:07.445 INFO:journalctl@ceph.mon.c.smithi007.stdout: num_file_reads_for_auto_readahead: 2 2024-06-18T02:10:07.445 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.write_buffer_size: 33554432 2024-06-18T02:10:07.445 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.max_write_buffer_number: 2 2024-06-18T02:10:07.445 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.compression: NoCompression 2024-06-18T02:10:07.445 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.bottommost_compression: Disabled 2024-06-18T02:10:07.446 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.prefix_extractor: nullptr 2024-06-18T02:10:07.446 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-06-18T02:10:07.446 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.num_levels: 7 2024-06-18T02:10:07.446 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-06-18T02:10:07.446 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-06-18T02:10:07.446 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-06-18T02:10:07.446 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-06-18T02:10:07.446 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-06-18T02:10:07.446 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-06-18T02:10:07.446 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-06-18T02:10:07.446 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-06-18T02:10:07.446 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-06-18T02:10:07.446 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-06-18T02:10:07.447 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-06-18T02:10:07.447 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-06-18T02:10:07.447 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.compression_opts.window_bits: -14 2024-06-18T02:10:07.447 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.compression_opts.level: 32767 2024-06-18T02:10:07.447 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.compression_opts.strategy: 0 2024-06-18T02:10:07.447 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-06-18T02:10:07.447 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-06-18T02:10:07.447 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-06-18T02:10:07.447 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-06-18T02:10:07.447 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.compression_opts.enabled: false 2024-06-18T02:10:07.447 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-06-18T02:10:07.447 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-06-18T02:10:07.447 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-06-18T02:10:07.447 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-06-18T02:10:07.448 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.target_file_size_base: 67108864 2024-06-18T02:10:07.448 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.target_file_size_multiplier: 1 2024-06-18T02:10:07.448 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-06-18T02:10:07.448 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-06-18T02:10:07.448 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-06-18T02:10:07.448 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-06-18T02:10:07.448 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-06-18T02:10:07.448 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-06-18T02:10:07.448 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-06-18T02:10:07.448 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-06-18T02:10:07.448 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-06-18T02:10:07.448 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-06-18T02:10:07.448 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-06-18T02:10:07.448 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-06-18T02:10:07.449 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-06-18T02:10:07.449 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.arena_block_size: 1048576 2024-06-18T02:10:07.449 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-06-18T02:10:07.449 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-06-18T02:10:07.449 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.disable_auto_compactions: 0 2024-06-18T02:10:07.449 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-06-18T02:10:07.449 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-06-18T02:10:07.449 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-06-18T02:10:07.449 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-06-18T02:10:07.449 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-06-18T02:10:07.449 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-06-18T02:10:07.449 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-06-18T02:10:07.449 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-06-18T02:10:07.449 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-06-18T02:10:07.450 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-06-18T02:10:07.450 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.table_properties_collectors: 2024-06-18T02:10:07.450 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.inplace_update_support: 0 2024-06-18T02:10:07.450 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.inplace_update_num_locks: 10000 2024-06-18T02:10:07.450 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-06-18T02:10:07.450 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-06-18T02:10:07.450 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.memtable_huge_page_size: 0 2024-06-18T02:10:07.450 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.bloom_locality: 0 2024-06-18T02:10:07.450 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.max_successive_merges: 0 2024-06-18T02:10:07.450 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.optimize_filters_for_hits: 0 2024-06-18T02:10:07.450 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.paranoid_file_checks: 0 2024-06-18T02:10:07.450 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.force_consistency_checks: 1 2024-06-18T02:10:07.450 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.report_bg_io_stats: 0 2024-06-18T02:10:07.450 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.ttl: 2592000 2024-06-18T02:10:07.451 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.periodic_compaction_seconds: 0 2024-06-18T02:10:07.451 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-06-18T02:10:07.451 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-06-18T02:10:07.451 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.enable_blob_files: false 2024-06-18T02:10:07.451 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.min_blob_size: 0 2024-06-18T02:10:07.451 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.blob_file_size: 268435456 2024-06-18T02:10:07.451 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.blob_compression_type: NoCompression 2024-06-18T02:10:07.451 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.enable_blob_garbage_collection: false 2024-06-18T02:10:07.451 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-06-18T02:10:07.451 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-06-18T02:10:07.451 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-06-18T02:10:07.451 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.blob_file_starting_level: 0 2024-06-18T02:10:07.451 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-06-18T02:10:07.452 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 39.sst 2024-06-18T02:10:07.452 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-06-18T02:10:07.452 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 41, last_sequence is 24137, log_number is 37,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-06-18T02:10:07.452 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 37 2024-06-18T02:10:07.452 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 831fd904-c59d-49e1-b699-49ed83c61de1 2024-06-18T02:10:07.452 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: EVENT_LOG_v1 {"time_micros": 1718676607257545, "job": 1, "event": "recovery_started", "wal_files": [37]} 2024-06-18T02:10:07.452 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #37 mode 2 2024-06-18T02:10:07.452 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: EVENT_LOG_v1 {"time_micros": 1718676607261274, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 42, "file_size": 600423, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 24142, "largest_seqno": 25007, "table_properties": {"data_size": 596701, "index_size": 1428, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1285, "raw_key_size": 12088, "raw_average_key_size": 24, "raw_value_size": 588452, "raw_average_value_size": 1203, "num_data_blocks": 58, "num_entries": 489, "num_filter_entries": 489, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1718676607, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "831fd904-c59d-49e1-b699-49ed83c61de1", "db_session_id": "G9W4FV7OKRPEH4PPLGVW", "orig_file_number": 42, "seqno_to_time_mapping": "N/A"}} 2024-06-18T02:10:07.452 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: EVENT_LOG_v1 {"time_micros": 1718676607261381, "job": 1, "event": "recovery_finished"} 2024-06-18T02:10:07.452 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: [db/version_set.cc:5047] Creating manifest 44 2024-06-18T02:10:07.452 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-06-18T02:10:07.452 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000037.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-06-18T02:10:07.452 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55ce1ae00e00 2024-06-18T02:10:07.453 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: DB pointer 0x55ce1aef6000 2024-06-18T02:10:07.453 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-06-18T02:10:07.453 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-06-18T02:10:07.453 INFO:journalctl@ceph.mon.c.smithi007.stdout: ** DB Stats ** 2024-06-18T02:10:07.453 INFO:journalctl@ceph.mon.c.smithi007.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-18T02:10:07.453 INFO:journalctl@ceph.mon.c.smithi007.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-06-18T02:10:07.453 INFO:journalctl@ceph.mon.c.smithi007.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-18T02:10:07.453 INFO:journalctl@ceph.mon.c.smithi007.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-18T02:10:07.453 INFO:journalctl@ceph.mon.c.smithi007.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-06-18T02:10:07.453 INFO:journalctl@ceph.mon.c.smithi007.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-18T02:10:07.453 INFO:journalctl@ceph.mon.c.smithi007.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-18T02:10:07.453 INFO:journalctl@ceph.mon.c.smithi007.stdout: 2024-06-18T02:10:07.453 INFO:journalctl@ceph.mon.c.smithi007.stdout: ** Compaction Stats [default] ** 2024-06-18T02:10:07.453 INFO:journalctl@ceph.mon.c.smithi007.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-06-18T02:10:07.454 INFO:journalctl@ceph.mon.c.smithi007.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-06-18T02:10:07.454 INFO:journalctl@ceph.mon.c.smithi007.stdout: L0 1/0 586.35 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 281.4 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-06-18T02:10:07.454 INFO:journalctl@ceph.mon.c.smithi007.stdout: L6 1/0 12.91 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-06-18T02:10:07.454 INFO:journalctl@ceph.mon.c.smithi007.stdout: Sum 2/0 13.49 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 281.4 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-06-18T02:10:07.454 INFO:journalctl@ceph.mon.c.smithi007.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 281.4 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-06-18T02:10:07.454 INFO:journalctl@ceph.mon.c.smithi007.stdout: 2024-06-18T02:10:07.454 INFO:journalctl@ceph.mon.c.smithi007.stdout: ** Compaction Stats [default] ** 2024-06-18T02:10:07.454 INFO:journalctl@ceph.mon.c.smithi007.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-06-18T02:10:07.454 INFO:journalctl@ceph.mon.c.smithi007.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-06-18T02:10:07.454 INFO:journalctl@ceph.mon.c.smithi007.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 281.4 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-06-18T02:10:07.454 INFO:journalctl@ceph.mon.c.smithi007.stdout: 2024-06-18T02:10:07.454 INFO:journalctl@ceph.mon.c.smithi007.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-06-18T02:10:07.454 INFO:journalctl@ceph.mon.c.smithi007.stdout: 2024-06-18T02:10:07.455 INFO:journalctl@ceph.mon.c.smithi007.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-18T02:10:07.455 INFO:journalctl@ceph.mon.c.smithi007.stdout: Flush(GB): cumulative 0.001, interval 0.001 2024-06-18T02:10:07.455 INFO:journalctl@ceph.mon.c.smithi007.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-06-18T02:10:07.455 INFO:journalctl@ceph.mon.c.smithi007.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-06-18T02:10:07.455 INFO:journalctl@ceph.mon.c.smithi007.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-06-18T02:10:07.455 INFO:journalctl@ceph.mon.c.smithi007.stdout: AddFile(Keys): cumulative 0, interval 0 2024-06-18T02:10:07.455 INFO:journalctl@ceph.mon.c.smithi007.stdout: Cumulative compaction: 0.00 GB write, 93.78 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-18T02:10:07.455 INFO:journalctl@ceph.mon.c.smithi007.stdout: Interval compaction: 0.00 GB write, 93.78 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-18T02:10:07.455 INFO:journalctl@ceph.mon.c.smithi007.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-06-18T02:10:07.455 INFO:journalctl@ceph.mon.c.smithi007.stdout: Block cache BinnedLRUCache@0x55ce1add3090#2 capacity: 512.00 MB usage: 2.98 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-06-18T02:10:07.455 INFO:journalctl@ceph.mon.c.smithi007.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.41 KB,0.000268221%) IndexBlock(1,1.58 KB,0.000301003%) Misc(1,0.00 KB,0%) 2024-06-18T02:10:07.455 INFO:journalctl@ceph.mon.c.smithi007.stdout: 2024-06-18T02:10:07.455 INFO:journalctl@ceph.mon.c.smithi007.stdout: ** File Read Latency Histogram By Level [default] ** 2024-06-18T02:10:07.455 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: starting mon.c rank 1 at public addrs [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] at bind addrs [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 2024-06-18T02:10:07.456 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: mon.c@-1(???) e3 preinit fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 2024-06-18T02:10:07.456 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: mon.c@-1(???).mds e1 new map 2024-06-18T02:10:07.456 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: mon.c@-1(???).mds e1 print_map 2024-06-18T02:10:07.456 INFO:journalctl@ceph.mon.c.smithi007.stdout: e1 2024-06-18T02:10:07.456 INFO:journalctl@ceph.mon.c.smithi007.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-06-18T02:10:07.456 INFO:journalctl@ceph.mon.c.smithi007.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-18T02:10:07.456 INFO:journalctl@ceph.mon.c.smithi007.stdout: legacy client fscid: -1 2024-06-18T02:10:07.456 INFO:journalctl@ceph.mon.c.smithi007.stdout: 2024-06-18T02:10:07.456 INFO:journalctl@ceph.mon.c.smithi007.stdout: No filesystems configured 2024-06-18T02:10:07.456 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: mon.c@-1(???).osd e115 crush map has features 3314933000854323200, adjusting msgr requires 2024-06-18T02:10:07.456 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: mon.c@-1(???).osd e115 crush map has features 432629239337189376, adjusting msgr requires 2024-06-18T02:10:07.456 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: mon.c@-1(???).osd e115 crush map has features 432629239337189376, adjusting msgr requires 2024-06-18T02:10:07.456 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: mon.c@-1(???).osd e115 crush map has features 432629239337189376, adjusting msgr requires 2024-06-18T02:10:07.457 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 ceph-mon[94123]: mon.c@-1(???).paxosservice(auth 1..25) refresh upgraded, format 0 -> 3 2024-06-18T02:10:07.457 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 bash[94104]: 273d99b73b247dff8ea33340d2391721b6ff746335085517976b9c17f427d34a 2024-06-18T02:10:07.457 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:07 smithi007 systemd[1]: Started Ceph mon.c for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:10:08.264 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:10:07 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:10:07] "GET /metrics HTTP/1.1" 200 38237 "" "Prometheus/2.33.4" 2024-06-18T02:10:08.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:10:08.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: mon.c calling monitor election 2024-06-18T02:10:08.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: mon.a calling monitor election 2024-06-18T02:10:08.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-06-18T02:10:08.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: monmap epoch 3 2024-06-18T02:10:08.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 2024-06-18T02:10:08.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: last_changed 2024-06-18T01:57:18.881740+0000 2024-06-18T02:10:08.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: created 2024-06-18T01:55:37.939231+0000 2024-06-18T02:10:08.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: min_mon_release 17 (quincy) 2024-06-18T02:10:08.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: election_strategy: 1 2024-06-18T02:10:08.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-06-18T02:10:08.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: 1: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-06-18T02:10:08.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: 2: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-06-18T02:10:08.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: fsmap 2024-06-18T02:10:08.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: osdmap e115: 8 total, 8 up, 8 in 2024-06-18T02:10:08.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: mgrmap e47: x(active, since 86s), standbys: y 2024-06-18T02:10:08.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: overall HEALTH_OK 2024-06-18T02:10:08.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:08.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:08.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:08.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:08.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:08.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:08.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:08.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:08.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:08.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:08.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:08.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:08.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:08.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:08.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:08.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:08.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:08.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:08.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:08.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:08.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:08.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:08.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:08.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:08.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:08.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:08.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: pgmap v60: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:10:08.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:08.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:08.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:08.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:08.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:08.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:08.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:08.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:08.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:08.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:08.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:08.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:08.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:08.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:08.549 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:08.549 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:08.549 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:08.549 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:08.549 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:08.549 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:08.612 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:10:08.613 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: mon.c calling monitor election 2024-06-18T02:10:08.613 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: mon.a calling monitor election 2024-06-18T02:10:08.613 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-06-18T02:10:08.613 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: monmap epoch 3 2024-06-18T02:10:08.613 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 2024-06-18T02:10:08.613 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: last_changed 2024-06-18T01:57:18.881740+0000 2024-06-18T02:10:08.613 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: created 2024-06-18T01:55:37.939231+0000 2024-06-18T02:10:08.613 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: min_mon_release 17 (quincy) 2024-06-18T02:10:08.613 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: election_strategy: 1 2024-06-18T02:10:08.613 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-06-18T02:10:08.613 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: 1: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-06-18T02:10:08.613 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: 2: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-06-18T02:10:08.613 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: fsmap 2024-06-18T02:10:08.614 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: osdmap e115: 8 total, 8 up, 8 in 2024-06-18T02:10:08.614 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: mgrmap e47: x(active, since 86s), standbys: y 2024-06-18T02:10:08.614 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: overall HEALTH_OK 2024-06-18T02:10:08.614 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:08.614 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:08.614 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:08.614 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:08.614 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:08.614 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:08.614 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:08.614 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:08.614 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:08.614 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:08.615 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:08.615 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:08.615 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:08.615 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:08.615 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:08.615 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:08.615 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:08.615 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:08.615 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:08.615 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:08.615 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:10:08.616 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: mon.c calling monitor election 2024-06-18T02:10:08.616 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: mon.a calling monitor election 2024-06-18T02:10:08.616 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-06-18T02:10:08.616 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: monmap epoch 3 2024-06-18T02:10:08.616 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 2024-06-18T02:10:08.616 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: last_changed 2024-06-18T01:57:18.881740+0000 2024-06-18T02:10:08.616 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: created 2024-06-18T01:55:37.939231+0000 2024-06-18T02:10:08.616 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: min_mon_release 17 (quincy) 2024-06-18T02:10:08.616 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: election_strategy: 1 2024-06-18T02:10:08.616 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-06-18T02:10:08.616 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: 1: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-06-18T02:10:08.616 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: 2: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-06-18T02:10:08.616 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: fsmap 2024-06-18T02:10:08.617 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: osdmap e115: 8 total, 8 up, 8 in 2024-06-18T02:10:08.617 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: mgrmap e47: x(active, since 86s), standbys: y 2024-06-18T02:10:08.617 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: overall HEALTH_OK 2024-06-18T02:10:08.617 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:08.617 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:08.617 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:08.617 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:08.617 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:08.617 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:08.617 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:08.617 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:08.617 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:08.617 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:08.618 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:08.618 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:08.618 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:08.618 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:08.618 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:08.618 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:08.618 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:08.618 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:08.618 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:08.618 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:08.619 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:08.619 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:08.619 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:08.619 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:08.619 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:08.619 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:08.619 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: pgmap v60: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:10:08.619 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:08.619 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:08.619 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:08.619 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:08.619 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:08.619 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:08.620 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:08.620 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:08.620 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:08.620 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:08.620 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:08.620 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:08.620 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:08.620 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:08.620 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:08.620 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:08.620 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:08.620 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:08.620 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:08.621 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:08.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:08.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:08.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:08.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:08.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:08.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:08.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: pgmap v60: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:10:08.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:08.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:08.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:08.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:08.622 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:08.622 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:08.622 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:08.622 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:08.622 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:08.622 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:08.622 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:08.622 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:08.622 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:08.622 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:08.622 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:08.622 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:08.622 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:08.622 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:08.623 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:08.623 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:08 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:08.941 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:10:08 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:10:08.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.7\", device_class=\"ssd\", hostname=\"smithi007\", instance=\"172.21.15.130:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.7\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"cd9a3408-2d15-11ef-bc9d-c7b262605968\", cluster_addr=\"172.21.15.7\", device_class=\"ssd\", hostname=\"smithi007\", instance=\"smithi130:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.7\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-06-18T02:10:09.345 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:09.345 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:09.345 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:09.346 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:09.346 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:09.346 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:09.346 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:09.346 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:09.346 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:09.346 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:09.346 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:09.346 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:09.346 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:09.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:09 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:09.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:09 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:09.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:09.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:09.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:09.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:09.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:09 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:09.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:09 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:09.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:09.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:09.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:09.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:09.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:09 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:09.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:09 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:09.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:09.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:09.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:09.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:09.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:09 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:09.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:09 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:09.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:09.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:09.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:09.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:09.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:09 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:09.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:09 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:09.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:09.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:09.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:09.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:09.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:09 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:09.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:09 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:09.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:09.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:09.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:09.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:09.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:09 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:09.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:09 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:09.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:09.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:09.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:09.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:09.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:09 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:09.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:09.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:09.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:09.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:09.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:09 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:09.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:09 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:09.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:09 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:09.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:09 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:09.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:09.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:09.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:09.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:09 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:09.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:09 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:09.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:09.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:09.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:09.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:09.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:09.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:09.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:09.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:09.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:09.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:09.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:09.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:09.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:09.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:09.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:09.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:09.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:09.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:09.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:09.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:09.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:09.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:09.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:09.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:09.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:09.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:09.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:09.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:09.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:09.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:09.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:09.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:09.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:09.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:09.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:09.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:09.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:09.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:09.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:09.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:09.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:09.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:09.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:09.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:09.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:09.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:09.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:09.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:09.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:09.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:09.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:09.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:09.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:09.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:09.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:09.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:09.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:09.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:09.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:09.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:09.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:09.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:09.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:09.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:09.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:09.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:09.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:09.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:09.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:09.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:09.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:09.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:09.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:09.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:09.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:09.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:09.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:09.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:09.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:09.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:09.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:09.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:09.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:09.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:09.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:09.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:09.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:09.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:09.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:09.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:09.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:09.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:09.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:09.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:09.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:09.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:09.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:09.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:09.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:09 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:10.670 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:10.670 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:10.670 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:10.670 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:10.671 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:10.671 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:10.671 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:10.671 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:10.671 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:10.672 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:10.672 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:10.672 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:10.672 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:10.672 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:10.672 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:10.673 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:10.673 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:10.673 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:10.673 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:10.673 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:10.674 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:10.674 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:10.674 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:10.674 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:10.675 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:10.675 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:10.675 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:10.675 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[73500]: pgmap v61: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:10:10.675 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:10.676 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:10.676 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:10.676 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:10.677 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:10.677 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:10.677 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:10.677 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:10.677 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:10.678 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:10.678 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:10.678 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:10.678 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:10.678 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:10.678 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:10.679 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:10.679 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:10.679 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:10.679 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:10.679 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:10.679 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:10.680 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:10.680 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:10.680 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:10.680 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:10.680 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:10.680 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:10.681 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:10.681 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:10.681 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[94123]: pgmap v61: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:10:10.681 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:10.681 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:10.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:10.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:10.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:10.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:10.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:10.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:10.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:10.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:10.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:10.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:10.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:10.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:10.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:10.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:10.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:10.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:10.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:10.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:10.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:10.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:10.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:10.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:10.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:10.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:10.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:10.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:10.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:10.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:10.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:10.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:10.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:10.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:10.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:10.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:10.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:10.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:10.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:10.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:10.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:10.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:10.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:10.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:10.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:10.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:10.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:10.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:10.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:10.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:10.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:10.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:10 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:10.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:10 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:10.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:10 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:10.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:10 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:10.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:10.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:10.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:10.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:10.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:10 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:10.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:10 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:10.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:10.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:10.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:10.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:10.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:10 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:10.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:10 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:10.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:10.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:10.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:10.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:10.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:10 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:10.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:10 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:10.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:10.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:10.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:10.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:10.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:10 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:10.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:10 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:10.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:10 smithi130 ceph-mon[26123]: pgmap v61: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:10:10.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:10.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:10.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:10.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:10.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:10 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:10.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:10 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:10.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:10.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:10.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:10.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:10.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:10 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:10.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:10 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:10.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:10.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:10.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:10.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:10.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:10 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:10.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:10.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:10.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:10.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:10.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:10 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:10.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:10.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:10.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:10.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:10 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:10.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:10 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:11.681 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:11.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:11.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:11.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:11.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:11.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:11.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:11.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:11.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:11.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:11.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:11.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:11.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:11.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:11.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:11.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:11.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:11.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:11.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:11.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:11.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:11.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:11.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:11.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:11.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:11.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:11.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:11.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:11.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:11.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:11.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:11.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:11.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:11.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:11.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:11.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:11.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:11.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:11.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:11.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:11.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:11.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:11.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:11.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:11.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:11.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:11.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:11.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:11.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:11.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:11.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:11.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:11.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:11.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:11.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:11.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:11.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:11.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:11.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:11.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:11.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:11.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:11.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:11.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:11.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:11.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:11.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:11.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:11.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:11.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:11.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:11.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:11.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:11.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:11.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:10:11.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:11.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:11.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:11.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:11.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:11.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:11.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:11.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:11.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:11.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:11.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:11.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:11.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:11.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:11.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:11.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:11.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:11.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:11.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:11.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:10:11.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:11.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:11.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:11.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:11.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:11 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:11.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:11 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:11.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:11 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:11.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:11 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:11.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:11.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:11.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:11.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:11.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:11 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:11.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:11 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:11.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:11.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:11.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:11.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:11.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:11 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:11.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:11 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:11.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:11.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:11.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:11.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:11.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:11 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:11.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:11 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:11.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:11.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:11.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:11.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:11.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:11 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:11.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:11 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:11.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:11.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:11.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:11.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:11.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:11 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:11.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:11 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:11.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:11.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:11.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:11.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:11.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:11 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:11.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:11 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:11.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:11.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:11.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:11.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:11.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:11 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:11.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:10:11.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:11.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:11.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:11.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:11 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:11.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:11 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:12.543 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:10:12 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:10:12.273+0000 7f680f9b8640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-06-18T02:10:12.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:12 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:12.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:12 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:12.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:12.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:12.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:12.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:12.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:12 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:12.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:12 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:12.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:12.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:12.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:12.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:12.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:12 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:12.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:12 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:12.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:12.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:12.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:12.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:12.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:12 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:12.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:12 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:12.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:12.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:12.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:12.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:12.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:12 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:12.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:12 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:12.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:12.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:12.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:12.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:12.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:12 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:12.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:12 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:12.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:12 smithi130 ceph-mon[26123]: pgmap v62: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:10:12.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:12 smithi130 ceph-mon[26123]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:10:12.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:12.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:12.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:12.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:12.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:12 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:12.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:12 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:12.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:12.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:12.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:12.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:12.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:12 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:12.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:12.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:12.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:12.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:12.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:12 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:12.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:12.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:12.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:12.549 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:12 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:12.549 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:12 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:12.673 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:12.673 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:12.673 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:12.674 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:12.674 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:12.674 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:12.674 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:12.674 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:12.674 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:12.674 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:12.674 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:12.674 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:12.674 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:12.674 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:12.674 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:12.674 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:12.675 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:12.675 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:12.675 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:12.675 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:12.675 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:12.675 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:12.675 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:12.675 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:12.675 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:12.675 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:12.675 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:12.675 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:12.675 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:12.676 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:12.676 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:12.676 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:12.676 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:12.676 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:12.676 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:12.676 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:12.676 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:12.676 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:12.676 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:12.677 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:12.677 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:12.677 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:12.677 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:12.677 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:12.677 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:12.677 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:12.677 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:12.677 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:12.677 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:12.677 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:12.677 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:12.677 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:12.677 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:12.678 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:12.678 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:12.678 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:12.678 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:12.678 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:12.678 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:12.678 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:12.678 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:12.678 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[94123]: pgmap v62: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:10:12.678 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[94123]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:10:12.678 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:12.679 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:12.679 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:12.679 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:12.679 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:12.679 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:12.679 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:12.679 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:12.679 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:12.679 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:12.679 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:12.679 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:12.679 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:12.679 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:12.679 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:12.679 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:12.679 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:12.680 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:12.680 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:12.680 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:12.680 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:12.680 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:12.680 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:12.680 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:12.680 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[73500]: pgmap v62: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:10:12.680 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[73500]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:10:12.680 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:12.680 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:12.680 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:12.680 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:12.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:12.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:12.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:12.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:12.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:12.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:12.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:12.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:12.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:12.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:12.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:12.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:12.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:12.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:12.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:12.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:12.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:12 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:13.605 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:13.605 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:13.605 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:13.605 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:13.605 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:13.605 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:13.605 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:13.605 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:13.605 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:13.606 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:13.606 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:13.606 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:13.606 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:13.606 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:13.606 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:13.606 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:13.606 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:13.606 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:13.606 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:13.606 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:13.606 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:13.606 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:13.607 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:13.607 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:13.607 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:13.607 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:13.607 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:13.607 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:13.607 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:13.607 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:13.607 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:13.607 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:13.607 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:13.607 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:13.607 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:13.608 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:13.608 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:13.608 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:13.608 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:13.608 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:13.608 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:13.608 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:13.608 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:13.608 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:13.608 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:13.608 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:13.608 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:13.608 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:13.608 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:13.608 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:13.609 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:13.609 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:13.609 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:13.609 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:13.609 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:13.609 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:13.609 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:13.609 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:13.609 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:13.609 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:13.609 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:13.610 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:13.610 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:13.610 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:13.610 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:13.610 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:13.610 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:13.610 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:13.610 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:13.610 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:13.610 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:13.610 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:13.610 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:13.610 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:13.611 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:13.611 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:13.611 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:13.611 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:13.611 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:13.611 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:13.611 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:13.611 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:13.611 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:13.611 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:13.611 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:13.611 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:13.611 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:13.612 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:13.612 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:13.612 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:13.612 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:13.612 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:13.612 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:13.612 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:13.612 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:13.612 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:13.612 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:13.612 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:13.612 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:13.612 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:13.612 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:13.612 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:13.612 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:13.613 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:13.613 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:13.613 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:13.613 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:13.613 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:13 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:13.793 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:10:13 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:10:13.505Z caller=manager.go:609 level=warn component="rule manager" group=nodes msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on(instance) group_left(nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi007\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"cd9a3408-2d15-11ef-bc9d-c7b262605968\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-06-18T02:10:13.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:13 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:13.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:13 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:13.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:13 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:13.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:13.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:13.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:13.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:13.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:13 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:13.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:13 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:13.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:13.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:13.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:13.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:13.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:13 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:13.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:13 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:13.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:13.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:13.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:13.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:13.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:13 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:13.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:13 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:13.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:13.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:13.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:13.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:13.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:13 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:13.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:13 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:13.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:13.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:13.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:13.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:13.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:13 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:13.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:13 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:13.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:13.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:13.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:13.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:13.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:13 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:13.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:13 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:13.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:13.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:13.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:13.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:13.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:13 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:13.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:13.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:13.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:13.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:13.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:13 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:13.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:13.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:13.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:13.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:13 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:13.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:13 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:14.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:14.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:14.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:14.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:14.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:14.587 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:14.587 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:14.587 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:14.587 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:14.587 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:14.587 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:14.587 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:14.587 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:14.587 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:14.587 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:14.587 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:14.587 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:14.587 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:14.587 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:14.588 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:14.588 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:14.588 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:14.588 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:14.588 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:14.588 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:14.588 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:14.588 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:14.588 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[73500]: pgmap v63: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:10:14.588 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:14.588 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:14.589 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:14.589 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:14.589 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:14.589 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:14.589 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:14.589 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:14.589 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:14.589 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:14.589 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:14.589 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:14.589 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:14.590 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:14.590 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:14.590 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:14.590 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:14.590 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:14.590 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:14.590 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:14.590 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:14.590 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:14.590 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:14.590 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:14.590 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:14.590 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:14.591 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:14.591 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:14.591 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:14.591 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[94123]: pgmap v63: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:10:14.591 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:14.591 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:14.591 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:14.591 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:14.591 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:14.591 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:14.591 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:14.591 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:14.591 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:14.591 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:14.592 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:14.592 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:14.592 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:14.592 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:14.592 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:14.592 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:14.592 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:14.592 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:14.592 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:14.592 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:14.592 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:14.592 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:14.592 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:14.592 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:14.593 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:14.593 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:14.593 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:14.593 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:14.593 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:14.593 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:14.593 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:14.593 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:14.593 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:14.593 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:14.593 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:14.593 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:14.594 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:14.594 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:14.594 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:14.594 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:14.594 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:14.594 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:14.594 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:14.594 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:14.594 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:14.594 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:14.594 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:14.594 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:14.594 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:14.595 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:14.595 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:14.595 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:14 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:14.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:14 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:14.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:14 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:14.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:14 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:14.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:14.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:14.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:14.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:14.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:14 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:14.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:14 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:14.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:14.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:14.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:14.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:14.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:14 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:14.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:14 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:14.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:14.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:14.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:14.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:14.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:14 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:14.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:14 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:14.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:14.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:14.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:14.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:14.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:14 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:14.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:14 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:14.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:14 smithi130 ceph-mon[26123]: pgmap v63: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:10:14.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:14.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:14.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:14.799 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:14.799 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:14 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:14.799 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:14 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:14.799 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:14.799 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:14.799 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:14.800 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:14.800 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:14 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:14.800 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:14 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:14.800 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:14.800 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:14.800 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:14.800 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:14.800 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:14 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:14.801 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:14.801 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:14.801 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:14.801 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:14.801 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:14 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:14.801 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:14.801 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:14.801 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:14.801 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:14 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:14.801 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:14 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:15.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:15.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:15.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:15.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:15.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:15.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:15.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:15.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:15.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:15.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:15.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:15.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:15.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:15.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:15.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:15.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:15.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:15.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:15.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:15.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:15.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:15.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:15.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:15.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:15.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:15.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:15.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:15.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:15.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:15.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:15.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:15.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:15.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:15.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:15.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:15.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:15.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:15.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:15.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:15.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:15.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:15.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:15.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:15.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:15.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:15.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:15.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:15.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:15.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:15.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:15.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:15.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:15.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:15.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:15.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:15.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:15.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:15.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:15.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:15.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:15.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:15.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:15.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:15.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:15.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:15.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:15.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:15.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:15.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:15.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:15.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:15.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:15.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:15.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:15.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:15.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:15.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:15.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:15.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:15.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:15.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:15.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:15.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:15.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:15.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:15.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:15.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:15.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:15.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:15.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:15.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:15.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:15.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:15.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:15.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:15.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:15.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:15.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:15 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:15.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:15 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:15.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:15 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:15.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:15 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:15.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:15.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:15.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:15.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:15.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:15 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:15.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:15 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:15.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:15.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:15.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:15.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:15.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:15 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:15.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:15 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:15.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:15.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:15.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:15.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:15.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:15 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:15.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:15 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:15.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:15.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:15.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:15.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:15.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:15 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:15.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:15 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:15.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:15.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:15.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:15.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:15.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:15 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:15.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:15 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:15.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:15.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:15.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:15.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:15.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:15 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:15.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:15 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:15.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:15.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:15.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:15.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:15.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:15 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:15.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:15.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:15.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:15.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:15 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:15.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:15 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:16.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:16.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:16.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:16.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:16.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:16.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:16.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:16.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:16.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:16.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:16.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:16.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:16.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:16.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:16.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:16.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:16.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:16.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:16.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:16.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:16.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:16.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:16.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:16.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:16.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:16.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:16.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:16.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:16.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:16.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:16.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:16.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:16.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[73500]: pgmap v64: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:10:16.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:16.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:16.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:16.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:16.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:16.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:16.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:16.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:16.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:16.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:16.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:16.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:16.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:16.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:16.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:16.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:16.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:16.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:16.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:16.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:16.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:16.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:16.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:16.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:16.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:16.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:16.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:16.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:16.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:16.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:16.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:16.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:16.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:16.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:16.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:16.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:16.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:16.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:16.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:16.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:16.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:16.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:16.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:16.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:16.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:16.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:16.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:16.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:16.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:16.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:16.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:16.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:16.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:16.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:16.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[94123]: pgmap v64: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:10:16.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:16.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:16.691 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:16.691 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:16.691 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:16.691 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:16.691 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:16.691 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:16.691 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:16.691 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:16.691 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:16.692 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:16.692 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:16.692 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:16.692 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:16.692 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:16.692 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:16.693 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:16.693 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:16.693 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:16.693 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:16.693 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:16 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:16.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:16 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:16.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:16 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:16.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:16.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:16.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:16.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:16.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:16 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:16.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:16 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:16.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:16.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:16.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:16.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:16.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:16 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:16.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:16 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:16.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:16.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:16.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:16.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:16.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:16 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:16.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:16 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:16.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:16.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:16.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:16.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:16.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:16 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:16.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:16 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:16.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:16.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:16.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:16.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:16.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:16 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:16.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:16 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:16.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:16 smithi130 ceph-mon[26123]: pgmap v64: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:10:16.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:16.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:16.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:16.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:16.799 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:16 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:16.799 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:16 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:16.799 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:16.799 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:16.799 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:16.799 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:16.799 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:16 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:16.799 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:16 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:16.799 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:16.799 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:16.799 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:16.800 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:16.800 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:16 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:16.800 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:16.800 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:16.800 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:16.800 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:16 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:16.800 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:16 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:17.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:17.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:17.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:17.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:17.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:17.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:17.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:17.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:17.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:17.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:17.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:17.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:17.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:17.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:17.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:17.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:17.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:17.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:17.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:17.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:17.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:17.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:17.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:17.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:17.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:17.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:17.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:17.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:17.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:17.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:17.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:17.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:17.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:17.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:17.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:17.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:17.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:17.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:17.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:17.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:17.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:17.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:17.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:17.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:17.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:17.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:17.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:17.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:17.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:17.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:17.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:17.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:17.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:17.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:17.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:17.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:17.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:17.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:17.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:17.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:17.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:17.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:17.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:17.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:17.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:17.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:17.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:17.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:17.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:17.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:17.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:17.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:17.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:17.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:17.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:17.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:17.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:17.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:17.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:17.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:17.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:17.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:17.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:17.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:17.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:17.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:17.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:17.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:17.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:17.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:17.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:17.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:17.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:17.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:17.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:17.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:17.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:17.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:17.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:17.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:17.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:17.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:17.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:17.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:17.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:17.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:17 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:17.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:17 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:17.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:17 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:17.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:17.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:17.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:17.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:17.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:17 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:17.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:17 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:17.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:17.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:17.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:17.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:17.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:17 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:17.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:17 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:17.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:17.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:17.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:17.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:17.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:17 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:17.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:17 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:17.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:17.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:17.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:17.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:17.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:17 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:17.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:17 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:17.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:17.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:17.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:17.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:17.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:17 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:17.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:17 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:17.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:17.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:17.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:17.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:17.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:17 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:17.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:17 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:17.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:17.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:17.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:17.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:17.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:17 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:17.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:17.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:17.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:17.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:17.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:17 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:17.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:17.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:17.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:17.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:17 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:17.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:17 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:18.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:10:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:10:17] "GET /metrics HTTP/1.1" 200 38176 "" "Prometheus/2.33.4" 2024-06-18T02:10:18.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:18.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:18.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:18.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:18.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:18.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:18.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:18.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:18.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:18.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:18.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:18.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:18.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:18.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:18.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:18.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:18.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:18.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:18.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:18.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:18.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:18.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:18.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:18.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:18.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:18.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:18.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:18.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[94123]: pgmap v65: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:10:18.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:18.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:18.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:18.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:18.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:18.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:18.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:18.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:18.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:18.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:18.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:18.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:18.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:18.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:18.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:18.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:18.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:18.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:18.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:18.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:18.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:18.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:18.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:18.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:18.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:18.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:18.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:18.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:18.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:18.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[73500]: pgmap v65: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:10:18.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:18.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:18.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:18.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:18.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:18.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:18.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:18.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:18.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:18.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:18.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:18.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:18.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:18.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:18.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:18.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:18.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:18.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:18.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:18.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:18.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:18.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:18.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:18.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:18.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:18.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:18.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:18.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:18.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:18.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:18.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:18.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:18.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:18.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:18.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:18.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:18.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:18.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:18.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:18.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:18.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:18.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:18.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:18.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:18.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:18.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:18.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:18.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:18.441 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:18.441 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:18.441 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:18.441 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:18 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:18.659 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:18 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:18.659 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:18 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:18.659 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:18 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:18.659 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:18.659 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:18.660 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:18.660 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:18.660 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:18 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:18.660 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:18 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:18.660 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:18.660 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:18.660 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:18.660 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:18.660 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:18 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:18.660 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:18 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:18.660 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:18.660 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:18.660 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:18.661 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:18.661 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:18 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:18.661 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:18 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:18.661 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:18.661 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:18.661 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:18.661 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:18.661 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:18 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:18.661 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:18 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:18.661 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:18 smithi130 ceph-mon[26123]: pgmap v65: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:10:18.661 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:18.661 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:18.661 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:18.661 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:18.662 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:18 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:18.662 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:18 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:18.662 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:18.662 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:18.662 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:18.662 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:18.662 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:18 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:18.662 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:18 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:18.662 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:18.662 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:18.662 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:18.662 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:18.662 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:18 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:18.663 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:18.663 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:18.663 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:18.663 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:18.663 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:18 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:18.663 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:18.663 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:18.663 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:18.663 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:18 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:18.663 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:18 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:19.043 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:10:18 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:10:18.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.7\", device_class=\"ssd\", hostname=\"smithi007\", instance=\"172.21.15.130:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.7\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"cd9a3408-2d15-11ef-bc9d-c7b262605968\", cluster_addr=\"172.21.15.7\", device_class=\"ssd\", hostname=\"smithi007\", instance=\"smithi130:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.7\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-06-18T02:10:19.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:19.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:19.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:19.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:19.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:19.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:19.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:19.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:19.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:19.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:19.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:19.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:19.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:19.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:19.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:19.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:19.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:19.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:19.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:19.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:19.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:19.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:19.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:19.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:19.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:19.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:19.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:19.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:19.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:19.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:19.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:19.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:19.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:19.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:19.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:19.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:19.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:19.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:19.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:19.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:19.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:19.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:19.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:19.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:19.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:19.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:19.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:19.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:19.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:19.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:19.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:19.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:19.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:19.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:19.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:19.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:19.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:19.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:19.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:19.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:19.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:19.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:19.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:19.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:19.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:19.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:19.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:19.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:19.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:19.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:19.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:19.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:19.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:19.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:19.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:19.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:19.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:19.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:19.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:19.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:19.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:19.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:19.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:19.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:19.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:19.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:19.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:19.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:19.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:19.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:19.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:19.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:19.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:19.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:19.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:19.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:19.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:19.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:19 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:19.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:19 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:19.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:19 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:19.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:19 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:19.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:19 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:19.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:19 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:19.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:19 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:19.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:19 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:19.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:19 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:19.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:19 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:19.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:19 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:19.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:19 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:19.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:19 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:19.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:19 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:19.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:19 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:19.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:19 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:19.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:19 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:19.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:19 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:19.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:19 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:19.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:19 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:19.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:19 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:19.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:19 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:19.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:19 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:19.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:19 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:19.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:19 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:19.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:19 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:19.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:19 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:19.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:19 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:19.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:19 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:19.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:19 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:19.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:19 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:19.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:19 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:19.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:19 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:19.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:19 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:19.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:19 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:19.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:19 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:19.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:19 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:19.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:19 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:19.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:19 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:19.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:19 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:19.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:19 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:19.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:19 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:19.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:19 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:19.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:19 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:19.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:19 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:19.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:19 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:19.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:19 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:19.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:19 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:19.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:19 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:19.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:19 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:20.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:20.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:20.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:20.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:20.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:20.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:20.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:20.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:20.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:20.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:20.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:20.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:20.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:20.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:20.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:20.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:20.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:20.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:20.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:20.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:20.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:20.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:20.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:20.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:20.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:20.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:20.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:20.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:20.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:20.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:20.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:20.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:20.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:20.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:20.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:20.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:20.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:20.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:20.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:20.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:20.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:20.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:20.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:20.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:20.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:20.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:20.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:20.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:20.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:20.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:20.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:20.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:20.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:20.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:20.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:20.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:20.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:20.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:20.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:20.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:20.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:20.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[73500]: pgmap v66: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:10:20.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:20.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:20.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:20.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:20.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:20.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:20.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:20.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:20.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:20.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:20.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:20.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:20.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:20.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:20.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:20.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:20.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:20.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:20.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:20.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:20.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:20.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:20.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:20.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:20.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[94123]: pgmap v66: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:10:20.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:20.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:20.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:20.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:20.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:20.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:20.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:20.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:20.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:20.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:20.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:20.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:20.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:20.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:20.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:20.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:20.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:20.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:20.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:20.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:20.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:20 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:20.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:20 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:20.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:20 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:20.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:20 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:20.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:20 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:20.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:20 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:20.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:20 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:20.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:20 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:20.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:20 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:20.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:20 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:20.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:20 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:20.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:20 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:20.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:20 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:20.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:20 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:20.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:20 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:20.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:20 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:20.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:20 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:20.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:20 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:20.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:20 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:20.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:20 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:20.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:20 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:20.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:20 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:20.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:20 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:20.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:20 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:20.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:20 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:20.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:20 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:20.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:20 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:20.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:20 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:20.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:20 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:20.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:20 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:20.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:20 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:20.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:20 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:20.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:20 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:20.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:20 smithi130 ceph-mon[26123]: pgmap v66: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:10:20.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:20 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:20.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:20 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:20.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:20 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:20.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:20 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:20.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:20 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:20.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:20 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:20.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:20 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:20.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:20 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:20.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:20 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:20.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:20 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:20.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:20 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:20.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:20 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:20.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:20 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:20.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:20 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:20.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:20 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:20.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:20 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:20.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:20 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:20.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:20 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:20.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:20 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:20.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:20 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:20.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:20 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:21.603 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:21.603 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:21.603 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:21.603 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:21.604 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:21.604 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:21.604 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:21.604 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:21.604 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:21.604 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:21.604 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:21.604 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:21.604 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:21.604 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:21.604 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:21.604 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:21.604 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:21.604 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:21.605 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:21.605 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:21.605 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:21.605 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:21.605 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:21.605 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:21.605 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:21.605 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:21.605 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:21.605 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:21.605 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:21.605 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:21.605 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:21.606 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:21.606 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-06-18T02:10:21.606 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2024-06-18T02:10:21.606 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[73500]: Upgrade: It appears safe to stop mon.c 2024-06-18T02:10:21.606 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:21.606 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:21.606 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:21.606 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:21.606 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:21.607 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:21.607 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:21.607 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:21.607 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:21.607 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:21.607 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:21.607 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:21.607 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:21.607 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:21.607 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:21.607 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:21.607 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:21.607 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:21.608 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:21.608 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:21.608 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:21.608 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:21.608 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:21.608 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:21.608 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:21.608 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:21.608 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:21.608 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:21.608 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:21.608 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[94123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:21.608 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:21.608 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:21.609 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:21.609 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:21.609 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:21.609 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-06-18T02:10:21.609 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2024-06-18T02:10:21.609 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[94123]: Upgrade: It appears safe to stop mon.c 2024-06-18T02:10:21.609 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:21.609 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:21.609 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:21 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:21.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:21 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:21.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:21 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:21.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:21 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:21.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:21 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:21.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:21 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:21.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:21 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:21.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:21 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:21.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:21 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:21.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:21 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:21.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:21 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:21.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:21 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:21.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:21 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:21.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:21 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:21.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:21 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:21.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:21 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:21.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:21 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:21.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:21 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:21.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:21 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:21.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:21 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:21.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:21 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:21.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:21 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:21.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:21 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:21.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:21 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:21.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:21 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:21.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:21 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:21.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:21 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:21.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:21 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:21.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:21 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:21.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:21 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:21.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:21 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:21.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:21 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:21.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:21 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:21.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:21 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-06-18T02:10:21.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:21 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2024-06-18T02:10:21.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:21 smithi130 ceph-mon[26123]: Upgrade: It appears safe to stop mon.c 2024-06-18T02:10:21.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:21 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:21.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:21 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:21.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:21 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:22.681 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:22 smithi007 ceph-mon[94123]: pgmap v67: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:10:22.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:22 smithi007 ceph-mon[94123]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:10:22.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:22 smithi007 ceph-mon[73500]: pgmap v67: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:10:22.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:22 smithi007 ceph-mon[73500]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:10:22.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:22 smithi130 ceph-mon[26123]: pgmap v67: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:10:22.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:22 smithi130 ceph-mon[26123]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:10:23.793 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:10:23 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:10:23.506Z caller=manager.go:609 level=warn component="rule manager" group=nodes msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on(instance) group_left(nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi007\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"cd9a3408-2d15-11ef-bc9d-c7b262605968\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-06-18T02:10:24.315 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:24 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:24.315 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:24 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:24.315 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:24 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:24.315 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:24 smithi007 ceph-mon[73500]: pgmap v68: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:10:24.315 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:24 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:24.315 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:24 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:24.315 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:24 smithi007 ceph-mon[94123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:24.315 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:24 smithi007 ceph-mon[94123]: pgmap v68: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:10:24.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:24 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:24.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:24 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:24.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:24 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:24.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:24 smithi130 ceph-mon[26123]: pgmap v68: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:10:25.386 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:25 smithi007 ceph-mon[73500]: Upgrade: Updating mon.c 2024-06-18T02:10:25.386 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:25 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-18T02:10:25.386 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:25 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-18T02:10:25.386 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:25 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:25.386 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:25 smithi007 ceph-mon[73500]: Deploying daemon mon.c on smithi007 2024-06-18T02:10:25.386 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:25 smithi007 ceph-mon[94123]: Upgrade: Updating mon.c 2024-06-18T02:10:25.386 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:25 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-18T02:10:25.386 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:25 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-18T02:10:25.387 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:25 smithi007 ceph-mon[94123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:25.387 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:25 smithi007 ceph-mon[94123]: Deploying daemon mon.c on smithi007 2024-06-18T02:10:25.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:25 smithi130 ceph-mon[26123]: Upgrade: Updating mon.c 2024-06-18T02:10:25.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:25 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-18T02:10:25.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:25 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-18T02:10:25.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:25 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:25.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:25 smithi130 ceph-mon[26123]: Deploying daemon mon.c on smithi007 2024-06-18T02:10:26.352 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:26 smithi130 ceph-mon[26123]: pgmap v69: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:10:26.354 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:26 smithi007 ceph-mon[73500]: pgmap v69: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:10:26.355 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:26 smithi007 ceph-mon[94123]: pgmap v69: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:10:26.670 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:26 smithi007 systemd[1]: Stopping Ceph mon.c for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:10:26.931 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:26 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-c[94119]: 2024-06-18T02:10:26.669+0000 7f96a496d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-06-18T02:10:26.931 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:26 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-c[94119]: 2024-06-18T02:10:26.669+0000 7f96a496d640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-06-18T02:10:26.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:26 smithi007 podman[99574]: 2024-06-18 02:10:26.700870089 +0000 UTC m=+0.161008278 container died 273d99b73b247dff8ea33340d2391721b6ff746335085517976b9c17f427d34a (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-c, io.buildah.version=1.36.0, RELEASE=squid-3781e3a, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240612, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-06-18T02:10:27.320 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:27 smithi007 podman[99574]: 2024-06-18 02:10:27.070109379 +0000 UTC m=+0.530247570 container cleanup 273d99b73b247dff8ea33340d2391721b6ff746335085517976b9c17f427d34a (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-c, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-3781e3a, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240612) 2024-06-18T02:10:27.320 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:27 smithi007 bash[99574]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-c 2024-06-18T02:10:27.662 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:27 smithi007 podman[99586]: 2024-06-18 02:10:27.32150317 +0000 UTC m=+0.619016538 container remove 273d99b73b247dff8ea33340d2391721b6ff746335085517976b9c17f427d34a (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-c, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240612, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, RELEASE=squid-3781e3a) 2024-06-18T02:10:27.662 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:27 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mon.c.service: Deactivated successfully. 2024-06-18T02:10:27.662 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:27 smithi007 systemd[1]: Stopped Ceph mon.c for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:10:27.662 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:27 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mon.c.service: Consumed 1.362s CPU time. 2024-06-18T02:10:27.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:27 smithi007 systemd[1]: Starting Ceph mon.c for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:10:27.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:27 smithi007 podman[99716]: 2024-06-18 02:10:27.864259929 +0000 UTC m=+0.098421010 container create 39418356156e8a41c4d75ad20e8fe50303fa00ea6f1c4c7d9a220d8de30e13bf (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-c, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, RELEASE=squid-3781e3a, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240612, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0) 2024-06-18T02:10:27.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:27 smithi007 podman[99716]: 2024-06-18 02:10:27.784341222 +0000 UTC m=+0.018502320 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:10:28.205 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:10:27 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:10:27] "GET /metrics HTTP/1.1" 200 38244 "" "Prometheus/2.33.4" 2024-06-18T02:10:28.335 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 podman[99716]: 2024-06-18 02:10:28.075215548 +0000 UTC m=+0.309376644 container init 39418356156e8a41c4d75ad20e8fe50303fa00ea6f1c4c7d9a220d8de30e13bf (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-c, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.build-date=20240612, CEPH_POINT_RELEASE=, RELEASE=squid-3781e3a, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-06-18T02:10:28.335 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 podman[99716]: 2024-06-18 02:10:28.078517943 +0000 UTC m=+0.312679033 container start 39418356156e8a41c4d75ad20e8fe50303fa00ea6f1c4c7d9a220d8de30e13bf (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-c, RELEASE=squid-3781e3a, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240612) 2024-06-18T02:10:28.335 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: set uid:gid to 167:167 (ceph:ceph) 2024-06-18T02:10:28.335 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc), process ceph-mon, pid 2 2024-06-18T02:10:28.335 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: pidfile_write: ignore empty --pid-file 2024-06-18T02:10:28.336 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: load: jerasure load: lrc 2024-06-18T02:10:28.336 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: RocksDB version: 7.9.2 2024-06-18T02:10:28.336 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Git sha 0 2024-06-18T02:10:28.336 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Compile date 2024-06-17 15:21:02 2024-06-18T02:10:28.336 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: DB SUMMARY 2024-06-18T02:10:28.336 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: DB Session ID: LXQDYLMNLT7AHVTTT5DG 2024-06-18T02:10:28.336 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: CURRENT file: CURRENT 2024-06-18T02:10:28.336 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: IDENTITY file: IDENTITY 2024-06-18T02:10:28.336 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: MANIFEST file: MANIFEST-000044 size: 530 Bytes 2024-06-18T02:10:28.336 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 1, files: 000049.sst 2024-06-18T02:10:28.336 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000047.log size: 1417359 ; 2024-06-18T02:10:28.336 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.error_if_exists: 0 2024-06-18T02:10:28.337 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.create_if_missing: 0 2024-06-18T02:10:28.337 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.paranoid_checks: 1 2024-06-18T02:10:28.337 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.flush_verify_memtable_count: 1 2024-06-18T02:10:28.337 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-06-18T02:10:28.337 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-06-18T02:10:28.337 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.env: 0x558733392740 2024-06-18T02:10:28.337 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.fs: PosixFileSystem 2024-06-18T02:10:28.337 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.info_log: 0x558733bf1000 2024-06-18T02:10:28.337 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.max_file_opening_threads: 16 2024-06-18T02:10:28.337 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.statistics: (nil) 2024-06-18T02:10:28.338 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.use_fsync: 0 2024-06-18T02:10:28.339 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.max_log_file_size: 0 2024-06-18T02:10:28.339 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-06-18T02:10:28.339 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.log_file_time_to_roll: 0 2024-06-18T02:10:28.339 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.keep_log_file_num: 1000 2024-06-18T02:10:28.339 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.recycle_log_file_num: 0 2024-06-18T02:10:28.339 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.allow_fallocate: 1 2024-06-18T02:10:28.339 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.allow_mmap_reads: 0 2024-06-18T02:10:28.339 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.allow_mmap_writes: 0 2024-06-18T02:10:28.339 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.use_direct_reads: 0 2024-06-18T02:10:28.339 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-06-18T02:10:28.339 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.create_missing_column_families: 0 2024-06-18T02:10:28.339 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.db_log_dir: 2024-06-18T02:10:28.339 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.wal_dir: 2024-06-18T02:10:28.339 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.table_cache_numshardbits: 6 2024-06-18T02:10:28.340 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.WAL_ttl_seconds: 0 2024-06-18T02:10:28.340 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.WAL_size_limit_MB: 0 2024-06-18T02:10:28.340 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-06-18T02:10:28.340 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-06-18T02:10:28.340 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.is_fd_close_on_exec: 1 2024-06-18T02:10:28.340 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.advise_random_on_open: 1 2024-06-18T02:10:28.340 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.db_write_buffer_size: 0 2024-06-18T02:10:28.340 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.write_buffer_manager: 0x558733c001e0 2024-06-18T02:10:28.340 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-06-18T02:10:28.340 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-06-18T02:10:28.340 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.use_adaptive_mutex: 0 2024-06-18T02:10:28.340 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.rate_limiter: (nil) 2024-06-18T02:10:28.340 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-06-18T02:10:28.340 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.wal_recovery_mode: 2 2024-06-18T02:10:28.340 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.enable_thread_tracking: 0 2024-06-18T02:10:28.340 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.enable_pipelined_write: 0 2024-06-18T02:10:28.341 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.unordered_write: 0 2024-06-18T02:10:28.341 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-06-18T02:10:28.341 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-06-18T02:10:28.341 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-06-18T02:10:28.341 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-06-18T02:10:28.341 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.row_cache: None 2024-06-18T02:10:28.341 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.wal_filter: None 2024-06-18T02:10:28.341 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-06-18T02:10:28.341 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.allow_ingest_behind: 0 2024-06-18T02:10:28.341 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.two_write_queues: 0 2024-06-18T02:10:28.341 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.manual_wal_flush: 0 2024-06-18T02:10:28.341 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.wal_compression: 0 2024-06-18T02:10:28.341 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.atomic_flush: 0 2024-06-18T02:10:28.341 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-06-18T02:10:28.342 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.persist_stats_to_disk: 0 2024-06-18T02:10:28.342 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.write_dbid_to_manifest: 0 2024-06-18T02:10:28.342 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.log_readahead_size: 0 2024-06-18T02:10:28.342 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-06-18T02:10:28.342 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.best_efforts_recovery: 0 2024-06-18T02:10:28.342 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-06-18T02:10:28.342 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-06-18T02:10:28.342 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.allow_data_in_errors: 0 2024-06-18T02:10:28.342 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.db_host_id: __hostname__ 2024-06-18T02:10:28.342 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.enforce_single_del_contracts: true 2024-06-18T02:10:28.342 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.max_background_jobs: 2 2024-06-18T02:10:28.342 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.max_background_compactions: -1 2024-06-18T02:10:28.343 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.max_subcompactions: 1 2024-06-18T02:10:28.343 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-06-18T02:10:28.343 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-06-18T02:10:28.343 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.delayed_write_rate : 16777216 2024-06-18T02:10:28.343 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.max_total_wal_size: 0 2024-06-18T02:10:28.343 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-06-18T02:10:28.343 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.stats_dump_period_sec: 600 2024-06-18T02:10:28.343 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.stats_persist_period_sec: 600 2024-06-18T02:10:28.343 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-06-18T02:10:28.343 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.max_open_files: -1 2024-06-18T02:10:28.343 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.bytes_per_sync: 0 2024-06-18T02:10:28.343 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.wal_bytes_per_sync: 0 2024-06-18T02:10:28.343 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.strict_bytes_per_sync: 0 2024-06-18T02:10:28.343 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.compaction_readahead_size: 0 2024-06-18T02:10:28.343 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.max_background_flushes: -1 2024-06-18T02:10:28.344 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Compression algorithms supported: 2024-06-18T02:10:28.344 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: kZSTD supported: 0 2024-06-18T02:10:28.344 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: kXpressCompression supported: 0 2024-06-18T02:10:28.344 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: kBZip2Compression supported: 0 2024-06-18T02:10:28.344 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-06-18T02:10:28.344 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: kLZ4Compression supported: 1 2024-06-18T02:10:28.344 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: kZlibCompression supported: 1 2024-06-18T02:10:28.344 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: kLZ4HCCompression supported: 1 2024-06-18T02:10:28.344 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: kSnappyCompression supported: 1 2024-06-18T02:10:28.344 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Fast CRC32 supported: Supported on x86 2024-06-18T02:10:28.344 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: DMutex implementation: pthread_mutex_t 2024-06-18T02:10:28.344 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000044 2024-06-18T02:10:28.344 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-06-18T02:10:28.345 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-06-18T02:10:28.345 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.merge_operator: 2024-06-18T02:10:28.345 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.compaction_filter: None 2024-06-18T02:10:28.345 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.compaction_filter_factory: None 2024-06-18T02:10:28.345 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.sst_partitioner_factory: None 2024-06-18T02:10:28.345 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.memtable_factory: SkipListFactory 2024-06-18T02:10:28.345 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.table_factory: BlockBasedTable 2024-06-18T02:10:28.345 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x558733bf0d00) 2024-06-18T02:10:28.345 INFO:journalctl@ceph.mon.c.smithi007.stdout: cache_index_and_filter_blocks: 1 2024-06-18T02:10:28.345 INFO:journalctl@ceph.mon.c.smithi007.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-06-18T02:10:28.345 INFO:journalctl@ceph.mon.c.smithi007.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-06-18T02:10:28.345 INFO:journalctl@ceph.mon.c.smithi007.stdout: pin_top_level_index_and_filter: 1 2024-06-18T02:10:28.345 INFO:journalctl@ceph.mon.c.smithi007.stdout: index_type: 0 2024-06-18T02:10:28.346 INFO:journalctl@ceph.mon.c.smithi007.stdout: data_block_index_type: 0 2024-06-18T02:10:28.346 INFO:journalctl@ceph.mon.c.smithi007.stdout: index_shortening: 1 2024-06-18T02:10:28.346 INFO:journalctl@ceph.mon.c.smithi007.stdout: data_block_hash_table_util_ratio: 0.750000 2024-06-18T02:10:28.346 INFO:journalctl@ceph.mon.c.smithi007.stdout: checksum: 4 2024-06-18T02:10:28.346 INFO:journalctl@ceph.mon.c.smithi007.stdout: no_block_cache: 0 2024-06-18T02:10:28.346 INFO:journalctl@ceph.mon.c.smithi007.stdout: block_cache: 0x558733be7090 2024-06-18T02:10:28.346 INFO:journalctl@ceph.mon.c.smithi007.stdout: block_cache_name: BinnedLRUCache 2024-06-18T02:10:28.346 INFO:journalctl@ceph.mon.c.smithi007.stdout: block_cache_options: 2024-06-18T02:10:28.346 INFO:journalctl@ceph.mon.c.smithi007.stdout: capacity : 536870912 2024-06-18T02:10:28.346 INFO:journalctl@ceph.mon.c.smithi007.stdout: num_shard_bits : 4 2024-06-18T02:10:28.346 INFO:journalctl@ceph.mon.c.smithi007.stdout: strict_capacity_limit : 0 2024-06-18T02:10:28.346 INFO:journalctl@ceph.mon.c.smithi007.stdout: high_pri_pool_ratio: 0.000 2024-06-18T02:10:28.346 INFO:journalctl@ceph.mon.c.smithi007.stdout: block_cache_compressed: (nil) 2024-06-18T02:10:28.347 INFO:journalctl@ceph.mon.c.smithi007.stdout: persistent_cache: (nil) 2024-06-18T02:10:28.347 INFO:journalctl@ceph.mon.c.smithi007.stdout: block_size: 4096 2024-06-18T02:10:28.347 INFO:journalctl@ceph.mon.c.smithi007.stdout: block_size_deviation: 10 2024-06-18T02:10:28.347 INFO:journalctl@ceph.mon.c.smithi007.stdout: block_restart_interval: 16 2024-06-18T02:10:28.347 INFO:journalctl@ceph.mon.c.smithi007.stdout: index_block_restart_interval: 1 2024-06-18T02:10:28.347 INFO:journalctl@ceph.mon.c.smithi007.stdout: metadata_block_size: 4096 2024-06-18T02:10:28.347 INFO:journalctl@ceph.mon.c.smithi007.stdout: partition_filters: 0 2024-06-18T02:10:28.347 INFO:journalctl@ceph.mon.c.smithi007.stdout: use_delta_encoding: 1 2024-06-18T02:10:28.347 INFO:journalctl@ceph.mon.c.smithi007.stdout: filter_policy: bloomfilter 2024-06-18T02:10:28.347 INFO:journalctl@ceph.mon.c.smithi007.stdout: whole_key_filtering: 1 2024-06-18T02:10:28.347 INFO:journalctl@ceph.mon.c.smithi007.stdout: verify_compression: 0 2024-06-18T02:10:28.347 INFO:journalctl@ceph.mon.c.smithi007.stdout: read_amp_bytes_per_bit: 0 2024-06-18T02:10:28.347 INFO:journalctl@ceph.mon.c.smithi007.stdout: format_version: 5 2024-06-18T02:10:28.347 INFO:journalctl@ceph.mon.c.smithi007.stdout: enable_index_compression: 1 2024-06-18T02:10:28.347 INFO:journalctl@ceph.mon.c.smithi007.stdout: block_align: 0 2024-06-18T02:10:28.348 INFO:journalctl@ceph.mon.c.smithi007.stdout: max_auto_readahead_size: 262144 2024-06-18T02:10:28.348 INFO:journalctl@ceph.mon.c.smithi007.stdout: prepopulate_block_cache: 0 2024-06-18T02:10:28.348 INFO:journalctl@ceph.mon.c.smithi007.stdout: initial_auto_readahead_size: 8192 2024-06-18T02:10:28.348 INFO:journalctl@ceph.mon.c.smithi007.stdout: num_file_reads_for_auto_readahead: 2 2024-06-18T02:10:28.348 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.write_buffer_size: 33554432 2024-06-18T02:10:28.348 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.max_write_buffer_number: 2 2024-06-18T02:10:28.348 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.compression: NoCompression 2024-06-18T02:10:28.348 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.bottommost_compression: Disabled 2024-06-18T02:10:28.348 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.prefix_extractor: nullptr 2024-06-18T02:10:28.348 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-06-18T02:10:28.348 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.num_levels: 7 2024-06-18T02:10:28.348 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-06-18T02:10:28.348 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-06-18T02:10:28.349 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-06-18T02:10:28.349 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-06-18T02:10:28.349 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-06-18T02:10:28.349 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-06-18T02:10:28.349 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-06-18T02:10:28.349 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-06-18T02:10:28.349 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-06-18T02:10:28.349 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-06-18T02:10:28.349 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-06-18T02:10:28.349 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-06-18T02:10:28.349 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.compression_opts.window_bits: -14 2024-06-18T02:10:28.349 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.compression_opts.level: 32767 2024-06-18T02:10:28.349 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.compression_opts.strategy: 0 2024-06-18T02:10:28.349 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-06-18T02:10:28.349 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-06-18T02:10:28.350 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-06-18T02:10:28.350 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-06-18T02:10:28.350 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.compression_opts.enabled: false 2024-06-18T02:10:28.350 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-06-18T02:10:28.350 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-06-18T02:10:28.350 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-06-18T02:10:28.350 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-06-18T02:10:28.350 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.target_file_size_base: 67108864 2024-06-18T02:10:28.350 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.target_file_size_multiplier: 1 2024-06-18T02:10:28.350 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-06-18T02:10:28.350 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-06-18T02:10:28.350 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-06-18T02:10:28.351 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-06-18T02:10:28.351 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-06-18T02:10:28.351 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-06-18T02:10:28.351 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-06-18T02:10:28.351 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-06-18T02:10:28.351 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-06-18T02:10:28.351 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-06-18T02:10:28.351 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-06-18T02:10:28.351 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-06-18T02:10:28.351 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-06-18T02:10:28.351 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.arena_block_size: 1048576 2024-06-18T02:10:28.351 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-06-18T02:10:28.351 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-06-18T02:10:28.351 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.disable_auto_compactions: 0 2024-06-18T02:10:28.352 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-06-18T02:10:28.352 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-06-18T02:10:28.352 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-06-18T02:10:28.352 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-06-18T02:10:28.352 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-06-18T02:10:28.352 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-06-18T02:10:28.352 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-06-18T02:10:28.352 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-06-18T02:10:28.352 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-06-18T02:10:28.352 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-06-18T02:10:28.352 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.table_properties_collectors: 2024-06-18T02:10:28.352 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.inplace_update_support: 0 2024-06-18T02:10:28.352 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.inplace_update_num_locks: 10000 2024-06-18T02:10:28.353 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-06-18T02:10:28.353 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-06-18T02:10:28.353 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.memtable_huge_page_size: 0 2024-06-18T02:10:28.353 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.bloom_locality: 0 2024-06-18T02:10:28.353 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.max_successive_merges: 0 2024-06-18T02:10:28.353 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.optimize_filters_for_hits: 0 2024-06-18T02:10:28.353 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.paranoid_file_checks: 0 2024-06-18T02:10:28.353 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.force_consistency_checks: 1 2024-06-18T02:10:28.353 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.report_bg_io_stats: 0 2024-06-18T02:10:28.353 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.ttl: 2592000 2024-06-18T02:10:28.353 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.periodic_compaction_seconds: 0 2024-06-18T02:10:28.353 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-06-18T02:10:28.353 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-06-18T02:10:28.353 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.enable_blob_files: false 2024-06-18T02:10:28.354 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.min_blob_size: 0 2024-06-18T02:10:28.354 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.blob_file_size: 268435456 2024-06-18T02:10:28.354 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.blob_compression_type: NoCompression 2024-06-18T02:10:28.354 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.enable_blob_garbage_collection: false 2024-06-18T02:10:28.354 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-06-18T02:10:28.354 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-06-18T02:10:28.354 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-06-18T02:10:28.354 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.blob_file_starting_level: 0 2024-06-18T02:10:28.354 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-06-18T02:10:28.354 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-06-18T02:10:28.354 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000044 succeeded,manifest_file_number is 44, next_file_number is 51, last_sequence is 25909, log_number is 47,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 47 2024-06-18T02:10:28.354 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 47 2024-06-18T02:10:28.354 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 831fd904-c59d-49e1-b699-49ed83c61de1 2024-06-18T02:10:28.355 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: EVENT_LOG_v1 {"time_micros": 1718676628106217, "job": 1, "event": "recovery_started", "wal_files": [47]} 2024-06-18T02:10:28.355 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #47 mode 2 2024-06-18T02:10:28.355 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: EVENT_LOG_v1 {"time_micros": 1718676628113496, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 52, "file_size": 888696, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 25914, "largest_seqno": 27308, "table_properties": {"data_size": 883652, "index_size": 2109, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1925, "raw_key_size": 18591, "raw_average_key_size": 24, "raw_value_size": 871129, "raw_average_value_size": 1140, "num_data_blocks": 86, "num_entries": 764, "num_filter_entries": 764, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1718676628, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "831fd904-c59d-49e1-b699-49ed83c61de1", "db_session_id": "LXQDYLMNLT7AHVTTT5DG", "orig_file_number": 52, "seqno_to_time_mapping": "N/A"}} 2024-06-18T02:10:28.355 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: EVENT_LOG_v1 {"time_micros": 1718676628113625, "job": 1, "event": "recovery_finished"} 2024-06-18T02:10:28.355 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: [db/version_set.cc:5047] Creating manifest 54 2024-06-18T02:10:28.355 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-06-18T02:10:28.355 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000047.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-06-18T02:10:28.355 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x558733c14e00 2024-06-18T02:10:28.355 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: DB pointer 0x558733d0a000 2024-06-18T02:10:28.355 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-06-18T02:10:28.355 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-06-18T02:10:28.355 INFO:journalctl@ceph.mon.c.smithi007.stdout: ** DB Stats ** 2024-06-18T02:10:28.355 INFO:journalctl@ceph.mon.c.smithi007.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-18T02:10:28.355 INFO:journalctl@ceph.mon.c.smithi007.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-06-18T02:10:28.356 INFO:journalctl@ceph.mon.c.smithi007.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-18T02:10:28.356 INFO:journalctl@ceph.mon.c.smithi007.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-18T02:10:28.356 INFO:journalctl@ceph.mon.c.smithi007.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-06-18T02:10:28.356 INFO:journalctl@ceph.mon.c.smithi007.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-18T02:10:28.356 INFO:journalctl@ceph.mon.c.smithi007.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-18T02:10:28.356 INFO:journalctl@ceph.mon.c.smithi007.stdout: 2024-06-18T02:10:28.356 INFO:journalctl@ceph.mon.c.smithi007.stdout: ** Compaction Stats [default] ** 2024-06-18T02:10:28.356 INFO:journalctl@ceph.mon.c.smithi007.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-06-18T02:10:28.356 INFO:journalctl@ceph.mon.c.smithi007.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-06-18T02:10:28.356 INFO:journalctl@ceph.mon.c.smithi007.stdout: L0 1/0 867.87 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 271.7 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-06-18T02:10:28.356 INFO:journalctl@ceph.mon.c.smithi007.stdout: L6 1/0 10.32 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-06-18T02:10:28.356 INFO:journalctl@ceph.mon.c.smithi007.stdout: Sum 2/0 11.17 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 271.7 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-06-18T02:10:28.356 INFO:journalctl@ceph.mon.c.smithi007.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 271.7 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-06-18T02:10:28.356 INFO:journalctl@ceph.mon.c.smithi007.stdout: 2024-06-18T02:10:28.356 INFO:journalctl@ceph.mon.c.smithi007.stdout: ** Compaction Stats [default] ** 2024-06-18T02:10:28.356 INFO:journalctl@ceph.mon.c.smithi007.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-06-18T02:10:28.357 INFO:journalctl@ceph.mon.c.smithi007.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-06-18T02:10:28.357 INFO:journalctl@ceph.mon.c.smithi007.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 271.7 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-06-18T02:10:28.357 INFO:journalctl@ceph.mon.c.smithi007.stdout: 2024-06-18T02:10:28.357 INFO:journalctl@ceph.mon.c.smithi007.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-06-18T02:10:28.357 INFO:journalctl@ceph.mon.c.smithi007.stdout: 2024-06-18T02:10:28.357 INFO:journalctl@ceph.mon.c.smithi007.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-18T02:10:28.357 INFO:journalctl@ceph.mon.c.smithi007.stdout: Flush(GB): cumulative 0.001, interval 0.001 2024-06-18T02:10:28.357 INFO:journalctl@ceph.mon.c.smithi007.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-06-18T02:10:28.357 INFO:journalctl@ceph.mon.c.smithi007.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-06-18T02:10:28.357 INFO:journalctl@ceph.mon.c.smithi007.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-06-18T02:10:28.357 INFO:journalctl@ceph.mon.c.smithi007.stdout: AddFile(Keys): cumulative 0, interval 0 2024-06-18T02:10:28.357 INFO:journalctl@ceph.mon.c.smithi007.stdout: Cumulative compaction: 0.00 GB write, 84.08 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-18T02:10:28.357 INFO:journalctl@ceph.mon.c.smithi007.stdout: Interval compaction: 0.00 GB write, 84.08 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-18T02:10:28.357 INFO:journalctl@ceph.mon.c.smithi007.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-06-18T02:10:28.358 INFO:journalctl@ceph.mon.c.smithi007.stdout: Block cache BinnedLRUCache@0x558733be7090#2 capacity: 512.00 MB usage: 4.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-06-18T02:10:28.358 INFO:journalctl@ceph.mon.c.smithi007.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,2.03 KB,0.00038743%) IndexBlock(1,2.33 KB,0.000444055%) Misc(1,0.00 KB,0%) 2024-06-18T02:10:28.358 INFO:journalctl@ceph.mon.c.smithi007.stdout: 2024-06-18T02:10:28.358 INFO:journalctl@ceph.mon.c.smithi007.stdout: ** File Read Latency Histogram By Level [default] ** 2024-06-18T02:10:28.358 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: starting mon.c rank 1 at public addrs [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] at bind addrs [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 2024-06-18T02:10:28.358 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: mon.c@-1(???) e3 preinit fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 2024-06-18T02:10:28.358 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: mon.c@-1(???).mds e1 new map 2024-06-18T02:10:28.358 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: mon.c@-1(???).mds e1 print_map 2024-06-18T02:10:28.358 INFO:journalctl@ceph.mon.c.smithi007.stdout: e1 2024-06-18T02:10:28.358 INFO:journalctl@ceph.mon.c.smithi007.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-06-18T02:10:28.358 INFO:journalctl@ceph.mon.c.smithi007.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-18T02:10:28.358 INFO:journalctl@ceph.mon.c.smithi007.stdout: legacy client fscid: -1 2024-06-18T02:10:28.358 INFO:journalctl@ceph.mon.c.smithi007.stdout: 2024-06-18T02:10:28.358 INFO:journalctl@ceph.mon.c.smithi007.stdout: No filesystems configured 2024-06-18T02:10:28.359 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: mon.c@-1(???).osd e115 crush map has features 3314933000854323200, adjusting msgr requires 2024-06-18T02:10:28.359 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: mon.c@-1(???).osd e115 crush map has features 432629239337189376, adjusting msgr requires 2024-06-18T02:10:28.359 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: mon.c@-1(???).osd e115 crush map has features 432629239337189376, adjusting msgr requires 2024-06-18T02:10:28.359 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: mon.c@-1(???).osd e115 crush map has features 432629239337189376, adjusting msgr requires 2024-06-18T02:10:28.359 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: mon.c@-1(???).paxosservice(auth 1..26) refresh upgraded, format 0 -> 3 2024-06-18T02:10:28.359 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 bash[99716]: 39418356156e8a41c4d75ad20e8fe50303fa00ea6f1c4c7d9a220d8de30e13bf 2024-06-18T02:10:28.359 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 systemd[1]: Started Ceph mon.c for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:10:28.359 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:10:28.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:28 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:10:28.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:28 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:10:28.905 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:10:28 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:10:28.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.7\", device_class=\"ssd\", hostname=\"smithi007\", instance=\"172.21.15.130:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.7\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"cd9a3408-2d15-11ef-bc9d-c7b262605968\", cluster_addr=\"172.21.15.7\", device_class=\"ssd\", hostname=\"smithi007\", instance=\"smithi130:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.7\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-06-18T02:10:29.359 INFO:teuthology.orchestra.run.smithi007.stdout:true 2024-06-18T02:10:29.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: pgmap v70: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:10:29.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: mon.c calling monitor election 2024-06-18T02:10:29.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: mon.a calling monitor election 2024-06-18T02:10:29.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-06-18T02:10:29.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: monmap epoch 3 2024-06-18T02:10:29.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 2024-06-18T02:10:29.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: last_changed 2024-06-18T01:57:18.881740+0000 2024-06-18T02:10:29.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: created 2024-06-18T01:55:37.939231+0000 2024-06-18T02:10:29.622 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: min_mon_release 17 (quincy) 2024-06-18T02:10:29.622 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: election_strategy: 1 2024-06-18T02:10:29.622 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-06-18T02:10:29.622 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: 1: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-06-18T02:10:29.622 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: 2: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-06-18T02:10:29.622 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: fsmap 2024-06-18T02:10:29.622 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: osdmap e115: 8 total, 8 up, 8 in 2024-06-18T02:10:29.622 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: mgrmap e47: x(active, since 107s), standbys: y 2024-06-18T02:10:29.622 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: overall HEALTH_OK 2024-06-18T02:10:29.622 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:29.622 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:29.622 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:29.622 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:29.623 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:29.623 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:29.623 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:29.623 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:29.623 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:29.623 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:29.623 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:29.623 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:29.623 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:29.623 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:29.623 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:29.623 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:29.624 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:29.624 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:29.624 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:29.624 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:29.624 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:29.624 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:29.625 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:29.625 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:29.626 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:29.626 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:29.626 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:29.626 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:29.626 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:29.626 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:29.626 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:29.626 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:29.626 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:29.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:29.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:29.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:29.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:29.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:29.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:29.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:29.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:29.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:29.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:29.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:29.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:29.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:29.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:29.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:29.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:29.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:29.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:29.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:29.628 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: pgmap v70: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:10:29.629 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: mon.c calling monitor election 2024-06-18T02:10:29.629 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: mon.a calling monitor election 2024-06-18T02:10:29.629 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-06-18T02:10:29.629 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: monmap epoch 3 2024-06-18T02:10:29.629 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 2024-06-18T02:10:29.629 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: last_changed 2024-06-18T01:57:18.881740+0000 2024-06-18T02:10:29.629 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: created 2024-06-18T01:55:37.939231+0000 2024-06-18T02:10:29.629 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: min_mon_release 17 (quincy) 2024-06-18T02:10:29.629 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: election_strategy: 1 2024-06-18T02:10:29.629 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-06-18T02:10:29.629 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: 1: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-06-18T02:10:29.630 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: 2: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-06-18T02:10:29.630 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: fsmap 2024-06-18T02:10:29.630 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: osdmap e115: 8 total, 8 up, 8 in 2024-06-18T02:10:29.630 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: mgrmap e47: x(active, since 107s), standbys: y 2024-06-18T02:10:29.630 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: overall HEALTH_OK 2024-06-18T02:10:29.630 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:29.630 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:29.630 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:29.630 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:29.630 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:29.630 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:29.631 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:29.631 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:29.631 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:29.631 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:29.631 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:29.631 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:29.631 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:29.631 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:29.631 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:29.631 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:29.631 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:29.632 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:29.632 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:29.632 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:29.632 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:29.632 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:29.632 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:29.632 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:29.632 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:29.632 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:29.632 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:29.632 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:29.632 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:29.632 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:29.633 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:29.633 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:29.633 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:29.633 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:29.633 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:29.633 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:29.633 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:29.633 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:29.633 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:29.633 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:29.633 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:29.633 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:29.633 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:29.633 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:29.634 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:29.634 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:29.634 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:29.634 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:29.634 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:29.634 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:29.634 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:29.634 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:29 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:29.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: pgmap v70: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:10:29.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: mon.c calling monitor election 2024-06-18T02:10:29.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: mon.a calling monitor election 2024-06-18T02:10:29.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-06-18T02:10:29.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: monmap epoch 3 2024-06-18T02:10:29.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 2024-06-18T02:10:29.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: last_changed 2024-06-18T01:57:18.881740+0000 2024-06-18T02:10:29.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: created 2024-06-18T01:55:37.939231+0000 2024-06-18T02:10:29.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: min_mon_release 17 (quincy) 2024-06-18T02:10:29.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: election_strategy: 1 2024-06-18T02:10:29.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-06-18T02:10:29.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: 1: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-06-18T02:10:29.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: 2: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-06-18T02:10:29.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: fsmap 2024-06-18T02:10:29.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: osdmap e115: 8 total, 8 up, 8 in 2024-06-18T02:10:29.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: mgrmap e47: x(active, since 107s), standbys: y 2024-06-18T02:10:29.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: overall HEALTH_OK 2024-06-18T02:10:29.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:29.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:29.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:29.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:29.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:29.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:29.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:29.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:29.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:29.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:29.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:29.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:29.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:29.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:29.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:29.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:29.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:29.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:29.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:29.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:29.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:29.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:29.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:29.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:29.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:29.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:29.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:29.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:29.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:29.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:29.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:29.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:29.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:29.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:29.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:29.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:29.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:29.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:29.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:29.799 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:29.799 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:29.799 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:29.799 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:29.799 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:29.799 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:29.799 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:29.799 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:29.799 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:29.799 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:29.799 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:29.799 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:29.799 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:29 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:30.110 INFO:teuthology.orchestra.run.smithi007.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-18T02:10:30.110 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi007 smithi007 running 7s ago 13m - - 2024-06-18T02:10:30.110 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi130 smithi130 running 0s ago 13m - - 2024-06-18T02:10:30.111 INFO:teuthology.orchestra.run.smithi007.stdout:alertmanager.a smithi007 *:9093,9094 running (3m) 7s ago 8m 24.0M - 0.23.0 ba2b418f427c 5994e8525c64 2024-06-18T02:10:30.111 INFO:teuthology.orchestra.run.smithi007.stdout:grafana.a smithi130 *:3000 running (3m) 0s ago 8m 48.6M - 8.3.5 dad864ee21e9 70ba81d97c8e 2024-06-18T02:10:30.111 INFO:teuthology.orchestra.run.smithi007.stdout:iscsi.foo.smithi007.xvdrwd smithi007 running (88s) 7s ago 6m 46.7M - 3.5 e1d6a67b021e 94121ad2702c 2024-06-18T02:10:30.111 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.x smithi130 *:8443,9283,8765 running (2m) 0s ago 12m 507M - 19.0.0-3124-g3781e3a5 af93c036e016 01017e37bdbe 2024-06-18T02:10:30.111 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.y smithi007 *:8443,9283,8765 running (44s) 7s ago 14m 440M - 19.0.0-3124-g3781e3a5 af93c036e016 2141e131e896 2024-06-18T02:10:30.111 INFO:teuthology.orchestra.run.smithi007.stdout:mon.a smithi007 running (115s) 7s ago 14m 56.4M 2048M 19.0.0-3124-g3781e3a5 af93c036e016 670d7777ae9b 2024-06-18T02:10:30.111 INFO:teuthology.orchestra.run.smithi007.stdout:mon.b smithi130 running (13m) 0s ago 13m 64.7M 2048M 17.2.0 e1d6a67b021e a0b38a9a595f 2024-06-18T02:10:30.111 INFO:teuthology.orchestra.run.smithi007.stdout:mon.c smithi007 starting - - - 2048M 2024-06-18T02:10:30.111 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.a smithi007 *:9100 running (3m) 7s ago 8m 18.5M - 1.3.1 1dbe0e931976 8128e558f099 2024-06-18T02:10:30.111 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.b smithi130 *:9100 running (3m) 0s ago 8m 17.9M - 1.3.1 1dbe0e931976 bab93b43cf16 2024-06-18T02:10:30.111 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0 smithi007 running (12m) 7s ago 12m 54.9M 4096M 17.2.0 e1d6a67b021e 1ef6e23afd55 2024-06-18T02:10:30.111 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1 smithi007 running (12m) 7s ago 12m 56.4M 4096M 17.2.0 e1d6a67b021e a967706523cb 2024-06-18T02:10:30.112 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2 smithi007 running (11m) 7s ago 11m 50.9M 4096M 17.2.0 e1d6a67b021e 2c1b76bd0876 2024-06-18T02:10:30.112 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3 smithi007 running (11m) 7s ago 11m 54.8M 4096M 17.2.0 e1d6a67b021e 8b91b2a07564 2024-06-18T02:10:30.112 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4 smithi130 running (10m) 0s ago 10m 56.3M 4096M 17.2.0 e1d6a67b021e c428dccffdf0 2024-06-18T02:10:30.112 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5 smithi130 running (10m) 0s ago 10m 54.5M 4096M 17.2.0 e1d6a67b021e f645d7f12378 2024-06-18T02:10:30.112 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6 smithi130 running (10m) 0s ago 10m 50.7M 4096M 17.2.0 e1d6a67b021e c7af86c14959 2024-06-18T02:10:30.112 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7 smithi130 running (9m) 0s ago 9m 54.1M 4096M 17.2.0 e1d6a67b021e 3688af8b2c46 2024-06-18T02:10:30.112 INFO:teuthology.orchestra.run.smithi007.stdout:prometheus.a smithi130 *:9095 running (2m) 0s ago 9m 64.3M - 2.33.4 514e6a882f6e e905fb2eb4a6 2024-06-18T02:10:30.112 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi007.dvbvbk smithi007 *:8000 running (7m) 7s ago 7m 76.3M - 17.2.0 e1d6a67b021e 1344b55b763c 2024-06-18T02:10:30.112 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi130.aakmof smithi130 *:8000 running (7m) 0s ago 7m 73.8M - 17.2.0 e1d6a67b021e e257e3230c6c 2024-06-18T02:10:30.112 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi007.hgrnmk smithi007 *:80 running (7m) 7s ago 7m 74.5M - 17.2.0 e1d6a67b021e 2173947bc4d6 2024-06-18T02:10:30.112 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi130.wwebfk smithi130 *:80 running (7m) 0s ago 7m 75.9M - 17.2.0 e1d6a67b021e 8662706b2231 2024-06-18T02:10:30.561 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:10:30.562 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": { 2024-06-18T02:10:30.562 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 1, 2024-06-18T02:10:30.562 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 2 2024-06-18T02:10:30.562 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:10:30.562 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": { 2024-06-18T02:10:30.562 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 2 2024-06-18T02:10:30.562 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:10:30.562 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": { 2024-06-18T02:10:30.562 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-06-18T02:10:30.562 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:10:30.563 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw": { 2024-06-18T02:10:30.563 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-06-18T02:10:30.563 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:10:30.563 INFO:teuthology.orchestra.run.smithi007.stdout: "overall": { 2024-06-18T02:10:30.563 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 13, 2024-06-18T02:10:30.563 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 4 2024-06-18T02:10:30.563 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-06-18T02:10:30.563 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:10:30.613 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:30.613 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:30.613 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:30.613 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[99735]: from='client.34296 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:10:30.613 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:30.613 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:30.613 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:30.613 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:30.613 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:30.614 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:30.614 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:30.614 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:30.614 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:30.614 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:30.614 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:30.614 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:30.614 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:30.614 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:30.614 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:30.614 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:30.614 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:30.614 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:30.615 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:30.615 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:30.615 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[99735]: from='client.34302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:10:30.615 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:30.615 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:30.615 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:30.615 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:30.615 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:30.615 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:30.615 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:30.616 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:30.616 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:30.616 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[73500]: from='client.34296 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:10:30.616 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:30.616 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:30.616 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:30.616 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:30.616 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:30.616 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:30.616 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:30.616 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:30.616 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:30.616 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:30.616 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:30.617 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:30.617 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:30.617 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:30.617 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:30.617 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:30.617 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:30.617 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:30.617 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:30.617 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:30.617 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[73500]: from='client.34302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:10:30.617 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:30.617 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:30.617 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:30.617 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:30.618 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:30.618 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:30.618 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[99735]: pgmap v71: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:10:30.618 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:30.618 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:30.618 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:30.618 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:30.618 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:30.618 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:30.618 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:30.619 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:30.619 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:30.619 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:30.619 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:30.619 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:30.619 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:30.619 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:30.619 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:30.619 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:30.619 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:30.619 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:30.619 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:30.619 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:30.619 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:30.620 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:30.620 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[73500]: pgmap v71: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:10:30.620 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:30.620 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:30.620 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:30.620 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:30.620 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:30.620 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:30.620 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:30.620 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:30.620 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:30.620 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:30.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:30.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:30.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:30.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:30.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:30.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:30.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:30.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:30.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:30.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:30.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:30.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:30 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:30.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:30 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:30.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:30 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:30.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:30 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:30.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:30 smithi130 ceph-mon[26123]: from='client.34296 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:10:30.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:30 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:30.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:30 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:30.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:30.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:30.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:30.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:30.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:30 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:30.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:30 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:30.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:30.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:30.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:30.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:30.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:30 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:30.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:30 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:30.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:30.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:30.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:30.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:30.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:30 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:30.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:30 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:30.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:30 smithi130 ceph-mon[26123]: from='client.34302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:10:30.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:30.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:30.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:30.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:30.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:30 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:30.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:30 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:30.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:30 smithi130 ceph-mon[26123]: pgmap v71: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:10:30.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:30.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:30.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:30.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:30.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:30 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:30.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:30 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:30.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:30.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:30.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:30.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:30.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:30 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:30.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:30 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:30.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:30.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:30.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:30.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:30.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:30 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:30.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:30.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:30.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:30.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:30 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:30.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:30 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:30.924 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:10:30.925 INFO:teuthology.orchestra.run.smithi007.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00", 2024-06-18T02:10:30.925 INFO:teuthology.orchestra.run.smithi007.stdout: "in_progress": true, 2024-06-18T02:10:30.925 INFO:teuthology.orchestra.run.smithi007.stdout: "which": "Upgrading all daemon types on all hosts", 2024-06-18T02:10:30.925 INFO:teuthology.orchestra.run.smithi007.stdout: "services_complete": [ 2024-06-18T02:10:30.925 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr" 2024-06-18T02:10:30.925 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-06-18T02:10:30.925 INFO:teuthology.orchestra.run.smithi007.stdout: "progress": "3/23 daemons upgraded", 2024-06-18T02:10:30.925 INFO:teuthology.orchestra.run.smithi007.stdout: "message": "Currently upgrading mon daemons", 2024-06-18T02:10:30.925 INFO:teuthology.orchestra.run.smithi007.stdout: "is_paused": false 2024-06-18T02:10:30.925 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:10:31.375 INFO:teuthology.orchestra.run.smithi007.stdout:HEALTH_OK 2024-06-18T02:10:31.612 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[73500]: from='client.25487 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:10:31.612 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:31.612 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:31.613 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:31.613 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:31.613 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:31.613 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:31.613 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:31.613 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:31.613 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:31.613 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:31.613 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:31.613 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:31.613 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:31.613 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:31.613 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[73500]: from='client.? 172.21.15.7:0/1602053500' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:31.613 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:31.614 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:31.614 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:31.614 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:31.614 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:31.614 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:31.614 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:31.614 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:31.614 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:31.614 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:31.614 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:31.614 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:31.614 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:31.614 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:31.615 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[99735]: from='client.25487 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:10:31.615 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:31.615 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:31.615 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:31.615 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:31.615 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:31.615 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:31.615 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:31.615 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:31.615 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:31.616 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:31.616 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:31.616 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:31.616 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:31.616 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:31.616 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[99735]: from='client.? 172.21.15.7:0/1602053500' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:31.616 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:31.616 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:31.616 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:31.616 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:31.616 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:31.616 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:31.616 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:31.616 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:31.616 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:31.616 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:31.617 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:31.617 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:31.617 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:31.617 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:31.617 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:31.617 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:31.617 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:31.617 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:31.617 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[73500]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:10:31.617 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:31.617 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:31.618 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:31.618 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:31.618 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:31.618 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:31.618 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:31.618 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:31.618 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:31.618 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:31.618 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:31.618 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:31.618 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:31.618 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:31.618 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:31.618 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:31.619 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:31.619 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:31.619 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:31.619 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:31.619 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[99735]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:10:31.619 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:31.619 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:31.619 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:31.619 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:31.619 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:31.619 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:31.619 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:31.620 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:31.620 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:31.620 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:31.620 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:31.620 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:31.620 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:31.620 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:31.620 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:31.620 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:31 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:31.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:31 smithi130 ceph-mon[26123]: from='client.25487 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:10:31.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:31 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:31.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:31 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:31.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:31.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:31.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:31.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:31.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:31 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:31.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:31 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:31.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:31.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:31.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:31.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:31.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:31 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:31.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:31 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:31.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:31 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/1602053500' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:31.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:31.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:31.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:31.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:31.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:31 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:31.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:31 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:31.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:31.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:31.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:31.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:31.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:31 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:31.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:31 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:31.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:31.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:31.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:31.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:31.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:31 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:31.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:31 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:31.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:31 smithi130 ceph-mon[26123]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:10:31.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:31.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:31.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:31.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:31.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:31 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:31.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:31 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:31.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:31.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:31.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:31.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:31.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:31 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:31.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:31.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:31.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:31.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:31 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:31.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:31 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:32.615 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:32.615 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:32.615 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:32.616 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:32.616 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:32.616 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:32.616 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:32.616 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:32.616 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[73500]: from='client.? 172.21.15.7:0/2427387663' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:10:32.616 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:32.616 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:32.616 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:32.616 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:32.616 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:32.616 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:32.616 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:32.616 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:32.617 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:32.617 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:32.617 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:32.617 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:32.617 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:32.617 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:32.617 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:32.617 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:32.617 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:32.617 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:32.618 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:32.618 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:32.618 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:32.618 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:32.618 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:32.618 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:32.618 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:32.618 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:32.618 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:32.619 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:32.619 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:32.619 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[99735]: from='client.? 172.21.15.7:0/2427387663' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:10:32.619 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:32.619 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:32.619 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:32.619 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:32.619 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:32.619 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:32.619 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:32.619 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:32.619 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:32.619 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:32.619 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:32.620 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:32.620 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:32.620 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:32.620 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:32.620 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:32.620 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:32.620 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:32.620 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:32.620 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:32.620 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:32.620 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:32.620 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:32.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:32.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[73500]: pgmap v72: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:10:32.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:32.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:32.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:32.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:32.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:32.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:32.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[73500]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:10:32.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:32.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:32.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:32.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:32.622 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:32.622 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:32.622 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:32.622 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:32.622 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:32.622 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:32.622 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:32.622 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:32.622 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:32.622 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:32.622 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:32.622 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:32.623 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:32.623 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:32.623 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:32.623 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[99735]: pgmap v72: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:10:32.623 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:32.623 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:32.623 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:32.623 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:32.623 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:32.623 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:32.623 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[99735]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:10:32.624 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:32.624 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:32.624 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:32.624 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:32.624 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:32.624 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:32.624 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:32.624 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:32.624 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:32.624 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:32.624 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:32.624 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:32.624 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:32.624 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:32.625 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:32.625 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:32 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:32.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:32 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:32.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:32 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:32.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:32.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:32.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:32.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:32.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:32 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:32.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:32 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:32.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:32 smithi130 ceph-mon[26123]: from='client.? 172.21.15.7:0/2427387663' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:10:32.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:32.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:32.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:32.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:32.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:32 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:32.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:32 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:32.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:32.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:32.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:32.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:32.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:32 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:32.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:32 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:32.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:32.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:32.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:32.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:32.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:32 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:32.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:32 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:32.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:32.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:32.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:32.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:32.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:32 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:32.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:32 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:32.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:32 smithi130 ceph-mon[26123]: pgmap v72: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:10:32.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:32.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:32.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:32.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:32.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:32 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:32.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:32 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:32.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:32 smithi130 ceph-mon[26123]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:10:32.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:32.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:32.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:32.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:32.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:32 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:32.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:32 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:32.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:32.799 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:32.799 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:32.799 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:32.799 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:32 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:32.799 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:32.799 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:32.799 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:32.799 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:32 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:32.799 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:32 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:33.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:33.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:33.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:33.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:33.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:33.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:33.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:33.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:33.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:33.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:33.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:33.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:33.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:33.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:33.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:33.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:33.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:33.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:33.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:33.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:33.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:33.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:33.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:33.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:33.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:33.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:33.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:33.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:33.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:33.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:33.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:33.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:33.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:33.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:33.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:33.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:33.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:33.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:33.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:33.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:33.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:33.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:33.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:33.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:33.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:33.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:33.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:33.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:33.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:33.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:33.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:33.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:33.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:33.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:33.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:33.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:33.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:33.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:33.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:33.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:33.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:33.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:33.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:33.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:33.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:33.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:33.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:33.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:33.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:33.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:33.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:33.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:33.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:33.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:33.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:33.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:33.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:33.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:33.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:33.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:33.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:33.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:33.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:33.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:33.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:33.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:33.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:33.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:33.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:33.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:33.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:33.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:33.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:33.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:33.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:33.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:33.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:33.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:33.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:33.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:33.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:33.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:33.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:33.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:33.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:33.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:33 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:33.793 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:10:33 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:10:33.505Z caller=manager.go:609 level=warn component="rule manager" group=nodes msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on(instance) group_left(nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi007\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"cd9a3408-2d15-11ef-bc9d-c7b262605968\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-06-18T02:10:33.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:33 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:33.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:33 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:33.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:33.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:33.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:33.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:33.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:33 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:33.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:33 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:33.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:33.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:33.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:33.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:33.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:33 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:33.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:33 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:33.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:33.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:33.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:33.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:33.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:33 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:33.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:33 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:33.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:33.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:33.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:33.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:33.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:33 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:33.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:33 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:33.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:33.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:33.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:33.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:33.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:33 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:33.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:33 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:33.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:33.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:33.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:33.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:33.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:33 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:33.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:33 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:33.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:33.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:33.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:33.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:33.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:33 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:33.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:33.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:33.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:33.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:33.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:33 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:33.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:33.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:33.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:33.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:33 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:33.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:33 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:34.654 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:34.654 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:34.654 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:34.654 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:34.654 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:34.655 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:34.655 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:34.655 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:34.655 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:34.655 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:34.655 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:34.655 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:34.655 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:34.655 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:34.655 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:34.655 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:34.655 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:34.655 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:34.655 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:34.656 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:34.656 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:34.656 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:34.656 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:34.656 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:34.656 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:34.656 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:34.656 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:34.656 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[73500]: pgmap v73: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:10:34.656 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:34.656 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:34.656 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:34.656 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:34.657 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:34.657 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:34.657 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:34.657 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:34.657 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:34.657 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:34.657 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:34.657 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:34.657 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:34.657 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:34.657 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:34.657 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:34.657 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:34.658 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:34.658 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:34.658 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:34.658 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:34.658 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:34.658 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:34.658 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:34.659 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:34.659 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:34.659 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:34.659 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:34.659 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:34.659 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:34.659 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:34.659 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:34.659 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:34.659 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:34.659 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:34.659 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:34.659 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:34.659 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:34.660 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:34.660 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:34.660 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:34.660 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:34.660 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:34.660 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:34.660 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:34.660 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:34.660 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:34.660 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:34.660 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:34.660 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[99735]: pgmap v73: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:10:34.660 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:34.660 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:34.661 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:34.661 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:34.661 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:34.661 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:34.661 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:34.661 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:34.661 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:34.661 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:34.661 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:34.661 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:34.661 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:34.661 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:34.661 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:34.661 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:34.661 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:34.662 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:34.662 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:34.662 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:34.662 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:34.662 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:34 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:34.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:34 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:34.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:34 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:34.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:34 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:34.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:34.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:34.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:34.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:34.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:34 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:34.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:34 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:34.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:34.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:34.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:34.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:34.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:34 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:34.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:34 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:34.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:34.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:34.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:34.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:34.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:34 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:34.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:34 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:34.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:34.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:34.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:34.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:34.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:34 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:34.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:34 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:34.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:34 smithi130 ceph-mon[26123]: pgmap v73: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:10:34.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:34.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:34.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:34.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:34.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:34 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:34.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:34 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:34.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:34.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:34.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:34.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:34.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:34 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:34.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:34 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:34.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:34.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:34.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:34.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:34.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:34 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:34.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:34.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:34.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:34.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:34 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:34.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:34 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:35.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:35.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:35.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:35.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:35.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:35.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:35.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:35.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:35.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:35.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:35.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:35.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:35.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:35.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:35.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:35.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:35.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:35.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:35.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:35.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:35.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:35.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:35.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:35.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:35.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:35.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:35.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:35.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:35.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:35.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:35.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:35.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:35.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:35.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:35.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:35.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:35.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:35.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:35.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:35.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:35.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:35.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:35.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:35.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:35.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:35.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:35.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:35.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:35.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:35.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:35.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:35.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:35.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:35.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:35.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:35.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:35.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:35.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:35.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:35.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:35.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:35.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:35.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:35.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:35.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:35.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:35.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:35.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:35.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:35.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:35.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:35.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:35.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:35.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:35.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:35.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:35.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:35.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:35.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:35.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:35.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:35.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:35.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:35.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:35.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:35.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:35.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:35.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:35.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:35.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:35.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:35.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:35.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:35.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:35.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:35.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:35.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:35.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:35.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:35.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:35.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:35.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:35.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:35.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:35.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:35.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:35.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:35.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:35 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:35.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:35 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:35.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:35 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:35.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:35.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:35.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:35.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:35.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:35 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:35.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:35 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:35.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:35.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:35.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:35.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:35.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:35 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:35.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:35 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:35.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:35.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:35.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:35.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:35.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:35 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:35.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:35 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:35.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:35.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:35.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:35.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:35.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:35 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:35.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:35 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:35.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:35.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:35.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:35.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:35.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:35 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:35.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:35 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:35.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:35.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:35.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:35.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:35.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:35 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:35.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:35 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:35.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:35.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:35.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:35.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:35.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:35 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:35.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:35 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:35.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:35.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:35.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:35.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:35.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:35 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:35.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:35.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:35.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:35.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:35 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:35.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:35 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:36.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:36.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:36.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:36.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:36.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:36.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:36.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:36.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:36.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:36.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:36.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:36.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:36.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:36.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:36.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:36.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:36.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:36.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:36.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:36.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:36.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:36.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:36.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:36.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:36.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:36.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:36.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:36.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:36.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:36.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:36.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:36.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:36.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:36.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:36.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:36.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:36.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:36.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:36.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:36.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:36.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:36.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:36.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:36.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:36.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:36.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:36.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:36.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:36.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:36.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:36.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:36.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:36.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:36.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:36.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:36.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:36.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:36.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:36.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:36.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:36.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:36.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[73500]: pgmap v74: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:10:36.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:36.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:36.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:36.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:36.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:36.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:36.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:36.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:36.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:36.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:36.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:36.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:36.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:36.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:36.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:36.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:36.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:36.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:36.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:36.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:36.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:36.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:36.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:36.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:36.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[99735]: pgmap v74: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:10:36.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:36.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:36.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:36.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:36.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:36.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:36.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:36.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:36.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:36.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:36.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:36.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:36.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:36.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:36.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:36.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:36.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:36.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:36.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:36.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:36.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:36 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:36.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:36 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:36.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:36 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:36.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:36.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:36.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:36.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:36.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:36 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:36.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:36 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:36.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:36.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:36.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:36.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:36.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:36 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:36.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:36 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:36.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:36.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:36.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:36.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:36.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:36 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:36.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:36 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:36.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:36.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:36.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:36.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:36.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:36 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:36.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:36 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:36.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:36.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:36.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:36.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:36.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:36 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:36.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:36 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:36.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:36 smithi130 ceph-mon[26123]: pgmap v74: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:10:36.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:36.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:36.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:36.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:36.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:36 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:36.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:36 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:36.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:36.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:36.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:36.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:36.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:36 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:36.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:36.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:36.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:36.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:36.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:36 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:36.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:36.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:36.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:36.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:36 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:36.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:36 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:37.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:37.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:37.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:37.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:37.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:37.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:37.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:37.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:37.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:37.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:37.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:37.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:37.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:37.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:37.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:37.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:37.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:37.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:37.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:37.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:37.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:37.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:37.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:37.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:37.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:37.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:37.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:37.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:37.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:37.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:37.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:37.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:37.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:37.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:37.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:37.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:37.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:37.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:37.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:37.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:37.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:37.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:37.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:37.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:37.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:37.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:37.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:37.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:37.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:37.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:37.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:37.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:37.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:37.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:37.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:37.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:37.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:37.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:37.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:37.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:37.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:37.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:37.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:37.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:37.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:37.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:37.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:37.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:37.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:37.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:37.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:37.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:37.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:37.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:37.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:37.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:37.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:37.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:37.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:37.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:37.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:37.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:37.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:37.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:37.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:37.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:37.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:37.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:37.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:37.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:37.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:37.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:37.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:37.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:37.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:37.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:37.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:37.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:37.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:37.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:37.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:37.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:37.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:37 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:37.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:37 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:37.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:37 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:37.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:37.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:37.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:37.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:37.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:37 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:37.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:37 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:37.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:37.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:37.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:37.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:37.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:37 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:37.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:37 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:37.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:37.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:37.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:37.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:37.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:37 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:37.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:37 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:37.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:37.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:37.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:37.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:37.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:37 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:37.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:37 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:37.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:37.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:37.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:37.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:37.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:37 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:37.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:37 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:37.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:37.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:37.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:37.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:37.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:37 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:37.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:37 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:37.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:37.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:37.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:37.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:37.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:37 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:37.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:37.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:37.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:37.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:37.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:37 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:37.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:37.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:37 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:38.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:10:37 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:10:37] "GET /metrics HTTP/1.1" 200 38244 "" "Prometheus/2.33.4" 2024-06-18T02:10:38.659 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:38 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:38.659 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:38 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:38.659 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:38.659 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:38.659 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:38 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:38.659 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:38 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:38.659 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:38.659 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:38.660 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:38.660 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:38.660 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:38 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:38.660 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:38 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:38.660 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:38.660 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:38.660 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:38.660 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:38.660 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:38 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:38.660 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:38 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:38.660 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:38.660 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:38.660 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:38.660 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:38.660 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:38 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:38.661 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:38 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:38.661 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:38.661 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:38.661 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:38.661 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:38.661 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:38 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:38.661 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:38 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:38.661 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:38 smithi130 ceph-mon[26123]: pgmap v75: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:10:38.661 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:38.662 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:38.662 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:38.662 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:38.662 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:38 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:38.662 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:38 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:38.662 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:38.662 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:38.662 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:38.662 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:38.662 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:38 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:38.662 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:38 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:38.663 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:38.663 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:38.663 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:38.663 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:38.663 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:38 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:38.663 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:38.663 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:38.663 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:38.663 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:38 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:38.663 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:38 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:38.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:38.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:38.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:38.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:38.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:38.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:38.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:38.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:38.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:38.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:38.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:38.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:38.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:38.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:38.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:38.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:38.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:38.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:38.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:38.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:38.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:38.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:38.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:38.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:38.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:38.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:38.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:38.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:38.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:38.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:38.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:38.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:38.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:38.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:38.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:38.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:38.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:38.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:38.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:38.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:38.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:38.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:38.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:38.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:38.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:38.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:38.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:38.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:38.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:38.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:38.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:38.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:38.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:38.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:38.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:38.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:38.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:38.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:38.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:38.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:38.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[99735]: pgmap v75: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:10:38.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:38.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:38.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:38.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:38.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:38.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:38.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:38.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:38.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:38.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:38.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:38.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:38.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:38.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:38.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:38.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:38.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:38.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:38.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:38.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:38.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:38.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:38.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[73500]: pgmap v75: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:10:38.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:38.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:38.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:38.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:38.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:38.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:38.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:38.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:38.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:38.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:38.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:38.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:38.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:38.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:38.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:38.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:38.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:38.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:38.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:38.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:38.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:38.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:38 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:39.043 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:10:38 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:10:38.659Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.7\", device_class=\"ssd\", hostname=\"smithi007\", instance=\"172.21.15.130:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.7\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"cd9a3408-2d15-11ef-bc9d-c7b262605968\", cluster_addr=\"172.21.15.7\", device_class=\"ssd\", hostname=\"smithi007\", instance=\"smithi130:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.7\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-06-18T02:10:39.609 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:39.609 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:39.609 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:39.609 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:39.609 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:39.610 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:39.610 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:39.610 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:39.610 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:39.610 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:39.610 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:39.610 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:39.610 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:39.610 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:39.610 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:39.610 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:39.610 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:39.611 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:39.611 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:39.611 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:39.611 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:39.611 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:39.611 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:39.611 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:39.611 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:39.611 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:39.611 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:39.611 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:39.611 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:39.611 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:39.612 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:39.612 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:39.612 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:39.612 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:39.612 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:39.612 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:39.612 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:39.612 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:39.612 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:39.612 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:39.612 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:39.612 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:39.612 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:39.612 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:39.613 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:39.613 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:39.613 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:39.613 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:39.613 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:39.613 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:39.613 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:39.613 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:39.613 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:39.613 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:39.613 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:39.613 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:39.613 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:39.613 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:39.614 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:39.614 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:39.614 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:39.614 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:39.614 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:39.614 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:39.614 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:39.614 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:39.615 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:39.615 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:39.615 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:39.615 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:39.615 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:39.615 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:39.615 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:39.615 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:39.615 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:39.616 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:39.616 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:39.616 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:39.616 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:39.616 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:39.616 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:39.616 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:39.616 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:39.616 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:39.617 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:39.617 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:39.617 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:39.617 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:39.617 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:39.617 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:39.617 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:39.617 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:39.617 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:39.617 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:39.617 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:39.617 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:39.618 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:39.618 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:39.618 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:39.618 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:39.618 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:39.618 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:39.618 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:39.618 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:39.618 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:39.618 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:39 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:39.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:39 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:39.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:39 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:39.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:39 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:39.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:39 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:39.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:39 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:39.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:39 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:39.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:39 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:39.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:39 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:39.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:39 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:39.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:39 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:39.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:39 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:39.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:39 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:39.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:39 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:39.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:39 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:39.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:39 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:39.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:39 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:39.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:39 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:39.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:39 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:39.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:39 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:39.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:39 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:39.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:39 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:39.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:39 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:39.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:39 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:39.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:39 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:39.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:39 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:39.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:39 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:39.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:39 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:39.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:39 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:39.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:39 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:39.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:39 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:39.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:39 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:39.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:39 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:39.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:39 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:39.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:39 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:39.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:39 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:39.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:39 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:39.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:39 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:39.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:39 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:39.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:39 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:39.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:39 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:39.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:39 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:39.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:39 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:39.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:39 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:39.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:39 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:39.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:39 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:39.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:39 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:39.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:39 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:39.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:39 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:39.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:39 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:39.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:39 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:39.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:39 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:39.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:39 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:39.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:39 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:40.571 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:40.571 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:40.571 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:40.571 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:40.571 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:40.571 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:40.571 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:40.571 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:40.571 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:40.571 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:40.572 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:40.572 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:40.572 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:40.572 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:40.572 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:40.572 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:40.572 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:40.572 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:40.572 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:40.572 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:40.572 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:40.572 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:40.572 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:40.572 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:40.573 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:40.573 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:40.573 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:40.573 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:40.573 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:40.573 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:40.573 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:40.573 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:40.573 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:40.574 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:40.574 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:40.574 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:40.574 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:40.574 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:40.574 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:40.574 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:40.574 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:40.574 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:40.574 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:40.574 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:40.574 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:40.574 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:40.575 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:40.575 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:40.575 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:40.575 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:40.575 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:40.575 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:40.575 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:40.575 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:40.575 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:40.575 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:40.575 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:40.575 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:40.575 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:40.575 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:40.575 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:40.576 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:40.576 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:40.576 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[99735]: pgmap v76: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:10:40.576 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:40.576 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:40.576 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:40.576 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:40.576 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:40.576 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:40.576 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:40.576 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:40.576 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:40.576 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:40.576 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:40.576 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:40.577 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:40.577 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:40.577 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:40.577 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:40.577 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:40.577 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:40.577 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:40.577 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:40.577 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:40.577 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:40.577 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:40.577 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:40.577 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[73500]: pgmap v76: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:10:40.578 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:40.578 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:40.578 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:40.578 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:40.578 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:40.578 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:40.578 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:40.578 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:40.578 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:40.578 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:40.578 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:40.578 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:40.578 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:40.579 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:40.579 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:40.579 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:40.579 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:40.579 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:40.579 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:40.579 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:40.579 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:40 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:40.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:40 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:40.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:40 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:40.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:40 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:40.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:40 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:40.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:40 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:40.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:40 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:40.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:40 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:40.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:40 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:40.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:40 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:40.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:40 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:40.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:40 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:40.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:40 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:40.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:40 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:40.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:40 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:40.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:40 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:40.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:40 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:40.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:40 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:40.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:40 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:40.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:40 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:40.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:40 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:40.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:40 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:40.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:40 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:40.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:40 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:40.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:40 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:40.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:40 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:40.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:40 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:40.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:40 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:40.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:40 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:40.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:40 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:40.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:40 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:40.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:40 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:40.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:40 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:40.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:40 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:40.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:40 smithi130 ceph-mon[26123]: pgmap v76: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:10:40.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:40 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:40.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:40 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:40.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:40 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:40.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:40 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:40.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:40 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:40.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:40 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:40.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:40 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:40.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:40 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:40.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:40 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:40.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:40 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:40.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:40 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:40.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:40 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:40.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:40 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:40.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:40 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:40.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:40 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:40.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:40 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:40.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:40 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:40.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:40 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:40.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:40 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:40.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:40 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:40.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:40 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:41.638 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:41.638 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:41.638 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:41.638 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:41.638 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:41.638 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:41.639 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:41.639 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:41.639 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:41.639 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:41.639 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:41.639 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:41.639 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:41.639 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:41.639 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:41.639 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:41.640 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:41.640 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:41.640 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:41.640 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:41.640 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:41.640 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:41.640 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:41.640 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:41.640 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:41.640 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:41.640 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:41.641 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:41.641 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:41.641 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:41.641 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:41.641 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:41.641 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:41.641 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:41.641 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:41.641 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:41.642 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:41.642 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:41.642 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:41.642 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:41.642 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:41.642 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:41.642 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:41.642 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:41.642 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:41.642 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:41.642 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:41.642 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:41.643 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:41.643 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:41.643 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:41.643 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:41.643 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:41.643 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:41.643 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:41.643 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:41.643 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:41.643 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:41.643 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:41.643 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:41.644 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:41.644 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:41.644 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:41.644 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:41.644 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:41.644 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:41.644 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:41.644 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:41.644 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:41.645 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:41.645 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:41.645 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:41.645 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:41.645 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:41.645 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:10:41.645 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:41.645 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:41.645 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:41.645 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:41.645 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:41.646 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:41.646 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:41.646 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:41.646 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:41.646 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:41.646 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:41.646 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:41.647 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:41.647 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:41.647 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:41.647 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:41.647 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:41.647 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:41.647 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:41.647 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:10:41.647 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:41.647 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:41.647 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:41.648 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:41.648 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:41 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:41.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:41 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:41.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:41 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:41.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:41 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:41.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:41 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:41.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:41 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:41.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:41 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:41.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:41 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:41.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:41 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:41.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:41 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:41.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:41 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:41.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:41 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:41.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:41 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:41.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:41 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:41.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:41 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:41.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:41 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:41.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:41 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:41.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:41 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:41.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:41 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:41.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:41 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:41.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:41 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:41.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:41 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:41.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:41 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:41.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:41 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:41.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:41 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:41.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:41 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:41.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:41 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:41.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:41 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:41.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:41 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:41.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:41 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:41.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:41 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:41.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:41 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:41.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:41 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:41.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:41 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:41.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:41 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:41.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:41 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:41.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:41 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:41.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:41 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:41.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:41 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:41.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:41 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:41.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:41 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:41.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:41 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:41.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:41 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:41.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:41 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:41.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:41 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:41.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:41 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:10:41.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:41 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:41.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:41 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:41.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:41 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:41.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:41 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:41.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:41 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:42.574 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:42.574 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:42.574 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:42.575 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:42.575 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:42.575 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:42.575 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:42.575 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:42.575 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:42.575 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:42.575 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:42.575 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:42.575 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:42.575 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:42.575 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:42.575 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:42.576 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:42.576 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:42.576 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:42.576 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:42.576 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:42.576 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:42.576 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:42.576 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:42.576 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:42.576 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:42.576 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:42.576 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:42.577 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:42.577 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:42.577 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:42.577 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:42.577 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:42.577 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:42.577 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:42.578 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:42.578 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:42.578 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:42.578 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:42.578 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:42.578 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:42.578 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:42.578 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:42.578 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:42.578 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:42.578 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:42.578 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:42.578 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:42.578 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:42.579 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:42.579 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:42.579 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:42.579 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:42.579 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:42.579 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:42.579 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:42.579 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:42.579 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:42.579 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:42.579 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:42.580 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:42.580 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[73500]: pgmap v77: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:10:42.580 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[73500]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:10:42.580 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:42.580 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:42.580 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:42.580 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:42.580 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:42.580 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:42.581 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:42.581 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:42.581 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:42.581 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:42.581 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:42.581 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:42.581 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:42.581 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:42.581 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:42.581 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:42.581 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:42.581 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:42.581 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:42.581 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:42.581 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:42.582 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:42.582 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:42.582 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:42.582 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[99735]: pgmap v77: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:10:42.582 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[99735]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:10:42.582 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:42.582 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:42.582 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:42.582 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:42.582 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:42.582 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:42.583 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:42.583 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:42.583 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:42.583 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:42.583 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:42.583 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:42.583 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:42.583 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:42.583 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:42.583 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:42.583 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:42.583 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:42.584 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:42.584 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:42.584 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:42.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:42 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:42.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:42 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:42.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:42 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:42.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:42 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:42.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:42 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:42.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:42 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:42.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:42 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:42.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:42 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:42.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:42 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:42.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:42 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:42.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:42 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:42.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:42 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:42.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:42 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:42.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:42 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:42.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:42 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:42.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:42 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:42.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:42 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:42.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:42 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:42.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:42 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:42.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:42 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:42.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:42 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:42.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:42 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:42.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:42 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:42.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:42 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:42.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:42 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:42.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:42 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:42.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:42 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:42.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:42 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:42.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:42 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:42.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:42 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:42.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:42 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:42.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:42 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:42.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:42 smithi130 ceph-mon[26123]: pgmap v77: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:10:42.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:42 smithi130 ceph-mon[26123]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:10:42.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:42 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:42.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:42 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:42.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:42 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:42.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:42 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:42.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:42 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:42.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:42 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:42.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:42 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:42.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:42 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:42.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:42 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:42.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:42 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:42.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:42 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:42.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:42 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:42.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:42 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:42.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:42 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:42.799 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:42 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:42.799 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:42 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:42.799 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:42 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:42.799 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:42 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:42.799 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:42 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:42.799 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:42 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:42.799 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:42 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:43.629 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:10:43 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:10:43.505Z caller=manager.go:609 level=warn component="rule manager" group=nodes msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on(instance) group_left(nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi007\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"cd9a3408-2d15-11ef-bc9d-c7b262605968\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-06-18T02:10:43.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:43 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:43.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:43 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:43.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:43 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:43.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:43 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:43.630 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:43 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:43.630 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:43 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:43.630 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:43 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:43.630 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:43 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:43.630 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:43 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:43.630 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:43 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:43.630 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:43 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:43.630 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:43 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:43.630 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:43 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:43.630 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:43 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:43.630 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:43 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:43.630 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:43 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:43.630 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:43 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:43.631 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:43 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:43.631 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:43 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:43.631 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:43 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:43.631 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:43 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:43.631 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:43 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:43.631 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:43 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:43.631 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:43 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:43.631 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:43 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:43.631 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:43 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:43.631 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:43 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:43.631 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:43 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:43.631 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:43 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:43.631 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:43 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:43.631 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:43 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:43.632 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:43 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:43.632 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:43 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:43.632 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:43 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:43.632 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:43 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:43.632 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:43 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:43.632 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:43 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:43.632 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:43 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:43.632 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:43 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:43.632 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:43 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:43.632 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:43 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:43.632 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:43 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:43.632 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:43 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:43.632 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:43 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:43.632 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:43 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:43.632 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:43 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:43.633 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:43 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:43.633 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:43 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:43.633 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:43 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:43.633 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:43 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-06-18T02:10:43.633 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:43 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2024-06-18T02:10:43.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:43.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:43.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:43.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:43.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:43.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:43.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:43.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:43.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:43.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:43.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:43.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:43.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:43.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:43.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:43.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:43.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:43.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:43.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:43.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:43.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:43.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:43.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:43.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:43.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:43.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:43.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:43.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:43.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:43.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:43.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:43.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:43.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:43.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:43.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:43.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:43.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:43.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:43.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:43.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:43.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:43.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:43.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:43.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:43.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:43.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:43.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:43.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:43.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:43.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:43.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:43.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:43.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:43.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:43.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:43.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:43.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:43.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:43.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:43.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:43.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:43.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:43.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:43.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:43.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:43.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:43.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:43.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:43.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:43.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:43.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:43.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:43.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:43.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:43.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:43.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:43.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:43.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:43.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:43.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-06-18T02:10:43.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2024-06-18T02:10:43.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:43.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:43.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:43.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:43.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:43.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:43.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:43.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:43.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:43.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:43.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:43.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:43.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:43.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:43.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:43.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:43.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:43.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:10:43.691 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:10:43.691 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-06-18T02:10:43.691 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:43 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2024-06-18T02:10:44.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:44 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:44.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:44 smithi007 ceph-mon[99735]: Upgrade: It appears safe to stop mon.b 2024-06-18T02:10:44.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:44 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:44.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:44 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:44.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:44 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:44.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:44 smithi007 ceph-mon[99735]: pgmap v78: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:10:44.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:44 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:44.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:44 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:44.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:44 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:44.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:44 smithi007 ceph-mon[73500]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:44.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:44 smithi007 ceph-mon[73500]: Upgrade: It appears safe to stop mon.b 2024-06-18T02:10:44.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:44 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:44.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:44 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:44.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:44 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:44.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:44 smithi007 ceph-mon[73500]: pgmap v78: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:10:44.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:44 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:44.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:44 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:44.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:44 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:44.694 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:44 smithi130 ceph-mon[26123]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:10:44.695 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:44 smithi130 ceph-mon[26123]: Upgrade: It appears safe to stop mon.b 2024-06-18T02:10:44.695 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:44 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:44.695 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:44 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:44.695 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:44 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:44.695 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:44 smithi130 ceph-mon[26123]: pgmap v78: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:10:44.695 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:44 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:44.695 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:44 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:44.695 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:44 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:45.822 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:45 smithi007 ceph-mon[73500]: Upgrade: Updating mon.b 2024-06-18T02:10:45.823 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:45 smithi007 ceph-mon[73500]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:45.823 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:45 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-18T02:10:45.823 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:45 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-18T02:10:45.823 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:45 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:45.823 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:45 smithi007 ceph-mon[73500]: Deploying daemon mon.b on smithi130 2024-06-18T02:10:45.823 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:45 smithi007 ceph-mon[99735]: Upgrade: Updating mon.b 2024-06-18T02:10:45.823 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:45 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:45.823 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-18T02:10:45.823 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-18T02:10:45.823 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:45.824 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:45 smithi007 ceph-mon[99735]: Deploying daemon mon.b on smithi130 2024-06-18T02:10:46.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:45 smithi130 ceph-mon[26123]: Upgrade: Updating mon.b 2024-06-18T02:10:46.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:45 smithi130 ceph-mon[26123]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:10:46.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:45 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-18T02:10:46.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:45 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-18T02:10:46.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:45 smithi130 ceph-mon[26123]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:46.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:45 smithi130 ceph-mon[26123]: Deploying daemon mon.b on smithi130 2024-06-18T02:10:46.633 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:46 smithi130 systemd[1]: Stopping Ceph mon.b for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:10:46.814 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:46 smithi007 ceph-mon[73500]: pgmap v79: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:10:46.814 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:46 smithi007 ceph-mon[99735]: pgmap v79: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:10:47.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:46 smithi130 ceph-mon[26123]: pgmap v79: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:10:47.740 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:47 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-b[26107]: 2024-06-18T02:10:47.587+0000 7f1a82c6f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-06-18T02:10:47.740 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:47 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-b[26107]: 2024-06-18T02:10:47.587+0000 7f1a82c6f700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-06-18T02:10:47.740 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:10:47 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: [18/Jun/2024:02:10:47] ENGINE Bus STOPPING 2024-06-18T02:10:48.041 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:47 smithi130 podman[84240]: 2024-06-18 02:10:47.740950649 +0000 UTC m=+0.253405007 container died a0b38a9a595fa8f33f17844f5a5b0e4ac48d62e4ed310895b0c6a9a330005a25 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-b, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, com.redhat.component=centos-stream-container, ceph=True, io.buildah.version=1.19.8, vcs-type=git, GIT_REPO=https://github.com/ceph/ceph-container.git, architecture=x86_64, io.openshift.tags=base centos centos-stream, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.openshift.expose-services=, GIT_BRANCH=HEAD, RELEASE=HEAD, vendor=Red Hat, Inc., name=centos-stream, build-date=2022-05-03T08:36:31.336870, version=8, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., CEPH_POINT_RELEASE=-17.2.0, distribution-scope=public, release=754, GIT_CLEAN=True, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, maintainer=Guillaume Abrioux , url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.k8s.display-name=CentOS Stream 8, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image) 2024-06-18T02:10:48.042 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:10:47 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:10:47] "GET /metrics HTTP/1.1" 200 38245 "" "Prometheus/2.33.4" 2024-06-18T02:10:48.042 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:10:47 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: [18/Jun/2024:02:10:47] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-06-18T02:10:48.042 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:10:47 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: [18/Jun/2024:02:10:47] ENGINE Bus STOPPED 2024-06-18T02:10:48.042 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:10:47 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: [18/Jun/2024:02:10:47] ENGINE Bus STARTING 2024-06-18T02:10:48.042 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:10:47 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: [18/Jun/2024:02:10:47] ENGINE Serving on http://:::9283 2024-06-18T02:10:48.042 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:10:47 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: [18/Jun/2024:02:10:47] ENGINE Bus STARTED 2024-06-18T02:10:48.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:48 smithi130 podman[84240]: 2024-06-18 02:10:48.150135076 +0000 UTC m=+0.662589434 container cleanup a0b38a9a595fa8f33f17844f5a5b0e4ac48d62e4ed310895b0c6a9a330005a25 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-b, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, ceph=True, release=754, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, vcs-type=git, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, maintainer=Guillaume Abrioux , io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., CEPH_POINT_RELEASE=-17.2.0, io.buildah.version=1.19.8, io.openshift.expose-services=, io.openshift.tags=base centos centos-stream, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, name=centos-stream, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_BRANCH=HEAD, version=8, build-date=2022-05-03T08:36:31.336870, io.k8s.display-name=CentOS Stream 8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, com.redhat.component=centos-stream-container, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, RELEASE=HEAD, architecture=x86_64, distribution-scope=public, vendor=Red Hat, Inc.) 2024-06-18T02:10:48.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:48 smithi130 bash[84240]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-b 2024-06-18T02:10:48.659 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:48 smithi130 podman[84254]: 2024-06-18 02:10:48.385180849 +0000 UTC m=+0.642546560 container remove a0b38a9a595fa8f33f17844f5a5b0e4ac48d62e4ed310895b0c6a9a330005a25 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-b, distribution-scope=public, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, version=8, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.component=centos-stream-container, GIT_CLEAN=True, architecture=x86_64, io.openshift.tags=base centos centos-stream, build-date=2022-05-03T08:36:31.336870, CEPH_POINT_RELEASE=-17.2.0, maintainer=Guillaume Abrioux , io.openshift.expose-services=, io.k8s.display-name=CentOS Stream 8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, vendor=Red Hat, Inc., io.buildah.version=1.19.8, ceph=True, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, vcs-type=git, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, GIT_BRANCH=HEAD, RELEASE=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, name=centos-stream, release=754) 2024-06-18T02:10:48.660 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:48 smithi130 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mon.b.service: Deactivated successfully. 2024-06-18T02:10:48.660 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:48 smithi130 systemd[1]: Stopped Ceph mon.b for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:10:48.660 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:48 smithi130 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mon.b.service: Consumed 14.873s CPU time. 2024-06-18T02:10:48.944 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:48 smithi130 systemd[1]: Starting Ceph mon.b for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:10:48.944 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:10:48 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:10:48.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.7\", device_class=\"ssd\", hostname=\"smithi007\", instance=\"172.21.15.130:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.7\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"cd9a3408-2d15-11ef-bc9d-c7b262605968\", cluster_addr=\"172.21.15.7\", device_class=\"ssd\", hostname=\"smithi007\", instance=\"smithi130:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.7\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-06-18T02:10:49.237 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:48 smithi130 podman[84387]: 2024-06-18 02:10:48.847627404 +0000 UTC m=+0.017719130 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:10:49.237 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:48 smithi130 podman[84387]: 2024-06-18 02:10:48.969502104 +0000 UTC m=+0.139593822 container create baacf2add994e89cba2a7722dc5b0adcbabc1935ed9b1e00c060f803e5cb01e5 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-b, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240612, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-3781e3a) 2024-06-18T02:10:49.537 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 podman[84387]: 2024-06-18 02:10:49.23868207 +0000 UTC m=+0.408773799 container init baacf2add994e89cba2a7722dc5b0adcbabc1935ed9b1e00c060f803e5cb01e5 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-b, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-3781e3a, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240612, ceph=True, GIT_BRANCH=HEAD) 2024-06-18T02:10:49.537 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 podman[84387]: 2024-06-18 02:10:49.243431339 +0000 UTC m=+0.413523065 container start baacf2add994e89cba2a7722dc5b0adcbabc1935ed9b1e00c060f803e5cb01e5 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-b, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240612, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, GIT_CLEAN=True, RELEASE=squid-3781e3a, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-06-18T02:10:49.537 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: set uid:gid to 167:167 (ceph:ceph) 2024-06-18T02:10:49.537 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc), process ceph-mon, pid 2 2024-06-18T02:10:49.537 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: pidfile_write: ignore empty --pid-file 2024-06-18T02:10:49.537 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: load: jerasure load: lrc 2024-06-18T02:10:49.537 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: RocksDB version: 7.9.2 2024-06-18T02:10:49.537 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Git sha 0 2024-06-18T02:10:49.538 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Compile date 2024-06-17 15:21:02 2024-06-18T02:10:49.538 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: DB SUMMARY 2024-06-18T02:10:49.538 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: DB Session ID: X7E0JP58V5BUNPGZQNJ8 2024-06-18T02:10:49.538 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: CURRENT file: CURRENT 2024-06-18T02:10:49.538 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: IDENTITY file: IDENTITY 2024-06-18T02:10:49.538 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: MANIFEST file: MANIFEST-000009 size: 2245 Bytes 2024-06-18T02:10:49.538 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 1, files: 000045.sst 2024-06-18T02:10:49.538 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000043.log size: 614403 ; 2024-06-18T02:10:49.538 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.error_if_exists: 0 2024-06-18T02:10:49.538 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.create_if_missing: 0 2024-06-18T02:10:49.538 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.paranoid_checks: 1 2024-06-18T02:10:49.538 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.flush_verify_memtable_count: 1 2024-06-18T02:10:49.538 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-06-18T02:10:49.538 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-06-18T02:10:49.539 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.env: 0x563d5ed5f740 2024-06-18T02:10:49.539 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.fs: PosixFileSystem 2024-06-18T02:10:49.539 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.info_log: 0x563d6097b000 2024-06-18T02:10:49.539 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.max_file_opening_threads: 16 2024-06-18T02:10:49.539 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.statistics: (nil) 2024-06-18T02:10:49.540 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.use_fsync: 0 2024-06-18T02:10:49.540 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.max_log_file_size: 0 2024-06-18T02:10:49.540 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-06-18T02:10:49.540 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.log_file_time_to_roll: 0 2024-06-18T02:10:49.540 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.keep_log_file_num: 1000 2024-06-18T02:10:49.540 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.recycle_log_file_num: 0 2024-06-18T02:10:49.540 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.allow_fallocate: 1 2024-06-18T02:10:49.541 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.allow_mmap_reads: 0 2024-06-18T02:10:49.541 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.allow_mmap_writes: 0 2024-06-18T02:10:49.541 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.use_direct_reads: 0 2024-06-18T02:10:49.541 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-06-18T02:10:49.541 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.create_missing_column_families: 0 2024-06-18T02:10:49.541 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.db_log_dir: 2024-06-18T02:10:49.541 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.wal_dir: 2024-06-18T02:10:49.541 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.table_cache_numshardbits: 6 2024-06-18T02:10:49.541 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.WAL_ttl_seconds: 0 2024-06-18T02:10:49.541 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.WAL_size_limit_MB: 0 2024-06-18T02:10:49.541 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-06-18T02:10:49.541 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-06-18T02:10:49.541 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.is_fd_close_on_exec: 1 2024-06-18T02:10:49.541 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.advise_random_on_open: 1 2024-06-18T02:10:49.541 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.db_write_buffer_size: 0 2024-06-18T02:10:49.542 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.write_buffer_manager: 0x563d6098a1e0 2024-06-18T02:10:49.542 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-06-18T02:10:49.542 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-06-18T02:10:49.542 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.use_adaptive_mutex: 0 2024-06-18T02:10:49.542 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.rate_limiter: (nil) 2024-06-18T02:10:49.542 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-06-18T02:10:49.542 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.wal_recovery_mode: 2 2024-06-18T02:10:49.542 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.enable_thread_tracking: 0 2024-06-18T02:10:49.542 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.enable_pipelined_write: 0 2024-06-18T02:10:49.542 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.unordered_write: 0 2024-06-18T02:10:49.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-06-18T02:10:49.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-06-18T02:10:49.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-06-18T02:10:49.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-06-18T02:10:49.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.row_cache: None 2024-06-18T02:10:49.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.wal_filter: None 2024-06-18T02:10:49.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-06-18T02:10:49.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.allow_ingest_behind: 0 2024-06-18T02:10:49.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.two_write_queues: 0 2024-06-18T02:10:49.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.manual_wal_flush: 0 2024-06-18T02:10:49.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.wal_compression: 0 2024-06-18T02:10:49.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.atomic_flush: 0 2024-06-18T02:10:49.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-06-18T02:10:49.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.persist_stats_to_disk: 0 2024-06-18T02:10:49.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.write_dbid_to_manifest: 0 2024-06-18T02:10:49.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.log_readahead_size: 0 2024-06-18T02:10:49.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-06-18T02:10:49.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.best_efforts_recovery: 0 2024-06-18T02:10:49.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-06-18T02:10:49.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-06-18T02:10:49.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.allow_data_in_errors: 0 2024-06-18T02:10:49.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.db_host_id: __hostname__ 2024-06-18T02:10:49.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.enforce_single_del_contracts: true 2024-06-18T02:10:49.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.max_background_jobs: 2 2024-06-18T02:10:49.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.max_background_compactions: -1 2024-06-18T02:10:49.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.max_subcompactions: 1 2024-06-18T02:10:49.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-06-18T02:10:49.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-06-18T02:10:49.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.delayed_write_rate : 16777216 2024-06-18T02:10:49.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.max_total_wal_size: 0 2024-06-18T02:10:49.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-06-18T02:10:49.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.stats_dump_period_sec: 600 2024-06-18T02:10:49.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.stats_persist_period_sec: 600 2024-06-18T02:10:49.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-06-18T02:10:49.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.max_open_files: -1 2024-06-18T02:10:49.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.bytes_per_sync: 0 2024-06-18T02:10:49.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.wal_bytes_per_sync: 0 2024-06-18T02:10:49.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.strict_bytes_per_sync: 0 2024-06-18T02:10:49.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.compaction_readahead_size: 0 2024-06-18T02:10:49.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.max_background_flushes: -1 2024-06-18T02:10:49.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Compression algorithms supported: 2024-06-18T02:10:49.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: kZSTD supported: 0 2024-06-18T02:10:49.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: kXpressCompression supported: 0 2024-06-18T02:10:49.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: kBZip2Compression supported: 0 2024-06-18T02:10:49.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-06-18T02:10:49.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: kLZ4Compression supported: 1 2024-06-18T02:10:49.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: kZlibCompression supported: 1 2024-06-18T02:10:49.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: kLZ4HCCompression supported: 1 2024-06-18T02:10:49.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: kSnappyCompression supported: 1 2024-06-18T02:10:49.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Fast CRC32 supported: Supported on x86 2024-06-18T02:10:49.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: DMutex implementation: pthread_mutex_t 2024-06-18T02:10:49.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000009 2024-06-18T02:10:49.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-06-18T02:10:49.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-06-18T02:10:49.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.merge_operator: 2024-06-18T02:10:49.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.compaction_filter: None 2024-06-18T02:10:49.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.compaction_filter_factory: None 2024-06-18T02:10:49.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.sst_partitioner_factory: None 2024-06-18T02:10:49.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.memtable_factory: SkipListFactory 2024-06-18T02:10:49.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.table_factory: BlockBasedTable 2024-06-18T02:10:49.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x563d6097ad00) 2024-06-18T02:10:49.547 INFO:journalctl@ceph.mon.b.smithi130.stdout: cache_index_and_filter_blocks: 1 2024-06-18T02:10:49.547 INFO:journalctl@ceph.mon.b.smithi130.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-06-18T02:10:49.547 INFO:journalctl@ceph.mon.b.smithi130.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-06-18T02:10:49.547 INFO:journalctl@ceph.mon.b.smithi130.stdout: pin_top_level_index_and_filter: 1 2024-06-18T02:10:49.547 INFO:journalctl@ceph.mon.b.smithi130.stdout: index_type: 0 2024-06-18T02:10:49.547 INFO:journalctl@ceph.mon.b.smithi130.stdout: data_block_index_type: 0 2024-06-18T02:10:49.547 INFO:journalctl@ceph.mon.b.smithi130.stdout: index_shortening: 1 2024-06-18T02:10:49.547 INFO:journalctl@ceph.mon.b.smithi130.stdout: data_block_hash_table_util_ratio: 0.750000 2024-06-18T02:10:49.548 INFO:journalctl@ceph.mon.b.smithi130.stdout: checksum: 4 2024-06-18T02:10:49.548 INFO:journalctl@ceph.mon.b.smithi130.stdout: no_block_cache: 0 2024-06-18T02:10:49.548 INFO:journalctl@ceph.mon.b.smithi130.stdout: block_cache: 0x563d60971090 2024-06-18T02:10:49.548 INFO:journalctl@ceph.mon.b.smithi130.stdout: block_cache_name: BinnedLRUCache 2024-06-18T02:10:49.548 INFO:journalctl@ceph.mon.b.smithi130.stdout: block_cache_options: 2024-06-18T02:10:49.548 INFO:journalctl@ceph.mon.b.smithi130.stdout: capacity : 536870912 2024-06-18T02:10:49.548 INFO:journalctl@ceph.mon.b.smithi130.stdout: num_shard_bits : 4 2024-06-18T02:10:49.548 INFO:journalctl@ceph.mon.b.smithi130.stdout: strict_capacity_limit : 0 2024-06-18T02:10:49.548 INFO:journalctl@ceph.mon.b.smithi130.stdout: high_pri_pool_ratio: 0.000 2024-06-18T02:10:49.548 INFO:journalctl@ceph.mon.b.smithi130.stdout: block_cache_compressed: (nil) 2024-06-18T02:10:49.548 INFO:journalctl@ceph.mon.b.smithi130.stdout: persistent_cache: (nil) 2024-06-18T02:10:49.548 INFO:journalctl@ceph.mon.b.smithi130.stdout: block_size: 4096 2024-06-18T02:10:49.548 INFO:journalctl@ceph.mon.b.smithi130.stdout: block_size_deviation: 10 2024-06-18T02:10:49.548 INFO:journalctl@ceph.mon.b.smithi130.stdout: block_restart_interval: 16 2024-06-18T02:10:49.549 INFO:journalctl@ceph.mon.b.smithi130.stdout: index_block_restart_interval: 1 2024-06-18T02:10:49.549 INFO:journalctl@ceph.mon.b.smithi130.stdout: metadata_block_size: 4096 2024-06-18T02:10:49.549 INFO:journalctl@ceph.mon.b.smithi130.stdout: partition_filters: 0 2024-06-18T02:10:49.549 INFO:journalctl@ceph.mon.b.smithi130.stdout: use_delta_encoding: 1 2024-06-18T02:10:49.549 INFO:journalctl@ceph.mon.b.smithi130.stdout: filter_policy: bloomfilter 2024-06-18T02:10:49.549 INFO:journalctl@ceph.mon.b.smithi130.stdout: whole_key_filtering: 1 2024-06-18T02:10:49.549 INFO:journalctl@ceph.mon.b.smithi130.stdout: verify_compression: 0 2024-06-18T02:10:49.549 INFO:journalctl@ceph.mon.b.smithi130.stdout: read_amp_bytes_per_bit: 0 2024-06-18T02:10:49.549 INFO:journalctl@ceph.mon.b.smithi130.stdout: format_version: 5 2024-06-18T02:10:49.549 INFO:journalctl@ceph.mon.b.smithi130.stdout: enable_index_compression: 1 2024-06-18T02:10:49.549 INFO:journalctl@ceph.mon.b.smithi130.stdout: block_align: 0 2024-06-18T02:10:49.549 INFO:journalctl@ceph.mon.b.smithi130.stdout: max_auto_readahead_size: 262144 2024-06-18T02:10:49.549 INFO:journalctl@ceph.mon.b.smithi130.stdout: prepopulate_block_cache: 0 2024-06-18T02:10:49.549 INFO:journalctl@ceph.mon.b.smithi130.stdout: initial_auto_readahead_size: 8192 2024-06-18T02:10:49.549 INFO:journalctl@ceph.mon.b.smithi130.stdout: num_file_reads_for_auto_readahead: 2 2024-06-18T02:10:49.550 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.write_buffer_size: 33554432 2024-06-18T02:10:49.550 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.max_write_buffer_number: 2 2024-06-18T02:10:49.550 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.compression: NoCompression 2024-06-18T02:10:49.550 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.bottommost_compression: Disabled 2024-06-18T02:10:49.550 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.prefix_extractor: nullptr 2024-06-18T02:10:49.550 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-06-18T02:10:49.550 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.num_levels: 7 2024-06-18T02:10:49.550 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-06-18T02:10:49.550 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-06-18T02:10:49.550 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-06-18T02:10:49.550 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-06-18T02:10:49.550 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-06-18T02:10:49.550 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-06-18T02:10:49.551 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-06-18T02:10:49.551 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-06-18T02:10:49.551 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-06-18T02:10:49.551 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-06-18T02:10:49.551 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-06-18T02:10:49.551 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-06-18T02:10:49.551 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.compression_opts.window_bits: -14 2024-06-18T02:10:49.551 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.compression_opts.level: 32767 2024-06-18T02:10:49.551 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.compression_opts.strategy: 0 2024-06-18T02:10:49.551 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-06-18T02:10:49.551 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-06-18T02:10:49.551 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-06-18T02:10:49.551 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-06-18T02:10:49.551 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.compression_opts.enabled: false 2024-06-18T02:10:49.552 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-06-18T02:10:49.552 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-06-18T02:10:49.552 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-06-18T02:10:49.552 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-06-18T02:10:49.552 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.target_file_size_base: 67108864 2024-06-18T02:10:49.552 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.target_file_size_multiplier: 1 2024-06-18T02:10:49.552 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-06-18T02:10:49.552 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-06-18T02:10:49.552 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-06-18T02:10:49.552 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-06-18T02:10:49.552 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-06-18T02:10:49.552 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-06-18T02:10:49.552 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-06-18T02:10:49.552 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-06-18T02:10:49.553 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-06-18T02:10:49.553 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-06-18T02:10:49.553 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-06-18T02:10:49.553 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-06-18T02:10:49.553 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-06-18T02:10:49.553 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.arena_block_size: 1048576 2024-06-18T02:10:49.553 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-06-18T02:10:49.553 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-06-18T02:10:49.553 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.disable_auto_compactions: 0 2024-06-18T02:10:49.553 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-06-18T02:10:49.553 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-06-18T02:10:49.553 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-06-18T02:10:49.553 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-06-18T02:10:49.554 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-06-18T02:10:49.554 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-06-18T02:10:49.554 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-06-18T02:10:49.554 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-06-18T02:10:49.554 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-06-18T02:10:49.554 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-06-18T02:10:49.554 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.table_properties_collectors: 2024-06-18T02:10:49.554 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.inplace_update_support: 0 2024-06-18T02:10:49.554 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.inplace_update_num_locks: 10000 2024-06-18T02:10:49.554 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-06-18T02:10:49.554 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-06-18T02:10:49.554 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.memtable_huge_page_size: 0 2024-06-18T02:10:49.554 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.bloom_locality: 0 2024-06-18T02:10:49.554 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.max_successive_merges: 0 2024-06-18T02:10:49.555 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.optimize_filters_for_hits: 0 2024-06-18T02:10:49.555 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.paranoid_file_checks: 0 2024-06-18T02:10:49.555 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.force_consistency_checks: 1 2024-06-18T02:10:49.555 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.report_bg_io_stats: 0 2024-06-18T02:10:49.555 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.ttl: 2592000 2024-06-18T02:10:49.555 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.periodic_compaction_seconds: 0 2024-06-18T02:10:49.555 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-06-18T02:10:49.555 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-06-18T02:10:49.555 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.enable_blob_files: false 2024-06-18T02:10:49.555 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.min_blob_size: 0 2024-06-18T02:10:49.555 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.blob_file_size: 268435456 2024-06-18T02:10:49.555 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.blob_compression_type: NoCompression 2024-06-18T02:10:49.555 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.enable_blob_garbage_collection: false 2024-06-18T02:10:49.555 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-06-18T02:10:49.556 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-06-18T02:10:49.556 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-06-18T02:10:49.556 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.blob_file_starting_level: 0 2024-06-18T02:10:49.556 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-06-18T02:10:49.556 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 45.sst 2024-06-18T02:10:49.556 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-06-18T02:10:49.556 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 47, last_sequence is 29560, log_number is 43,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-06-18T02:10:49.556 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 43 2024-06-18T02:10:49.556 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: c570c20c-4eba-42e5-84d3-6b522ebcc54b 2024-06-18T02:10:49.556 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: EVENT_LOG_v1 {"time_micros": 1718676649270024, "job": 1, "event": "recovery_started", "wal_files": [43]} 2024-06-18T02:10:49.556 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #43 mode 2 2024-06-18T02:10:49.556 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: EVENT_LOG_v1 {"time_micros": 1718676649272205, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 48, "file_size": 370176, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 29565, "largest_seqno": 29952, "table_properties": {"data_size": 367761, "index_size": 825, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 5053, "raw_average_key_size": 24, "raw_value_size": 363887, "raw_average_value_size": 1775, "num_data_blocks": 35, "num_entries": 205, "num_filter_entries": 205, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1718676649, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "c570c20c-4eba-42e5-84d3-6b522ebcc54b", "db_session_id": "X7E0JP58V5BUNPGZQNJ8", "orig_file_number": 48, "seqno_to_time_mapping": "N/A"}} 2024-06-18T02:10:49.556 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: EVENT_LOG_v1 {"time_micros": 1718676649272305, "job": 1, "event": "recovery_finished"} 2024-06-18T02:10:49.556 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: [db/version_set.cc:5047] Creating manifest 50 2024-06-18T02:10:49.556 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-06-18T02:10:49.557 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000043.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-06-18T02:10:49.557 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x563d6099ee00 2024-06-18T02:10:49.557 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: DB pointer 0x563d60a94000 2024-06-18T02:10:49.557 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-06-18T02:10:49.557 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-06-18T02:10:49.557 INFO:journalctl@ceph.mon.b.smithi130.stdout: ** DB Stats ** 2024-06-18T02:10:49.557 INFO:journalctl@ceph.mon.b.smithi130.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-18T02:10:49.557 INFO:journalctl@ceph.mon.b.smithi130.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-06-18T02:10:49.557 INFO:journalctl@ceph.mon.b.smithi130.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-18T02:10:49.557 INFO:journalctl@ceph.mon.b.smithi130.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-18T02:10:49.557 INFO:journalctl@ceph.mon.b.smithi130.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-06-18T02:10:49.557 INFO:journalctl@ceph.mon.b.smithi130.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-18T02:10:49.558 INFO:journalctl@ceph.mon.b.smithi130.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-18T02:10:49.558 INFO:journalctl@ceph.mon.b.smithi130.stdout: 2024-06-18T02:10:49.558 INFO:journalctl@ceph.mon.b.smithi130.stdout: ** Compaction Stats [default] ** 2024-06-18T02:10:49.558 INFO:journalctl@ceph.mon.b.smithi130.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-06-18T02:10:49.558 INFO:journalctl@ceph.mon.b.smithi130.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-06-18T02:10:49.558 INFO:journalctl@ceph.mon.b.smithi130.stdout: L0 1/0 361.50 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 299.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-06-18T02:10:49.558 INFO:journalctl@ceph.mon.b.smithi130.stdout: L6 1/0 10.75 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-06-18T02:10:49.558 INFO:journalctl@ceph.mon.b.smithi130.stdout: Sum 2/0 11.11 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 299.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-06-18T02:10:49.558 INFO:journalctl@ceph.mon.b.smithi130.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 299.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-06-18T02:10:49.558 INFO:journalctl@ceph.mon.b.smithi130.stdout: 2024-06-18T02:10:49.558 INFO:journalctl@ceph.mon.b.smithi130.stdout: ** Compaction Stats [default] ** 2024-06-18T02:10:49.558 INFO:journalctl@ceph.mon.b.smithi130.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-06-18T02:10:49.558 INFO:journalctl@ceph.mon.b.smithi130.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-06-18T02:10:49.559 INFO:journalctl@ceph.mon.b.smithi130.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 299.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-06-18T02:10:49.559 INFO:journalctl@ceph.mon.b.smithi130.stdout: 2024-06-18T02:10:49.559 INFO:journalctl@ceph.mon.b.smithi130.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-06-18T02:10:49.559 INFO:journalctl@ceph.mon.b.smithi130.stdout: 2024-06-18T02:10:49.559 INFO:journalctl@ceph.mon.b.smithi130.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-18T02:10:49.559 INFO:journalctl@ceph.mon.b.smithi130.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-06-18T02:10:49.559 INFO:journalctl@ceph.mon.b.smithi130.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-06-18T02:10:49.559 INFO:journalctl@ceph.mon.b.smithi130.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-06-18T02:10:49.559 INFO:journalctl@ceph.mon.b.smithi130.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-06-18T02:10:49.559 INFO:journalctl@ceph.mon.b.smithi130.stdout: AddFile(Keys): cumulative 0, interval 0 2024-06-18T02:10:49.559 INFO:journalctl@ceph.mon.b.smithi130.stdout: Cumulative compaction: 0.00 GB write, 53.47 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-18T02:10:49.559 INFO:journalctl@ceph.mon.b.smithi130.stdout: Interval compaction: 0.00 GB write, 53.47 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-18T02:10:49.559 INFO:journalctl@ceph.mon.b.smithi130.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-06-18T02:10:49.559 INFO:journalctl@ceph.mon.b.smithi130.stdout: Block cache BinnedLRUCache@0x563d60971090#2 capacity: 512.00 MB usage: 1.61 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-06-18T02:10:49.559 INFO:journalctl@ceph.mon.b.smithi130.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.66 KB,0.00012517%) IndexBlock(1,0.95 KB,0.000181794%) Misc(1,0.00 KB,0%) 2024-06-18T02:10:49.560 INFO:journalctl@ceph.mon.b.smithi130.stdout: 2024-06-18T02:10:49.560 INFO:journalctl@ceph.mon.b.smithi130.stdout: ** File Read Latency Histogram By Level [default] ** 2024-06-18T02:10:49.560 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: starting mon.b rank 2 at public addrs [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] at bind addrs [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 2024-06-18T02:10:49.560 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: mon.b@-1(???) e3 preinit fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 2024-06-18T02:10:49.560 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: mon.b@-1(???).mds e1 new map 2024-06-18T02:10:49.560 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: mon.b@-1(???).mds e1 print_map 2024-06-18T02:10:49.560 INFO:journalctl@ceph.mon.b.smithi130.stdout: e1 2024-06-18T02:10:49.560 INFO:journalctl@ceph.mon.b.smithi130.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-06-18T02:10:49.560 INFO:journalctl@ceph.mon.b.smithi130.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-18T02:10:49.560 INFO:journalctl@ceph.mon.b.smithi130.stdout: legacy client fscid: -1 2024-06-18T02:10:49.560 INFO:journalctl@ceph.mon.b.smithi130.stdout: 2024-06-18T02:10:49.560 INFO:journalctl@ceph.mon.b.smithi130.stdout: No filesystems configured 2024-06-18T02:10:49.560 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: mon.b@-1(???).osd e115 crush map has features 3314933000854323200, adjusting msgr requires 2024-06-18T02:10:49.560 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: mon.b@-1(???).osd e115 crush map has features 432629239337189376, adjusting msgr requires 2024-06-18T02:10:49.561 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: mon.b@-1(???).osd e115 crush map has features 432629239337189376, adjusting msgr requires 2024-06-18T02:10:49.561 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: mon.b@-1(???).osd e115 crush map has features 432629239337189376, adjusting msgr requires 2024-06-18T02:10:49.561 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 ceph-mon[84407]: mon.b@-1(???).paxosservice(auth 1..27) refresh upgraded, format 0 -> 3 2024-06-18T02:10:49.561 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 bash[84387]: baacf2add994e89cba2a7722dc5b0adcbabc1935ed9b1e00c060f803e5cb01e5 2024-06-18T02:10:49.561 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:49 smithi130 systemd[1]: Started Ceph mon.b for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:10:50.988 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-18T02:10:50.989 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-18T02:10:50.989 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-18T02:10:51.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:50 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-18T02:10:51.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:50 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-18T02:10:51.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:50 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-18T02:10:51.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-18T02:10:51.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-18T02:10:51.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-18T02:10:51.710 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[73500]: osdmap e115: 8 total, 8 up, 8 in 2024-06-18T02:10:51.710 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[73500]: mgrmap e47: x(active, since 2m), standbys: y 2024-06-18T02:10:51.710 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[73500]: overall HEALTH_OK 2024-06-18T02:10:51.710 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[73500]: mon.a calling monitor election 2024-06-18T02:10:51.711 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[99735]: osdmap e115: 8 total, 8 up, 8 in 2024-06-18T02:10:51.711 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[99735]: mgrmap e47: x(active, since 2m), standbys: y 2024-06-18T02:10:51.711 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[99735]: overall HEALTH_OK 2024-06-18T02:10:51.711 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[99735]: mon.a calling monitor election 2024-06-18T02:10:51.711 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[99735]: mon.c calling monitor election 2024-06-18T02:10:51.711 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[99735]: mon.b calling monitor election 2024-06-18T02:10:51.711 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-18T02:10:51.711 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-18T02:10:51.711 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-18T02:10:51.711 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[99735]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-06-18T02:10:51.711 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[99735]: monmap epoch 4 2024-06-18T02:10:52.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:51 smithi130 ceph-mon[84407]: osdmap e115: 8 total, 8 up, 8 in 2024-06-18T02:10:52.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:51 smithi130 ceph-mon[84407]: mgrmap e47: x(active, since 2m), standbys: y 2024-06-18T02:10:52.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:51 smithi130 ceph-mon[84407]: overall HEALTH_OK 2024-06-18T02:10:52.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:51 smithi130 ceph-mon[84407]: mon.a calling monitor election 2024-06-18T02:10:52.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:51 smithi130 ceph-mon[84407]: mon.c calling monitor election 2024-06-18T02:10:52.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:51 smithi130 ceph-mon[84407]: mon.b calling monitor election 2024-06-18T02:10:52.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-18T02:10:52.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-18T02:10:52.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-18T02:10:52.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:51 smithi130 ceph-mon[84407]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-06-18T02:10:52.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:51 smithi130 ceph-mon[84407]: monmap epoch 4 2024-06-18T02:10:52.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:51 smithi130 ceph-mon[84407]: fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 2024-06-18T02:10:52.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:51 smithi130 ceph-mon[84407]: last_changed 2024-06-18T02:10:50.706088+0000 2024-06-18T02:10:52.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:51 smithi130 ceph-mon[84407]: created 2024-06-18T01:55:37.939231+0000 2024-06-18T02:10:52.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:51 smithi130 ceph-mon[84407]: min_mon_release 19 (squid) 2024-06-18T02:10:52.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:51 smithi130 ceph-mon[84407]: election_strategy: 1 2024-06-18T02:10:52.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:51 smithi130 ceph-mon[84407]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-06-18T02:10:52.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:51 smithi130 ceph-mon[84407]: 1: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-06-18T02:10:52.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:51 smithi130 ceph-mon[84407]: 2: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-06-18T02:10:52.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:51 smithi130 ceph-mon[84407]: fsmap 2024-06-18T02:10:52.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:51 smithi130 ceph-mon[84407]: osdmap e115: 8 total, 8 up, 8 in 2024-06-18T02:10:52.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:51 smithi130 ceph-mon[84407]: mgrmap e47: x(active, since 2m), standbys: y 2024-06-18T02:10:52.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:51 smithi130 ceph-mon[84407]: overall HEALTH_OK 2024-06-18T02:10:52.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:10:52.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:10:52.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:10:52.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:10:52.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:52.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:52.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:10:52.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:10:52.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:51 smithi130 ceph-mon[84407]: Reconfiguring mon.a (monmap changed)... 2024-06-18T02:10:52.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-18T02:10:52.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-18T02:10:52.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:52.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:51 smithi130 ceph-mon[84407]: Reconfiguring daemon mon.a on smithi007 2024-06-18T02:10:52.080 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[73500]: mon.c calling monitor election 2024-06-18T02:10:52.080 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[73500]: mon.b calling monitor election 2024-06-18T02:10:52.081 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-18T02:10:52.081 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-18T02:10:52.081 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-18T02:10:52.081 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[73500]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-06-18T02:10:52.081 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[73500]: monmap epoch 4 2024-06-18T02:10:52.081 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[73500]: fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 2024-06-18T02:10:52.081 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[73500]: last_changed 2024-06-18T02:10:50.706088+0000 2024-06-18T02:10:52.081 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[73500]: created 2024-06-18T01:55:37.939231+0000 2024-06-18T02:10:52.081 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[73500]: min_mon_release 19 (squid) 2024-06-18T02:10:52.081 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[73500]: election_strategy: 1 2024-06-18T02:10:52.081 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[73500]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-06-18T02:10:52.081 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[73500]: 1: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-06-18T02:10:52.081 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[73500]: 2: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-06-18T02:10:52.081 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[73500]: fsmap 2024-06-18T02:10:52.082 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[73500]: osdmap e115: 8 total, 8 up, 8 in 2024-06-18T02:10:52.082 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[73500]: mgrmap e47: x(active, since 2m), standbys: y 2024-06-18T02:10:52.082 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[73500]: overall HEALTH_OK 2024-06-18T02:10:52.082 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:10:52.082 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:10:52.082 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:10:52.082 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:10:52.082 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:52.082 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:52.082 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:10:52.082 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:10:52.082 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[73500]: Reconfiguring mon.a (monmap changed)... 2024-06-18T02:10:52.082 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-18T02:10:52.083 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-18T02:10:52.083 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:52.083 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[73500]: Reconfiguring daemon mon.a on smithi007 2024-06-18T02:10:52.083 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[99735]: fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 2024-06-18T02:10:52.083 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[99735]: last_changed 2024-06-18T02:10:50.706088+0000 2024-06-18T02:10:52.083 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[99735]: created 2024-06-18T01:55:37.939231+0000 2024-06-18T02:10:52.083 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[99735]: min_mon_release 19 (squid) 2024-06-18T02:10:52.083 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[99735]: election_strategy: 1 2024-06-18T02:10:52.083 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[99735]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-06-18T02:10:52.083 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[99735]: 1: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-06-18T02:10:52.083 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[99735]: 2: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-06-18T02:10:52.083 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[99735]: fsmap 2024-06-18T02:10:52.084 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[99735]: osdmap e115: 8 total, 8 up, 8 in 2024-06-18T02:10:52.084 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[99735]: mgrmap e47: x(active, since 2m), standbys: y 2024-06-18T02:10:52.084 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[99735]: overall HEALTH_OK 2024-06-18T02:10:52.084 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:10:52.084 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:10:52.084 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:10:52.084 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:10:52.084 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:52.084 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:10:52.084 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:10:52.084 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:10:52.084 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[99735]: Reconfiguring mon.a (monmap changed)... 2024-06-18T02:10:52.084 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-18T02:10:52.085 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-18T02:10:52.085 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:52.085 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:51 smithi007 ceph-mon[99735]: Reconfiguring daemon mon.a on smithi007 2024-06-18T02:10:52.800 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:52 smithi007 ceph-mon[99735]: pgmap v82: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:10:52.800 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:52 smithi007 ceph-mon[99735]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:10:52.800 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:10:52.800 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:10:52.801 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-18T02:10:52.801 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-18T02:10:52.801 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:52.801 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:52 smithi007 ceph-mon[73500]: pgmap v82: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:10:52.801 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:52 smithi007 ceph-mon[73500]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:10:52.801 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:52 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:10:52.801 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:52 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:10:52.801 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:52 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-18T02:10:52.801 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:52 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-18T02:10:52.801 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:52 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:53.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:52 smithi130 ceph-mon[84407]: pgmap v82: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:10:53.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:52 smithi130 ceph-mon[84407]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:10:53.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:10:53.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:10:53.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-18T02:10:53.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-18T02:10:53.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:53.793 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:10:53 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:10:53.505Z caller=manager.go:609 level=warn component="rule manager" group=nodes msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on(instance) group_left(nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi007\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"cd9a3408-2d15-11ef-bc9d-c7b262605968\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-06-18T02:10:53.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:53 smithi130 ceph-mon[84407]: Reconfiguring mgr.y (monmap changed)... 2024-06-18T02:10:53.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:53 smithi130 ceph-mon[84407]: Reconfiguring daemon mgr.y on smithi007 2024-06-18T02:10:53.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:10:53.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:10:53.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-18T02:10:53.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-18T02:10:53.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:53.921 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:53 smithi007 ceph-mon[73500]: Reconfiguring mgr.y (monmap changed)... 2024-06-18T02:10:53.921 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:53 smithi007 ceph-mon[73500]: Reconfiguring daemon mgr.y on smithi007 2024-06-18T02:10:53.921 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:53 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:10:53.921 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:53 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:10:53.921 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:53 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-18T02:10:53.921 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:53 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-18T02:10:53.921 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:53 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:53.921 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:53 smithi007 ceph-mon[99735]: Reconfiguring mgr.y (monmap changed)... 2024-06-18T02:10:53.922 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:53 smithi007 ceph-mon[99735]: Reconfiguring daemon mgr.y on smithi007 2024-06-18T02:10:53.922 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:10:53.922 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:10:53.922 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-18T02:10:53.922 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-18T02:10:53.922 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:54.543 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:10:54 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:10:54.285+0000 7f680f9b8640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-06-18T02:10:54.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:54 smithi007 ceph-mon[73500]: Reconfiguring mon.c (monmap changed)... 2024-06-18T02:10:54.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:54 smithi007 ceph-mon[73500]: Reconfiguring daemon mon.c on smithi007 2024-06-18T02:10:54.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:54 smithi007 ceph-mon[73500]: pgmap v83: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:10:54.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:54 smithi007 ceph-mon[99735]: Reconfiguring mon.c (monmap changed)... 2024-06-18T02:10:54.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:54 smithi007 ceph-mon[99735]: Reconfiguring daemon mon.c on smithi007 2024-06-18T02:10:54.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:54 smithi007 ceph-mon[99735]: pgmap v83: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:10:55.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:54 smithi130 ceph-mon[84407]: Reconfiguring mon.c (monmap changed)... 2024-06-18T02:10:55.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:54 smithi130 ceph-mon[84407]: Reconfiguring daemon mon.c on smithi007 2024-06-18T02:10:55.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:54 smithi130 ceph-mon[84407]: pgmap v83: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:10:56.157 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:55 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:10:56.158 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:55 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:10:56.158 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:55 smithi007 ceph-mon[73500]: Reconfiguring osd.0 (monmap changed)... 2024-06-18T02:10:56.158 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:55 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-06-18T02:10:56.158 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:55 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:56.158 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:55 smithi007 ceph-mon[73500]: Reconfiguring daemon osd.0 on smithi007 2024-06-18T02:10:56.158 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:10:56.158 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:10:56.158 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:55 smithi007 ceph-mon[99735]: Reconfiguring osd.0 (monmap changed)... 2024-06-18T02:10:56.158 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-06-18T02:10:56.159 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:56.159 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:55 smithi007 ceph-mon[99735]: Reconfiguring daemon osd.0 on smithi007 2024-06-18T02:10:56.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:10:56.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:10:56.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:55 smithi130 ceph-mon[84407]: Reconfiguring osd.0 (monmap changed)... 2024-06-18T02:10:56.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-06-18T02:10:56.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:56.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:55 smithi130 ceph-mon[84407]: Reconfiguring daemon osd.0 on smithi007 2024-06-18T02:10:56.894 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:56 smithi007 ceph-mon[73500]: pgmap v84: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:10:56.894 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:56 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:10:56.895 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:56 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:10:56.895 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:56 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:10:56.895 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:56 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-06-18T02:10:56.895 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:56 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:56.895 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:56 smithi007 ceph-mon[99735]: pgmap v84: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:10:56.895 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:10:56.895 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:10:56.895 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:10:56.895 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-06-18T02:10:56.895 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:57.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:56 smithi130 ceph-mon[84407]: pgmap v84: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:10:57.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:10:57.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:10:57.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:10:57.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-06-18T02:10:57.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:58.158 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:57 smithi007 ceph-mon[73500]: Reconfiguring osd.1 (monmap changed)... 2024-06-18T02:10:58.158 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:57 smithi007 ceph-mon[73500]: Reconfiguring daemon osd.1 on smithi007 2024-06-18T02:10:58.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:57 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:10:58.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:57 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:10:58.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:57 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-06-18T02:10:58.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:57 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:58.159 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:57 smithi007 ceph-mon[99735]: Reconfiguring osd.1 (monmap changed)... 2024-06-18T02:10:58.159 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:57 smithi007 ceph-mon[99735]: Reconfiguring daemon osd.1 on smithi007 2024-06-18T02:10:58.159 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:10:58.159 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:10:58.159 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-06-18T02:10:58.159 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:58.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:10:57 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:10:57] "GET /metrics HTTP/1.1" 200 38266 "" "Prometheus/2.33.4" 2024-06-18T02:10:58.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:57 smithi130 ceph-mon[84407]: Reconfiguring osd.1 (monmap changed)... 2024-06-18T02:10:58.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:57 smithi130 ceph-mon[84407]: Reconfiguring daemon osd.1 on smithi007 2024-06-18T02:10:58.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:10:58.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:10:58.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-06-18T02:10:58.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:10:59.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:58 smithi130 ceph-mon[84407]: Reconfiguring osd.2 (monmap changed)... 2024-06-18T02:10:59.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:58 smithi130 ceph-mon[84407]: Reconfiguring daemon osd.2 on smithi007 2024-06-18T02:10:59.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:58 smithi130 ceph-mon[84407]: pgmap v85: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:10:59.044 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:10:58 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:10:58.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.7\", device_class=\"ssd\", hostname=\"smithi007\", instance=\"172.21.15.130:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.7\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"cd9a3408-2d15-11ef-bc9d-c7b262605968\", cluster_addr=\"172.21.15.7\", device_class=\"ssd\", hostname=\"smithi007\", instance=\"smithi130:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.7\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-06-18T02:10:59.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:58 smithi007 ceph-mon[73500]: Reconfiguring osd.2 (monmap changed)... 2024-06-18T02:10:59.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:58 smithi007 ceph-mon[73500]: Reconfiguring daemon osd.2 on smithi007 2024-06-18T02:10:59.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:58 smithi007 ceph-mon[73500]: pgmap v85: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:10:59.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:58 smithi007 ceph-mon[99735]: Reconfiguring osd.2 (monmap changed)... 2024-06-18T02:10:59.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:58 smithi007 ceph-mon[99735]: Reconfiguring daemon osd.2 on smithi007 2024-06-18T02:10:59.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:58 smithi007 ceph-mon[99735]: pgmap v85: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:11:00.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:00.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:00.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:59 smithi130 ceph-mon[84407]: Reconfiguring osd.3 (monmap changed)... 2024-06-18T02:11:00.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-06-18T02:11:00.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:00.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:10:59 smithi130 ceph-mon[84407]: Reconfiguring daemon osd.3 on smithi007 2024-06-18T02:11:00.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:59 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:00.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:59 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:00.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:59 smithi007 ceph-mon[73500]: Reconfiguring osd.3 (monmap changed)... 2024-06-18T02:11:00.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:59 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-06-18T02:11:00.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:59 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:00.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:10:59 smithi007 ceph-mon[73500]: Reconfiguring daemon osd.3 on smithi007 2024-06-18T02:11:00.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:00.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:00.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:59 smithi007 ceph-mon[99735]: Reconfiguring osd.3 (monmap changed)... 2024-06-18T02:11:00.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-06-18T02:11:00.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:00.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:10:59 smithi007 ceph-mon[99735]: Reconfiguring daemon osd.3 on smithi007 2024-06-18T02:11:01.160 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:00 smithi007 ceph-mon[73500]: pgmap v86: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:11:01.160 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:00 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:01.160 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:00 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:01.160 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:00 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi007.dvbvbk", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-06-18T02:11:01.160 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:00 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:01.160 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:00 smithi007 ceph-mon[99735]: pgmap v86: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:11:01.160 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:01.160 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:01.161 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi007.dvbvbk", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-06-18T02:11:01.161 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:01.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:00 smithi130 ceph-mon[84407]: pgmap v86: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:11:01.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:01.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:01.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi007.dvbvbk", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-06-18T02:11:01.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:01.771 INFO:teuthology.orchestra.run.smithi007.stdout:true 2024-06-18T02:11:02.053 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:01 smithi007 ceph-mon[73500]: Reconfiguring rgw.foo.smithi007.dvbvbk (monmap changed)... 2024-06-18T02:11:02.053 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:01 smithi007 ceph-mon[73500]: Reconfiguring daemon rgw.foo.smithi007.dvbvbk on smithi007 2024-06-18T02:11:02.053 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:01 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:02.053 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:01 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:02.053 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:01 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi007.hgrnmk", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-06-18T02:11:02.053 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:01 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:02.053 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:01 smithi007 ceph-mon[99735]: Reconfiguring rgw.foo.smithi007.dvbvbk (monmap changed)... 2024-06-18T02:11:02.054 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:01 smithi007 ceph-mon[99735]: Reconfiguring daemon rgw.foo.smithi007.dvbvbk on smithi007 2024-06-18T02:11:02.054 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:02.054 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:02.054 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi007.hgrnmk", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-06-18T02:11:02.054 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:02.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:01 smithi130 ceph-mon[84407]: Reconfiguring rgw.foo.smithi007.dvbvbk (monmap changed)... 2024-06-18T02:11:02.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:01 smithi130 ceph-mon[84407]: Reconfiguring daemon rgw.foo.smithi007.dvbvbk on smithi007 2024-06-18T02:11:02.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:02.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:02.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi007.hgrnmk", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-06-18T02:11:02.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:02.461 INFO:teuthology.orchestra.run.smithi007.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-18T02:11:02.461 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi007 smithi007 running 18s ago 14m - - 2024-06-18T02:11:02.461 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi130 smithi130 running 12s ago 14m - - 2024-06-18T02:11:02.462 INFO:teuthology.orchestra.run.smithi007.stdout:alertmanager.a smithi007 *:9093,9094 running (3m) 18s ago 8m 24.0M - 0.23.0 ba2b418f427c 5994e8525c64 2024-06-18T02:11:02.462 INFO:teuthology.orchestra.run.smithi007.stdout:grafana.a smithi130 *:3000 running (3m) 12s ago 8m 49.4M - 8.3.5 dad864ee21e9 70ba81d97c8e 2024-06-18T02:11:02.462 INFO:teuthology.orchestra.run.smithi007.stdout:iscsi.foo.smithi007.xvdrwd smithi007 running (2m) 18s ago 7m 48.9M - 3.5 e1d6a67b021e 94121ad2702c 2024-06-18T02:11:02.462 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.x smithi130 *:8443,9283,8765 running (2m) 12s ago 13m 510M - 19.0.0-3124-g3781e3a5 af93c036e016 01017e37bdbe 2024-06-18T02:11:02.462 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.y smithi007 *:8443,9283,8765 running (76s) 18s ago 15m 440M - 19.0.0-3124-g3781e3a5 af93c036e016 2141e131e896 2024-06-18T02:11:02.462 INFO:teuthology.orchestra.run.smithi007.stdout:mon.a smithi007 running (2m) 18s ago 15m 61.3M 2048M 19.0.0-3124-g3781e3a5 af93c036e016 670d7777ae9b 2024-06-18T02:11:02.462 INFO:teuthology.orchestra.run.smithi007.stdout:mon.b smithi130 running (13m) 12s ago 13m 66.3M 2048M 17.2.0 e1d6a67b021e a0b38a9a595f 2024-06-18T02:11:02.462 INFO:teuthology.orchestra.run.smithi007.stdout:mon.c smithi007 running (34s) 18s ago 13m 37.1M 2048M 19.0.0-3124-g3781e3a5 af93c036e016 39418356156e 2024-06-18T02:11:02.462 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.a smithi007 *:9100 running (4m) 18s ago 9m 18.2M - 1.3.1 1dbe0e931976 8128e558f099 2024-06-18T02:11:02.462 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.b smithi130 *:9100 running (3m) 12s ago 9m 17.1M - 1.3.1 1dbe0e931976 bab93b43cf16 2024-06-18T02:11:02.462 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0 smithi007 running (13m) 18s ago 13m 54.9M 4096M 17.2.0 e1d6a67b021e 1ef6e23afd55 2024-06-18T02:11:02.462 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1 smithi007 running (12m) 18s ago 12m 56.5M 4096M 17.2.0 e1d6a67b021e a967706523cb 2024-06-18T02:11:02.463 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2 smithi007 running (12m) 18s ago 12m 51.0M 4096M 17.2.0 e1d6a67b021e 2c1b76bd0876 2024-06-18T02:11:02.463 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3 smithi007 running (11m) 18s ago 11m 54.9M 4096M 17.2.0 e1d6a67b021e 8b91b2a07564 2024-06-18T02:11:02.463 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4 smithi130 running (11m) 12s ago 11m 56.4M 4096M 17.2.0 e1d6a67b021e c428dccffdf0 2024-06-18T02:11:02.463 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5 smithi130 running (11m) 12s ago 11m 54.5M 4096M 17.2.0 e1d6a67b021e f645d7f12378 2024-06-18T02:11:02.463 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6 smithi130 running (10m) 12s ago 10m 50.9M 4096M 17.2.0 e1d6a67b021e c7af86c14959 2024-06-18T02:11:02.463 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7 smithi130 running (10m) 12s ago 10m 54.2M 4096M 17.2.0 e1d6a67b021e 3688af8b2c46 2024-06-18T02:11:02.463 INFO:teuthology.orchestra.run.smithi007.stdout:prometheus.a smithi130 *:9095 running (2m) 12s ago 9m 64.4M - 2.33.4 514e6a882f6e e905fb2eb4a6 2024-06-18T02:11:02.463 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi007.dvbvbk smithi007 *:8000 running (7m) 18s ago 7m 76.4M - 17.2.0 e1d6a67b021e 1344b55b763c 2024-06-18T02:11:02.463 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi130.aakmof smithi130 *:8000 running (7m) 12s ago 7m 73.9M - 17.2.0 e1d6a67b021e e257e3230c6c 2024-06-18T02:11:02.463 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi007.hgrnmk smithi007 *:80 running (7m) 18s ago 7m 74.6M - 17.2.0 e1d6a67b021e 2173947bc4d6 2024-06-18T02:11:02.463 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi130.wwebfk smithi130 *:80 running (7m) 12s ago 7m 76.0M - 17.2.0 e1d6a67b021e 8662706b2231 2024-06-18T02:11:02.885 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:11:02.925 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": { 2024-06-18T02:11:02.926 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 3 2024-06-18T02:11:02.926 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:11:02.926 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": { 2024-06-18T02:11:02.926 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 2 2024-06-18T02:11:02.926 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:11:02.926 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": { 2024-06-18T02:11:02.926 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-06-18T02:11:02.926 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:11:02.926 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw": { 2024-06-18T02:11:02.926 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-06-18T02:11:02.926 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:11:02.927 INFO:teuthology.orchestra.run.smithi007.stdout: "overall": { 2024-06-18T02:11:02.927 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 12, 2024-06-18T02:11:02.927 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 5 2024-06-18T02:11:02.927 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-06-18T02:11:02.927 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:11:03.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:02 smithi007 ceph-mon[73500]: Reconfiguring rgw.smpl.smithi007.hgrnmk (monmap changed)... 2024-06-18T02:11:03.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:02 smithi007 ceph-mon[73500]: Reconfiguring daemon rgw.smpl.smithi007.hgrnmk on smithi007 2024-06-18T02:11:03.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:02 smithi007 ceph-mon[73500]: from='client.54103 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:11:03.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:02 smithi007 ceph-mon[73500]: pgmap v87: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:11:03.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:02 smithi007 ceph-mon[73500]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:11:03.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:02 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:03.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:02 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:03.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:02 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-18T02:11:03.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:02 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-18T02:11:03.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:02 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:03.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:02 smithi007 ceph-mon[99735]: Reconfiguring rgw.smpl.smithi007.hgrnmk (monmap changed)... 2024-06-18T02:11:03.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:02 smithi007 ceph-mon[99735]: Reconfiguring daemon rgw.smpl.smithi007.hgrnmk on smithi007 2024-06-18T02:11:03.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:02 smithi007 ceph-mon[99735]: from='client.54103 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:11:03.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:02 smithi007 ceph-mon[99735]: pgmap v87: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:11:03.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:02 smithi007 ceph-mon[99735]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:11:03.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:03.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:03.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-18T02:11:03.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-18T02:11:03.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:03.213 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:02 smithi130 ceph-mon[84407]: Reconfiguring rgw.smpl.smithi007.hgrnmk (monmap changed)... 2024-06-18T02:11:03.213 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:02 smithi130 ceph-mon[84407]: Reconfiguring daemon rgw.smpl.smithi007.hgrnmk on smithi007 2024-06-18T02:11:03.213 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:02 smithi130 ceph-mon[84407]: from='client.54103 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:11:03.213 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:02 smithi130 ceph-mon[84407]: pgmap v87: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:11:03.213 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:02 smithi130 ceph-mon[84407]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:11:03.214 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:03.214 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:03.214 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-18T02:11:03.214 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-18T02:11:03.214 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:03.234 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:11:03.234 INFO:teuthology.orchestra.run.smithi007.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00", 2024-06-18T02:11:03.234 INFO:teuthology.orchestra.run.smithi007.stdout: "in_progress": true, 2024-06-18T02:11:03.234 INFO:teuthology.orchestra.run.smithi007.stdout: "which": "Upgrading all daemon types on all hosts", 2024-06-18T02:11:03.234 INFO:teuthology.orchestra.run.smithi007.stdout: "services_complete": [ 2024-06-18T02:11:03.234 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr" 2024-06-18T02:11:03.234 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-06-18T02:11:03.234 INFO:teuthology.orchestra.run.smithi007.stdout: "progress": "4/23 daemons upgraded", 2024-06-18T02:11:03.234 INFO:teuthology.orchestra.run.smithi007.stdout: "message": "Currently upgrading mon daemons", 2024-06-18T02:11:03.234 INFO:teuthology.orchestra.run.smithi007.stdout: "is_paused": false 2024-06-18T02:11:03.234 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:11:03.644 INFO:teuthology.orchestra.run.smithi007.stdout:HEALTH_OK 2024-06-18T02:11:03.793 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:11:03 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:11:03.505Z caller=manager.go:609 level=warn component="rule manager" group=nodes msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on(instance) group_left(nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi007\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"cd9a3408-2d15-11ef-bc9d-c7b262605968\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-06-18T02:11:03.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:03 smithi007 ceph-mon[99735]: from='client.34338 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:11:03.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:03 smithi007 ceph-mon[99735]: from='client.54115 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:11:03.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:03 smithi007 ceph-mon[99735]: Reconfiguring mon.b (monmap changed)... 2024-06-18T02:11:03.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:03 smithi007 ceph-mon[99735]: Reconfiguring daemon mon.b on smithi130 2024-06-18T02:11:03.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:03 smithi007 ceph-mon[99735]: from='client.? 172.21.15.7:0/248574273' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:03.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:03 smithi007 ceph-mon[99735]: from='client.? 172.21.15.7:0/157431707' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:11:03.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:03 smithi007 ceph-mon[73500]: from='client.34338 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:11:03.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:03 smithi007 ceph-mon[73500]: from='client.54115 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:11:03.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:03 smithi007 ceph-mon[73500]: Reconfiguring mon.b (monmap changed)... 2024-06-18T02:11:03.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:03 smithi007 ceph-mon[73500]: Reconfiguring daemon mon.b on smithi130 2024-06-18T02:11:03.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:03 smithi007 ceph-mon[73500]: from='client.? 172.21.15.7:0/248574273' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:03.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:03 smithi007 ceph-mon[73500]: from='client.? 172.21.15.7:0/157431707' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:11:04.145 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:03 smithi130 ceph-mon[84407]: from='client.34338 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:11:04.145 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:03 smithi130 ceph-mon[84407]: from='client.54115 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:11:04.145 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:03 smithi130 ceph-mon[84407]: Reconfiguring mon.b (monmap changed)... 2024-06-18T02:11:04.146 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:03 smithi130 ceph-mon[84407]: Reconfiguring daemon mon.b on smithi130 2024-06-18T02:11:04.146 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:03 smithi130 ceph-mon[84407]: from='client.? 172.21.15.7:0/248574273' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:04.146 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:03 smithi130 ceph-mon[84407]: from='client.? 172.21.15.7:0/157431707' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:11:05.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:04 smithi007 ceph-mon[73500]: from='client.54127 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:11:05.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:04 smithi007 ceph-mon[73500]: pgmap v88: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:11:05.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:04 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:05.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:04 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:05.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:04 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-18T02:11:05.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:04 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-18T02:11:05.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:04 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:05.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:04 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:05.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:04 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:05.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:04 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:05.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:04 smithi007 ceph-mon[99735]: from='client.54127 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:11:05.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:04 smithi007 ceph-mon[99735]: pgmap v88: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:11:05.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:05.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:05.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-18T02:11:05.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-18T02:11:05.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:05.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:05.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:05.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:05.254 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:04 smithi130 ceph-mon[84407]: from='client.54127 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:11:05.254 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:04 smithi130 ceph-mon[84407]: pgmap v88: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:11:05.254 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:05.254 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:05.254 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-18T02:11:05.254 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-18T02:11:05.254 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:05.255 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:05.255 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:05.255 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:05.921 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:05 smithi007 ceph-mon[73500]: Reconfiguring mgr.x (monmap changed)... 2024-06-18T02:11:05.921 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:05 smithi007 ceph-mon[73500]: Reconfiguring daemon mgr.x on smithi130 2024-06-18T02:11:05.921 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:05 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:05.921 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:05 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:05.921 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:05 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-06-18T02:11:05.921 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:05 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:05.922 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:05 smithi007 ceph-mon[99735]: Reconfiguring mgr.x (monmap changed)... 2024-06-18T02:11:05.922 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:05 smithi007 ceph-mon[99735]: Reconfiguring daemon mgr.x on smithi130 2024-06-18T02:11:05.922 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:05.922 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:05.922 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-06-18T02:11:05.922 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:06.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:05 smithi130 ceph-mon[84407]: Reconfiguring mgr.x (monmap changed)... 2024-06-18T02:11:06.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:05 smithi130 ceph-mon[84407]: Reconfiguring daemon mgr.x on smithi130 2024-06-18T02:11:06.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:06.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:06.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-06-18T02:11:06.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:06.926 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:06 smithi130 ceph-mon[84407]: Reconfiguring osd.4 (monmap changed)... 2024-06-18T02:11:06.927 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:06 smithi130 ceph-mon[84407]: Reconfiguring daemon osd.4 on smithi130 2024-06-18T02:11:06.927 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:06 smithi130 ceph-mon[84407]: pgmap v89: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:11:07.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:06 smithi007 ceph-mon[73500]: Reconfiguring osd.4 (monmap changed)... 2024-06-18T02:11:07.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:06 smithi007 ceph-mon[73500]: Reconfiguring daemon osd.4 on smithi130 2024-06-18T02:11:07.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:06 smithi007 ceph-mon[73500]: pgmap v89: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:11:07.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:06 smithi007 ceph-mon[99735]: Reconfiguring osd.4 (monmap changed)... 2024-06-18T02:11:07.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:06 smithi007 ceph-mon[99735]: Reconfiguring daemon osd.4 on smithi130 2024-06-18T02:11:07.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:06 smithi007 ceph-mon[99735]: pgmap v89: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:11:08.100 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:11:07 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:11:07] "GET /metrics HTTP/1.1" 200 38266 "" "Prometheus/2.33.4" 2024-06-18T02:11:08.101 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:08.101 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:08.101 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:08 smithi130 ceph-mon[84407]: Reconfiguring osd.5 (monmap changed)... 2024-06-18T02:11:08.101 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-06-18T02:11:08.101 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:08.101 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:08 smithi130 ceph-mon[84407]: Reconfiguring daemon osd.5 on smithi130 2024-06-18T02:11:08.303 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:08.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:08.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:08 smithi007 ceph-mon[73500]: Reconfiguring osd.5 (monmap changed)... 2024-06-18T02:11:08.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-06-18T02:11:08.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:08 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:08.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:08 smithi007 ceph-mon[73500]: Reconfiguring daemon osd.5 on smithi130 2024-06-18T02:11:08.304 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:08.304 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:08.304 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:08 smithi007 ceph-mon[99735]: Reconfiguring osd.5 (monmap changed)... 2024-06-18T02:11:08.304 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-06-18T02:11:08.304 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:08.304 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:08 smithi007 ceph-mon[99735]: Reconfiguring daemon osd.5 on smithi130 2024-06-18T02:11:08.746 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:11:08 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:11:08.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.7\", device_class=\"ssd\", hostname=\"smithi007\", instance=\"172.21.15.130:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.7\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"cd9a3408-2d15-11ef-bc9d-c7b262605968\", cluster_addr=\"172.21.15.7\", device_class=\"ssd\", hostname=\"smithi007\", instance=\"smithi130:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.7\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-06-18T02:11:09.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:09 smithi130 ceph-mon[84407]: pgmap v90: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:11:09.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:09 smithi007 ceph-mon[73500]: pgmap v90: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:11:09.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:09 smithi007 ceph-mon[99735]: pgmap v90: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:11:10.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:10.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:10.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:10 smithi130 ceph-mon[84407]: Reconfiguring osd.6 (monmap changed)... 2024-06-18T02:11:10.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-06-18T02:11:10.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:10.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:10 smithi130 ceph-mon[84407]: Reconfiguring daemon osd.6 on smithi130 2024-06-18T02:11:10.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:10 smithi130 ceph-mon[84407]: pgmap v91: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:11:10.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:10.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:10.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:10 smithi007 ceph-mon[73500]: Reconfiguring osd.6 (monmap changed)... 2024-06-18T02:11:10.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-06-18T02:11:10.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:10 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:10.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:10 smithi007 ceph-mon[73500]: Reconfiguring daemon osd.6 on smithi130 2024-06-18T02:11:10.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:10 smithi007 ceph-mon[73500]: pgmap v91: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:11:10.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:10.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:10.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:10 smithi007 ceph-mon[99735]: Reconfiguring osd.6 (monmap changed)... 2024-06-18T02:11:10.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-06-18T02:11:10.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:10.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:10 smithi007 ceph-mon[99735]: Reconfiguring daemon osd.6 on smithi130 2024-06-18T02:11:10.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:10 smithi007 ceph-mon[99735]: pgmap v91: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:11:12.146 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:12.146 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:12.146 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:12.146 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:11:12.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:12.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:12.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:12.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:11 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:11:12.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:12.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:12.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:12.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:11:13.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:12 smithi130 ceph-mon[84407]: pgmap v92: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:11:13.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:12 smithi130 ceph-mon[84407]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:11:13.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:12 smithi007 ceph-mon[73500]: pgmap v92: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:11:13.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:12 smithi007 ceph-mon[73500]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:11:13.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:12 smithi007 ceph-mon[99735]: pgmap v92: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:11:13.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:12 smithi007 ceph-mon[99735]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:11:13.543 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:11:13 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:11:13.507Z caller=manager.go:609 level=warn component="rule manager" group=nodes msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on(instance) group_left(nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi007\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"cd9a3408-2d15-11ef-bc9d-c7b262605968\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-06-18T02:11:15.222 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:14 smithi130 ceph-mon[84407]: pgmap v93: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:11:15.222 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:15.222 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:15.222 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-06-18T02:11:15.222 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:15.431 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:14 smithi007 ceph-mon[99735]: pgmap v93: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:11:15.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:15.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:15.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-06-18T02:11:15.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:15.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:14 smithi007 ceph-mon[73500]: pgmap v93: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:11:15.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:15.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:15.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-06-18T02:11:15.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:14 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:16.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:15 smithi130 ceph-mon[84407]: Reconfiguring osd.7 (monmap changed)... 2024-06-18T02:11:16.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:15 smithi130 ceph-mon[84407]: Reconfiguring daemon osd.7 on smithi130 2024-06-18T02:11:16.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:16.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:16.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:16.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:15 smithi007 ceph-mon[99735]: Reconfiguring osd.7 (monmap changed)... 2024-06-18T02:11:16.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:15 smithi007 ceph-mon[99735]: Reconfiguring daemon osd.7 on smithi130 2024-06-18T02:11:16.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:16.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:16.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:16.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:15 smithi007 ceph-mon[73500]: Reconfiguring osd.7 (monmap changed)... 2024-06-18T02:11:16.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:15 smithi007 ceph-mon[73500]: Reconfiguring daemon osd.7 on smithi130 2024-06-18T02:11:16.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:16.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:16.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:15 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:17.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:16 smithi130 ceph-mon[84407]: pgmap v94: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:11:17.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:16 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:17.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:16 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:17.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:16 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi130.aakmof", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-06-18T02:11:17.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:16 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:17.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:16 smithi007 ceph-mon[73500]: pgmap v94: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:11:17.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:17.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:17.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi130.aakmof", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-06-18T02:11:17.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:16 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:17.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:16 smithi007 ceph-mon[99735]: pgmap v94: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:11:17.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:16 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:17.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:16 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:17.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:16 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi130.aakmof", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-06-18T02:11:17.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:16 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:18.173 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:11:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:11:17] "GET /metrics HTTP/1.1" 200 38263 "" "Prometheus/2.33.4" 2024-06-18T02:11:18.174 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:17 smithi130 ceph-mon[84407]: Reconfiguring rgw.foo.smithi130.aakmof (monmap changed)... 2024-06-18T02:11:18.174 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:17 smithi130 ceph-mon[84407]: Reconfiguring daemon rgw.foo.smithi130.aakmof on smithi130 2024-06-18T02:11:18.174 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:17 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:18.174 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:17 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:18.174 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:17 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi130.wwebfk", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-06-18T02:11:18.174 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:17 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:18.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:17 smithi007 ceph-mon[73500]: Reconfiguring rgw.foo.smithi130.aakmof (monmap changed)... 2024-06-18T02:11:18.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:17 smithi007 ceph-mon[73500]: Reconfiguring daemon rgw.foo.smithi130.aakmof on smithi130 2024-06-18T02:11:18.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:18.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:18.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi130.wwebfk", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-06-18T02:11:18.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:17 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:18.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:17 smithi007 ceph-mon[99735]: Reconfiguring rgw.foo.smithi130.aakmof (monmap changed)... 2024-06-18T02:11:18.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:17 smithi007 ceph-mon[99735]: Reconfiguring daemon rgw.foo.smithi130.aakmof on smithi130 2024-06-18T02:11:18.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:17 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:18.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:17 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:18.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:17 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi130.wwebfk", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-06-18T02:11:18.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:17 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:18.951 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:11:18 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:11:18.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.7\", device_class=\"ssd\", hostname=\"smithi007\", instance=\"172.21.15.130:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.7\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"cd9a3408-2d15-11ef-bc9d-c7b262605968\", cluster_addr=\"172.21.15.7\", device_class=\"ssd\", hostname=\"smithi007\", instance=\"smithi130:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.7\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-06-18T02:11:19.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:18 smithi130 ceph-mon[84407]: Reconfiguring rgw.smpl.smithi130.wwebfk (monmap changed)... 2024-06-18T02:11:19.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:18 smithi130 ceph-mon[84407]: Reconfiguring daemon rgw.smpl.smithi130.wwebfk on smithi130 2024-06-18T02:11:19.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:18 smithi130 ceph-mon[84407]: pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:11:19.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:18 smithi007 ceph-mon[73500]: Reconfiguring rgw.smpl.smithi130.wwebfk (monmap changed)... 2024-06-18T02:11:19.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:18 smithi007 ceph-mon[73500]: Reconfiguring daemon rgw.smpl.smithi130.wwebfk on smithi130 2024-06-18T02:11:19.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:18 smithi007 ceph-mon[73500]: pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:11:19.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:18 smithi007 ceph-mon[99735]: Reconfiguring rgw.smpl.smithi130.wwebfk (monmap changed)... 2024-06-18T02:11:19.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:18 smithi007 ceph-mon[99735]: Reconfiguring daemon rgw.smpl.smithi130.wwebfk on smithi130 2024-06-18T02:11:19.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:18 smithi007 ceph-mon[99735]: pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:11:20.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:20 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:20.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:20 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:20.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:20 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:20.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:20 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:20.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:20 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-06-18T02:11:20.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:20 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-06-18T02:11:20.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:20 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:20.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:20 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:20.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:20 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:20.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:20 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:20.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:20 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-06-18T02:11:20.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:20 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-06-18T02:11:20.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:20 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:20.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:20 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' 2024-06-18T02:11:20.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:20 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:20.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:20 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:20.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:20 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-06-18T02:11:20.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:20 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-06-18T02:11:21.179 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:21 smithi007 ceph-mon[73500]: Upgrade: It appears safe to stop mon.a 2024-06-18T02:11:21.180 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:21 smithi007 ceph-mon[73500]: pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:11:21.180 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:21 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-18T02:11:21.180 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:21 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-18T02:11:21.180 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:21 smithi007 ceph-mon[73500]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:21.180 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:21 smithi007 ceph-mon[99735]: Upgrade: It appears safe to stop mon.a 2024-06-18T02:11:21.180 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:21 smithi007 ceph-mon[99735]: pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:11:21.180 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:21 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-18T02:11:21.180 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:21 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-18T02:11:21.180 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:21 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:21.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:21 smithi130 ceph-mon[84407]: Upgrade: It appears safe to stop mon.a 2024-06-18T02:11:21.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:21 smithi130 ceph-mon[84407]: pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:11:21.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:21 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-18T02:11:21.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:21 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-18T02:11:21.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:21 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:22.379 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:22 smithi007 ceph-mon[73500]: Upgrade: Updating mon.a 2024-06-18T02:11:22.380 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:22 smithi007 ceph-mon[73500]: Deploying daemon mon.a on smithi007 2024-06-18T02:11:22.380 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:22 smithi007 systemd[1]: Stopping Ceph mon.a for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:11:22.380 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:22 smithi007 ceph-mon[99735]: Upgrade: Updating mon.a 2024-06-18T02:11:22.380 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:22 smithi007 ceph-mon[99735]: Deploying daemon mon.a on smithi007 2024-06-18T02:11:22.390 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:22 smithi130 ceph-mon[84407]: Upgrade: Updating mon.a 2024-06-18T02:11:22.390 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:22 smithi130 ceph-mon[84407]: Deploying daemon mon.a on smithi007 2024-06-18T02:11:22.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:22 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-a[73496]: 2024-06-18T02:11:22.379+0000 7f164499c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-06-18T02:11:22.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:22 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-a[73496]: 2024-06-18T02:11:22.379+0000 7f164499c640 -1 mon.a@0(leader) e4 *** Got Signal Terminated *** 2024-06-18T02:11:22.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:22 smithi007 podman[107413]: 2024-06-18 02:11:22.451578321 +0000 UTC m=+0.165750093 container died 670d7777ae9b5d2cce51bb4a0520822cf60591520b5fc6126caad4d816a0064c (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-a, org.label-schema.build-date=20240612, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, ceph=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-3781e3a) 2024-06-18T02:11:22.793 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:11:22 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: [18/Jun/2024:02:11:22] ENGINE Bus STOPPING 2024-06-18T02:11:22.988 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:22 smithi007 podman[107413]: 2024-06-18 02:11:22.796272273 +0000 UTC m=+0.510444042 container cleanup 670d7777ae9b5d2cce51bb4a0520822cf60591520b5fc6126caad4d816a0064c (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-a, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-3781e3a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240612, org.label-schema.vendor=CentOS) 2024-06-18T02:11:22.988 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:22 smithi007 bash[107413]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-a 2024-06-18T02:11:23.241 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:22 smithi007 podman[107427]: 2024-06-18 02:11:22.98921167 +0000 UTC m=+0.536273859 container remove 670d7777ae9b5d2cce51bb4a0520822cf60591520b5fc6126caad4d816a0064c (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-a, GIT_BRANCH=HEAD, org.label-schema.build-date=20240612, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, RELEASE=squid-3781e3a, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-06-18T02:11:23.242 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mon.a.service: Deactivated successfully. 2024-06-18T02:11:23.242 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 systemd[1]: Stopped Ceph mon.a for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:11:23.242 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mon.a.service: Consumed 7.513s CPU time. 2024-06-18T02:11:23.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:11:22 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: [18/Jun/2024:02:11:22] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-06-18T02:11:23.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:11:22 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: [18/Jun/2024:02:11:22] ENGINE Bus STOPPED 2024-06-18T02:11:23.294 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:11:22 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: [18/Jun/2024:02:11:22] ENGINE Bus STARTING 2024-06-18T02:11:23.294 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:11:22 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: [18/Jun/2024:02:11:22] ENGINE Serving on http://:::9283 2024-06-18T02:11:23.294 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:11:22 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: [18/Jun/2024:02:11:22] ENGINE Bus STARTED 2024-06-18T02:11:23.638 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 systemd[1]: Starting Ceph mon.a for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:11:23.793 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:11:23 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:11:23.505Z caller=manager.go:609 level=warn component="rule manager" group=nodes msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on(instance) group_left(nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi007\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"cd9a3408-2d15-11ef-bc9d-c7b262605968\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-06-18T02:11:23.890 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 podman[107551]: 2024-06-18 02:11:23.640193763 +0000 UTC m=+0.098115944 container create 48cea472f626d9085d34a4fbcf9019744de33f44b82f4d86dbd281f12392de32 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-3781e3a, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.36.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240612, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-06-18T02:11:23.890 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 podman[107551]: 2024-06-18 02:11:23.560079162 +0000 UTC m=+0.018001340 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:11:23.890 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 podman[107551]: 2024-06-18 02:11:23.851379707 +0000 UTC m=+0.309301899 container init 48cea472f626d9085d34a4fbcf9019744de33f44b82f4d86dbd281f12392de32 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-a, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240612, RELEASE=squid-3781e3a, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-06-18T02:11:23.890 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 podman[107551]: 2024-06-18 02:11:23.855174127 +0000 UTC m=+0.313096308 container start 48cea472f626d9085d34a4fbcf9019744de33f44b82f4d86dbd281f12392de32 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-a, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-3781e3a, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240612, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-18T02:11:23.890 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: set uid:gid to 167:167 (ceph:ceph) 2024-06-18T02:11:23.890 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc), process ceph-mon, pid 2 2024-06-18T02:11:23.890 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: pidfile_write: ignore empty --pid-file 2024-06-18T02:11:23.890 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: load: jerasure load: lrc 2024-06-18T02:11:23.890 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: RocksDB version: 7.9.2 2024-06-18T02:11:23.890 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Git sha 0 2024-06-18T02:11:23.891 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Compile date 2024-06-17 15:21:02 2024-06-18T02:11:23.891 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: DB SUMMARY 2024-06-18T02:11:23.891 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: DB Session ID: K5HHC5J5D0MW4TYXTEFQ 2024-06-18T02:11:23.891 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: CURRENT file: CURRENT 2024-06-18T02:11:23.891 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: IDENTITY file: IDENTITY 2024-06-18T02:11:23.891 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: MANIFEST file: MANIFEST-000038 size: 1757 Bytes 2024-06-18T02:11:23.891 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000058.sst 2024-06-18T02:11:23.891 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000056.log size: 2369249 ; 2024-06-18T02:11:23.891 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.error_if_exists: 0 2024-06-18T02:11:23.891 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.create_if_missing: 0 2024-06-18T02:11:23.893 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.paranoid_checks: 1 2024-06-18T02:11:23.893 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.flush_verify_memtable_count: 1 2024-06-18T02:11:23.893 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-06-18T02:11:23.893 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-06-18T02:11:23.893 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.env: 0x5613e4971740 2024-06-18T02:11:23.893 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.fs: PosixFileSystem 2024-06-18T02:11:23.893 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.info_log: 0x5613e6141000 2024-06-18T02:11:23.893 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.max_file_opening_threads: 16 2024-06-18T02:11:23.893 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.statistics: (nil) 2024-06-18T02:11:23.893 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.use_fsync: 0 2024-06-18T02:11:23.893 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.max_log_file_size: 0 2024-06-18T02:11:23.893 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-06-18T02:11:23.893 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.log_file_time_to_roll: 0 2024-06-18T02:11:23.894 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.keep_log_file_num: 1000 2024-06-18T02:11:23.894 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.recycle_log_file_num: 0 2024-06-18T02:11:23.894 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.allow_fallocate: 1 2024-06-18T02:11:23.894 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.allow_mmap_reads: 0 2024-06-18T02:11:23.894 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.allow_mmap_writes: 0 2024-06-18T02:11:23.894 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.use_direct_reads: 0 2024-06-18T02:11:23.894 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-06-18T02:11:23.894 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.create_missing_column_families: 0 2024-06-18T02:11:23.894 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.db_log_dir: 2024-06-18T02:11:23.894 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.wal_dir: 2024-06-18T02:11:23.894 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.table_cache_numshardbits: 6 2024-06-18T02:11:23.894 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.WAL_ttl_seconds: 0 2024-06-18T02:11:23.894 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.WAL_size_limit_MB: 0 2024-06-18T02:11:23.894 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-06-18T02:11:23.895 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-06-18T02:11:23.895 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.is_fd_close_on_exec: 1 2024-06-18T02:11:23.895 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.advise_random_on_open: 1 2024-06-18T02:11:23.895 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.db_write_buffer_size: 0 2024-06-18T02:11:23.895 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.write_buffer_manager: 0x5613e61501e0 2024-06-18T02:11:23.895 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-06-18T02:11:23.895 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-06-18T02:11:23.895 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.use_adaptive_mutex: 0 2024-06-18T02:11:23.895 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.rate_limiter: (nil) 2024-06-18T02:11:23.895 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-06-18T02:11:23.895 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.wal_recovery_mode: 2 2024-06-18T02:11:23.895 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.enable_thread_tracking: 0 2024-06-18T02:11:23.895 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.enable_pipelined_write: 0 2024-06-18T02:11:23.895 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.unordered_write: 0 2024-06-18T02:11:23.896 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-06-18T02:11:23.896 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-06-18T02:11:23.896 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-06-18T02:11:23.896 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-06-18T02:11:23.896 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.row_cache: None 2024-06-18T02:11:23.896 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.wal_filter: None 2024-06-18T02:11:23.896 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-06-18T02:11:23.896 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.allow_ingest_behind: 0 2024-06-18T02:11:23.896 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.two_write_queues: 0 2024-06-18T02:11:23.896 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.manual_wal_flush: 0 2024-06-18T02:11:23.896 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.wal_compression: 0 2024-06-18T02:11:23.896 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.atomic_flush: 0 2024-06-18T02:11:23.896 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-06-18T02:11:23.896 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.persist_stats_to_disk: 0 2024-06-18T02:11:23.897 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.write_dbid_to_manifest: 0 2024-06-18T02:11:23.897 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.log_readahead_size: 0 2024-06-18T02:11:23.897 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-06-18T02:11:23.897 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.best_efforts_recovery: 0 2024-06-18T02:11:23.897 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-06-18T02:11:23.897 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-06-18T02:11:23.897 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.allow_data_in_errors: 0 2024-06-18T02:11:23.897 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.db_host_id: __hostname__ 2024-06-18T02:11:23.897 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.enforce_single_del_contracts: true 2024-06-18T02:11:23.897 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.max_background_jobs: 2 2024-06-18T02:11:23.897 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.max_background_compactions: -1 2024-06-18T02:11:23.897 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.max_subcompactions: 1 2024-06-18T02:11:23.897 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-06-18T02:11:23.897 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-06-18T02:11:23.898 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.delayed_write_rate : 16777216 2024-06-18T02:11:23.898 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.max_total_wal_size: 0 2024-06-18T02:11:23.898 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-06-18T02:11:23.898 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.stats_dump_period_sec: 600 2024-06-18T02:11:23.898 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.stats_persist_period_sec: 600 2024-06-18T02:11:23.898 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-06-18T02:11:23.898 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.max_open_files: -1 2024-06-18T02:11:23.898 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.bytes_per_sync: 0 2024-06-18T02:11:23.898 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.wal_bytes_per_sync: 0 2024-06-18T02:11:23.898 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.strict_bytes_per_sync: 0 2024-06-18T02:11:23.898 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.compaction_readahead_size: 0 2024-06-18T02:11:23.898 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.max_background_flushes: -1 2024-06-18T02:11:23.898 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Compression algorithms supported: 2024-06-18T02:11:23.898 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: kZSTD supported: 0 2024-06-18T02:11:23.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: kXpressCompression supported: 0 2024-06-18T02:11:23.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: kBZip2Compression supported: 0 2024-06-18T02:11:23.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-06-18T02:11:23.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: kLZ4Compression supported: 1 2024-06-18T02:11:23.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: kZlibCompression supported: 1 2024-06-18T02:11:23.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: kLZ4HCCompression supported: 1 2024-06-18T02:11:23.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: kSnappyCompression supported: 1 2024-06-18T02:11:23.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Fast CRC32 supported: Supported on x86 2024-06-18T02:11:23.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: DMutex implementation: pthread_mutex_t 2024-06-18T02:11:23.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000038 2024-06-18T02:11:23.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-06-18T02:11:23.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-06-18T02:11:23.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.merge_operator: 2024-06-18T02:11:23.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.compaction_filter: None 2024-06-18T02:11:23.900 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.compaction_filter_factory: None 2024-06-18T02:11:23.900 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.sst_partitioner_factory: None 2024-06-18T02:11:23.900 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.memtable_factory: SkipListFactory 2024-06-18T02:11:23.900 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.table_factory: BlockBasedTable 2024-06-18T02:11:23.900 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5613e6140d00) 2024-06-18T02:11:23.900 INFO:journalctl@ceph.mon.a.smithi007.stdout: cache_index_and_filter_blocks: 1 2024-06-18T02:11:23.900 INFO:journalctl@ceph.mon.a.smithi007.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-06-18T02:11:23.900 INFO:journalctl@ceph.mon.a.smithi007.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-06-18T02:11:23.900 INFO:journalctl@ceph.mon.a.smithi007.stdout: pin_top_level_index_and_filter: 1 2024-06-18T02:11:23.900 INFO:journalctl@ceph.mon.a.smithi007.stdout: index_type: 0 2024-06-18T02:11:23.900 INFO:journalctl@ceph.mon.a.smithi007.stdout: data_block_index_type: 0 2024-06-18T02:11:23.900 INFO:journalctl@ceph.mon.a.smithi007.stdout: index_shortening: 1 2024-06-18T02:11:23.900 INFO:journalctl@ceph.mon.a.smithi007.stdout: data_block_hash_table_util_ratio: 0.750000 2024-06-18T02:11:23.901 INFO:journalctl@ceph.mon.a.smithi007.stdout: checksum: 4 2024-06-18T02:11:23.901 INFO:journalctl@ceph.mon.a.smithi007.stdout: no_block_cache: 0 2024-06-18T02:11:23.901 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_cache: 0x5613e6137090 2024-06-18T02:11:23.901 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_cache_name: BinnedLRUCache 2024-06-18T02:11:23.901 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_cache_options: 2024-06-18T02:11:23.901 INFO:journalctl@ceph.mon.a.smithi007.stdout: capacity : 536870912 2024-06-18T02:11:23.901 INFO:journalctl@ceph.mon.a.smithi007.stdout: num_shard_bits : 4 2024-06-18T02:11:23.901 INFO:journalctl@ceph.mon.a.smithi007.stdout: strict_capacity_limit : 0 2024-06-18T02:11:23.901 INFO:journalctl@ceph.mon.a.smithi007.stdout: high_pri_pool_ratio: 0.000 2024-06-18T02:11:23.901 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_cache_compressed: (nil) 2024-06-18T02:11:23.901 INFO:journalctl@ceph.mon.a.smithi007.stdout: persistent_cache: (nil) 2024-06-18T02:11:23.901 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_size: 4096 2024-06-18T02:11:23.901 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_size_deviation: 10 2024-06-18T02:11:23.902 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_restart_interval: 16 2024-06-18T02:11:23.902 INFO:journalctl@ceph.mon.a.smithi007.stdout: index_block_restart_interval: 1 2024-06-18T02:11:23.902 INFO:journalctl@ceph.mon.a.smithi007.stdout: metadata_block_size: 4096 2024-06-18T02:11:23.902 INFO:journalctl@ceph.mon.a.smithi007.stdout: partition_filters: 0 2024-06-18T02:11:23.902 INFO:journalctl@ceph.mon.a.smithi007.stdout: use_delta_encoding: 1 2024-06-18T02:11:23.902 INFO:journalctl@ceph.mon.a.smithi007.stdout: filter_policy: bloomfilter 2024-06-18T02:11:23.902 INFO:journalctl@ceph.mon.a.smithi007.stdout: whole_key_filtering: 1 2024-06-18T02:11:23.902 INFO:journalctl@ceph.mon.a.smithi007.stdout: verify_compression: 0 2024-06-18T02:11:23.902 INFO:journalctl@ceph.mon.a.smithi007.stdout: read_amp_bytes_per_bit: 0 2024-06-18T02:11:23.902 INFO:journalctl@ceph.mon.a.smithi007.stdout: format_version: 5 2024-06-18T02:11:23.902 INFO:journalctl@ceph.mon.a.smithi007.stdout: enable_index_compression: 1 2024-06-18T02:11:23.902 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_align: 0 2024-06-18T02:11:23.902 INFO:journalctl@ceph.mon.a.smithi007.stdout: max_auto_readahead_size: 262144 2024-06-18T02:11:23.902 INFO:journalctl@ceph.mon.a.smithi007.stdout: prepopulate_block_cache: 0 2024-06-18T02:11:23.903 INFO:journalctl@ceph.mon.a.smithi007.stdout: initial_auto_readahead_size: 8192 2024-06-18T02:11:23.903 INFO:journalctl@ceph.mon.a.smithi007.stdout: num_file_reads_for_auto_readahead: 2 2024-06-18T02:11:23.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.write_buffer_size: 33554432 2024-06-18T02:11:23.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.max_write_buffer_number: 2 2024-06-18T02:11:23.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.compression: NoCompression 2024-06-18T02:11:23.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.bottommost_compression: Disabled 2024-06-18T02:11:23.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.prefix_extractor: nullptr 2024-06-18T02:11:23.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-06-18T02:11:23.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.num_levels: 7 2024-06-18T02:11:23.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-06-18T02:11:23.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-06-18T02:11:23.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-06-18T02:11:23.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-06-18T02:11:23.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-06-18T02:11:23.904 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-06-18T02:11:23.904 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-06-18T02:11:23.904 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-06-18T02:11:23.904 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-06-18T02:11:23.904 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-06-18T02:11:23.904 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-06-18T02:11:23.904 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-06-18T02:11:23.904 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.compression_opts.window_bits: -14 2024-06-18T02:11:23.904 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.compression_opts.level: 32767 2024-06-18T02:11:23.904 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.compression_opts.strategy: 0 2024-06-18T02:11:23.904 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-06-18T02:11:23.904 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-06-18T02:11:23.904 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-06-18T02:11:23.904 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-06-18T02:11:23.904 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.compression_opts.enabled: false 2024-06-18T02:11:23.905 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-06-18T02:11:23.905 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-06-18T02:11:23.905 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-06-18T02:11:23.905 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-06-18T02:11:23.905 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.target_file_size_base: 67108864 2024-06-18T02:11:23.905 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.target_file_size_multiplier: 1 2024-06-18T02:11:23.905 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-06-18T02:11:23.905 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-06-18T02:11:23.905 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-06-18T02:11:23.905 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-06-18T02:11:23.905 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-06-18T02:11:23.905 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-06-18T02:11:23.905 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-06-18T02:11:23.906 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-06-18T02:11:23.906 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-06-18T02:11:23.906 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-06-18T02:11:23.906 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-06-18T02:11:23.906 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-06-18T02:11:23.906 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-06-18T02:11:23.906 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.arena_block_size: 1048576 2024-06-18T02:11:23.906 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-06-18T02:11:23.906 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-06-18T02:11:23.906 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.disable_auto_compactions: 0 2024-06-18T02:11:23.906 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-06-18T02:11:23.906 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-06-18T02:11:23.906 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-06-18T02:11:23.906 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-06-18T02:11:23.906 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-06-18T02:11:23.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-06-18T02:11:23.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-06-18T02:11:23.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-06-18T02:11:23.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-06-18T02:11:23.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-06-18T02:11:23.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.table_properties_collectors: 2024-06-18T02:11:23.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.inplace_update_support: 0 2024-06-18T02:11:23.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.inplace_update_num_locks: 10000 2024-06-18T02:11:23.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-06-18T02:11:23.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-06-18T02:11:23.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.memtable_huge_page_size: 0 2024-06-18T02:11:23.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.bloom_locality: 0 2024-06-18T02:11:23.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.max_successive_merges: 0 2024-06-18T02:11:23.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.optimize_filters_for_hits: 0 2024-06-18T02:11:23.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.paranoid_file_checks: 0 2024-06-18T02:11:23.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.force_consistency_checks: 1 2024-06-18T02:11:23.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.report_bg_io_stats: 0 2024-06-18T02:11:23.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.ttl: 2592000 2024-06-18T02:11:23.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.periodic_compaction_seconds: 0 2024-06-18T02:11:23.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-06-18T02:11:23.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-06-18T02:11:23.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.enable_blob_files: false 2024-06-18T02:11:23.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.min_blob_size: 0 2024-06-18T02:11:23.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.blob_file_size: 268435456 2024-06-18T02:11:23.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.blob_compression_type: NoCompression 2024-06-18T02:11:23.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.enable_blob_garbage_collection: false 2024-06-18T02:11:23.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-06-18T02:11:23.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-06-18T02:11:23.909 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-06-18T02:11:23.909 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.blob_file_starting_level: 0 2024-06-18T02:11:23.909 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-06-18T02:11:23.909 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-06-18T02:11:23.909 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000038 succeeded,manifest_file_number is 38, next_file_number is 60, last_sequence is 27819, log_number is 56,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 56 2024-06-18T02:11:23.909 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 56 2024-06-18T02:11:23.909 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: e87bb5f4-533e-44e3-a05d-92dfdc098920 2024-06-18T02:11:23.909 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: EVENT_LOG_v1 {"time_micros": 1718676683882374, "job": 1, "event": "recovery_started", "wal_files": [56]} 2024-06-18T02:11:23.909 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #56 mode 2 2024-06-18T02:11:23.909 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: EVENT_LOG_v1 {"time_micros": 1718676683889579, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 61, "file_size": 1988539, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 27820, "largest_seqno": 29042, "table_properties": {"data_size": 1982334, "index_size": 3654, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1541, "raw_key_size": 13989, "raw_average_key_size": 23, "raw_value_size": 1970031, "raw_average_value_size": 3283, "num_data_blocks": 167, "num_entries": 600, "num_filter_entries": 600, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1718676683, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "e87bb5f4-533e-44e3-a05d-92dfdc098920", "db_session_id": "K5HHC5J5D0MW4TYXTEFQ", "orig_file_number": 61, "seqno_to_time_mapping": "N/A"}} 2024-06-18T02:11:23.909 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: EVENT_LOG_v1 {"time_micros": 1718676683889679, "job": 1, "event": "recovery_finished"} 2024-06-18T02:11:23.909 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: [db/version_set.cc:5047] Creating manifest 63 2024-06-18T02:11:23.909 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-06-18T02:11:23.910 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000056.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-06-18T02:11:23.910 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5613e6164e00 2024-06-18T02:11:23.910 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: DB pointer 0x5613e625a000 2024-06-18T02:11:23.910 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-06-18T02:11:23.910 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-06-18T02:11:23.910 INFO:journalctl@ceph.mon.a.smithi007.stdout: ** DB Stats ** 2024-06-18T02:11:23.910 INFO:journalctl@ceph.mon.a.smithi007.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-18T02:11:23.910 INFO:journalctl@ceph.mon.a.smithi007.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-06-18T02:11:23.910 INFO:journalctl@ceph.mon.a.smithi007.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-18T02:11:23.910 INFO:journalctl@ceph.mon.a.smithi007.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-18T02:11:23.910 INFO:journalctl@ceph.mon.a.smithi007.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-06-18T02:11:23.910 INFO:journalctl@ceph.mon.a.smithi007.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-18T02:11:23.910 INFO:journalctl@ceph.mon.a.smithi007.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-18T02:11:23.911 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-06-18T02:11:23.911 INFO:journalctl@ceph.mon.a.smithi007.stdout: ** Compaction Stats [default] ** 2024-06-18T02:11:23.911 INFO:journalctl@ceph.mon.a.smithi007.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-06-18T02:11:23.911 INFO:journalctl@ceph.mon.a.smithi007.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-06-18T02:11:23.911 INFO:journalctl@ceph.mon.a.smithi007.stdout: L0 1/0 1.90 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 498.9 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-06-18T02:11:23.911 INFO:journalctl@ceph.mon.a.smithi007.stdout: L6 1/0 10.75 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-06-18T02:11:23.911 INFO:journalctl@ceph.mon.a.smithi007.stdout: Sum 2/0 12.65 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 498.9 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-06-18T02:11:23.911 INFO:journalctl@ceph.mon.a.smithi007.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 498.9 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-06-18T02:11:23.911 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-06-18T02:11:23.911 INFO:journalctl@ceph.mon.a.smithi007.stdout: ** Compaction Stats [default] ** 2024-06-18T02:11:23.911 INFO:journalctl@ceph.mon.a.smithi007.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-06-18T02:11:23.911 INFO:journalctl@ceph.mon.a.smithi007.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-06-18T02:11:23.911 INFO:journalctl@ceph.mon.a.smithi007.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 498.9 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-06-18T02:11:23.911 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-06-18T02:11:23.912 INFO:journalctl@ceph.mon.a.smithi007.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-06-18T02:11:23.912 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-06-18T02:11:23.912 INFO:journalctl@ceph.mon.a.smithi007.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-18T02:11:23.912 INFO:journalctl@ceph.mon.a.smithi007.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-06-18T02:11:23.912 INFO:journalctl@ceph.mon.a.smithi007.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-06-18T02:11:23.912 INFO:journalctl@ceph.mon.a.smithi007.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-06-18T02:11:23.912 INFO:journalctl@ceph.mon.a.smithi007.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-06-18T02:11:23.912 INFO:journalctl@ceph.mon.a.smithi007.stdout: AddFile(Keys): cumulative 0, interval 0 2024-06-18T02:11:23.912 INFO:journalctl@ceph.mon.a.smithi007.stdout: Cumulative compaction: 0.00 GB write, 194.78 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-18T02:11:23.912 INFO:journalctl@ceph.mon.a.smithi007.stdout: Interval compaction: 0.00 GB write, 194.78 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-18T02:11:23.912 INFO:journalctl@ceph.mon.a.smithi007.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-06-18T02:11:23.912 INFO:journalctl@ceph.mon.a.smithi007.stdout: Block cache BinnedLRUCache@0x5613e6137090#2 capacity: 512.00 MB usage: 5.86 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.6e-05 secs_since: 0 2024-06-18T02:11:23.912 INFO:journalctl@ceph.mon.a.smithi007.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.78 KB,0.000339746%) IndexBlock(1,4.08 KB,0.000777841%) Misc(1,0.00 KB,0%) 2024-06-18T02:11:23.912 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-06-18T02:11:23.913 INFO:journalctl@ceph.mon.a.smithi007.stdout: ** File Read Latency Histogram By Level [default] ** 2024-06-18T02:11:23.913 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: starting mon.a rank 0 at public addrs [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] at bind addrs [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 2024-06-18T02:11:23.913 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: mon.a@-1(???) e4 preinit fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 2024-06-18T02:11:23.913 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: mon.a@-1(???).mds e1 new map 2024-06-18T02:11:23.913 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: mon.a@-1(???).mds e1 print_map 2024-06-18T02:11:23.913 INFO:journalctl@ceph.mon.a.smithi007.stdout: e1 2024-06-18T02:11:23.913 INFO:journalctl@ceph.mon.a.smithi007.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-06-18T02:11:23.913 INFO:journalctl@ceph.mon.a.smithi007.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-18T02:11:23.913 INFO:journalctl@ceph.mon.a.smithi007.stdout: legacy client fscid: -1 2024-06-18T02:11:23.913 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-06-18T02:11:23.913 INFO:journalctl@ceph.mon.a.smithi007.stdout: No filesystems configured 2024-06-18T02:11:23.913 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: mon.a@-1(???).osd e115 crush map has features 3314933000854323200, adjusting msgr requires 2024-06-18T02:11:23.913 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: mon.a@-1(???).osd e115 crush map has features 432629239337189376, adjusting msgr requires 2024-06-18T02:11:23.913 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: mon.a@-1(???).osd e115 crush map has features 432629239337189376, adjusting msgr requires 2024-06-18T02:11:23.914 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: mon.a@-1(???).osd e115 crush map has features 432629239337189376, adjusting msgr requires 2024-06-18T02:11:23.914 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 ceph-mon[107569]: mon.a@-1(???).paxosservice(auth 1..28) refresh upgraded, format 0 -> 3 2024-06-18T02:11:24.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 bash[107551]: 48cea472f626d9085d34a4fbcf9019744de33f44b82f4d86dbd281f12392de32 2024-06-18T02:11:24.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:23 smithi007 systemd[1]: Started Ceph mon.a for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:11:27.005 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-18T02:11:27.005 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-18T02:11:27.005 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-18T02:11:27.005 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[99735]: pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:11:27.005 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[99735]: mon.a calling monitor election 2024-06-18T02:11:27.006 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[99735]: pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:11:27.006 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:11:27.006 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[99735]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-06-18T02:11:27.006 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[99735]: monmap epoch 4 2024-06-18T02:11:27.006 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[99735]: fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 2024-06-18T02:11:27.006 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[99735]: last_changed 2024-06-18T02:10:50.706088+0000 2024-06-18T02:11:27.006 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[99735]: created 2024-06-18T01:55:37.939231+0000 2024-06-18T02:11:27.006 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[99735]: min_mon_release 19 (squid) 2024-06-18T02:11:27.006 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[99735]: election_strategy: 1 2024-06-18T02:11:27.006 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[99735]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-06-18T02:11:27.006 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[99735]: 1: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-06-18T02:11:27.006 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[99735]: 2: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-06-18T02:11:27.007 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[99735]: fsmap 2024-06-18T02:11:27.007 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[99735]: osdmap e115: 8 total, 8 up, 8 in 2024-06-18T02:11:27.007 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[99735]: mgrmap e47: x(active, since 2m), standbys: y 2024-06-18T02:11:27.007 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[99735]: overall HEALTH_OK 2024-06-18T02:11:27.007 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='' 2024-06-18T02:11:27.007 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='' 2024-06-18T02:11:27.007 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:27.007 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:27.007 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:27.007 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:27.007 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:27.007 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:27.008 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[107569]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-18T02:11:27.008 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[107569]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-18T02:11:27.008 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[107569]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-18T02:11:27.008 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[107569]: pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:11:27.008 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[107569]: mon.a calling monitor election 2024-06-18T02:11:27.008 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[107569]: pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:11:27.008 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[107569]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:11:27.008 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[107569]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-06-18T02:11:27.008 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[107569]: monmap epoch 4 2024-06-18T02:11:27.008 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[107569]: fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 2024-06-18T02:11:27.008 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[107569]: last_changed 2024-06-18T02:10:50.706088+0000 2024-06-18T02:11:27.009 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[107569]: created 2024-06-18T01:55:37.939231+0000 2024-06-18T02:11:27.009 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[107569]: min_mon_release 19 (squid) 2024-06-18T02:11:27.009 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[107569]: election_strategy: 1 2024-06-18T02:11:27.009 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[107569]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-06-18T02:11:27.009 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[107569]: 1: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-06-18T02:11:27.009 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[107569]: 2: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-06-18T02:11:27.009 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[107569]: fsmap 2024-06-18T02:11:27.009 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[107569]: osdmap e115: 8 total, 8 up, 8 in 2024-06-18T02:11:27.009 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[107569]: mgrmap e47: x(active, since 2m), standbys: y 2024-06-18T02:11:27.009 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[107569]: overall HEALTH_OK 2024-06-18T02:11:27.009 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[107569]: from='mgr.25310 ' entity='' 2024-06-18T02:11:27.009 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[107569]: from='mgr.25310 ' entity='' 2024-06-18T02:11:27.009 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[107569]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:27.010 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[107569]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:27.010 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[107569]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:27.010 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[107569]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:27.010 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[107569]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:27.010 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:26 smithi007 ceph-mon[107569]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:27.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-18T02:11:27.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-18T02:11:27.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-18T02:11:27.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:26 smithi130 ceph-mon[84407]: pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:11:27.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:26 smithi130 ceph-mon[84407]: mon.a calling monitor election 2024-06-18T02:11:27.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:26 smithi130 ceph-mon[84407]: pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:11:27.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:11:27.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:26 smithi130 ceph-mon[84407]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-06-18T02:11:27.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:26 smithi130 ceph-mon[84407]: monmap epoch 4 2024-06-18T02:11:27.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:26 smithi130 ceph-mon[84407]: fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 2024-06-18T02:11:27.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:26 smithi130 ceph-mon[84407]: last_changed 2024-06-18T02:10:50.706088+0000 2024-06-18T02:11:27.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:26 smithi130 ceph-mon[84407]: created 2024-06-18T01:55:37.939231+0000 2024-06-18T02:11:27.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:26 smithi130 ceph-mon[84407]: min_mon_release 19 (squid) 2024-06-18T02:11:27.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:26 smithi130 ceph-mon[84407]: election_strategy: 1 2024-06-18T02:11:27.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:26 smithi130 ceph-mon[84407]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-06-18T02:11:27.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:26 smithi130 ceph-mon[84407]: 1: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-06-18T02:11:27.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:26 smithi130 ceph-mon[84407]: 2: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-06-18T02:11:27.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:26 smithi130 ceph-mon[84407]: fsmap 2024-06-18T02:11:27.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:26 smithi130 ceph-mon[84407]: osdmap e115: 8 total, 8 up, 8 in 2024-06-18T02:11:27.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:26 smithi130 ceph-mon[84407]: mgrmap e47: x(active, since 2m), standbys: y 2024-06-18T02:11:27.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:26 smithi130 ceph-mon[84407]: overall HEALTH_OK 2024-06-18T02:11:27.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='' 2024-06-18T02:11:27.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='' 2024-06-18T02:11:27.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:27.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:27.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:27.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:27.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:27.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:28.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:27 smithi007 ceph-mon[107569]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:28.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:27 smithi007 ceph-mon[107569]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:28.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:27 smithi007 ceph-mon[107569]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-06-18T02:11:28.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:27 smithi007 ceph-mon[107569]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-06-18T02:11:28.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:27 smithi007 ceph-mon[107569]: Upgrade: It appears safe to stop mon.a 2024-06-18T02:11:28.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:28.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:28.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-06-18T02:11:28.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-06-18T02:11:28.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:27 smithi007 ceph-mon[99735]: Upgrade: It appears safe to stop mon.a 2024-06-18T02:11:28.242 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:11:27 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:11:27] "GET /metrics HTTP/1.1" 200 38196 "" "Prometheus/2.33.4" 2024-06-18T02:11:28.243 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:28.243 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:28.243 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-06-18T02:11:28.243 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-06-18T02:11:28.243 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:27 smithi130 ceph-mon[84407]: Upgrade: It appears safe to stop mon.a 2024-06-18T02:11:28.867 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:11:28 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:11:28.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.7\", device_class=\"ssd\", hostname=\"smithi007\", instance=\"172.21.15.130:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.7\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"cd9a3408-2d15-11ef-bc9d-c7b262605968\", cluster_addr=\"172.21.15.7\", device_class=\"ssd\", hostname=\"smithi007\", instance=\"smithi130:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.7\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-06-18T02:11:29.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:28 smithi130 ceph-mon[84407]: pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:11:29.396 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:28 smithi007 ceph-mon[107569]: pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:11:29.397 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:28 smithi007 ceph-mon[99735]: pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:11:30.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:29 smithi130 ceph-mon[84407]: Upgrade: Updating mon.a 2024-06-18T02:11:30.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-18T02:11:30.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-18T02:11:30.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:30.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:29 smithi130 ceph-mon[84407]: Deploying daemon mon.a on smithi007 2024-06-18T02:11:30.393 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:29 smithi007 ceph-mon[107569]: Upgrade: Updating mon.a 2024-06-18T02:11:30.393 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:29 smithi007 ceph-mon[107569]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-18T02:11:30.394 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:29 smithi007 ceph-mon[107569]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-18T02:11:30.394 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:29 smithi007 ceph-mon[107569]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:30.394 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:29 smithi007 ceph-mon[107569]: Deploying daemon mon.a on smithi007 2024-06-18T02:11:30.394 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:29 smithi007 ceph-mon[99735]: Upgrade: Updating mon.a 2024-06-18T02:11:30.394 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-18T02:11:30.394 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-18T02:11:30.394 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:30.394 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:29 smithi007 ceph-mon[99735]: Deploying daemon mon.a on smithi007 2024-06-18T02:11:31.052 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:30 smithi007 systemd[1]: Stopping Ceph mon.a for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:11:31.052 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:30 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-a[107565]: 2024-06-18T02:11:30.939+0000 7f1662b63640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-06-18T02:11:31.052 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:30 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-a[107565]: 2024-06-18T02:11:30.939+0000 7f1662b63640 -1 mon.a@0(leader) e4 *** Got Signal Terminated *** 2024-06-18T02:11:31.356 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:31 smithi007 podman[108088]: 2024-06-18 02:11:31.052803367 +0000 UTC m=+0.209640598 container died 48cea472f626d9085d34a4fbcf9019744de33f44b82f4d86dbd281f12392de32 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-a, GIT_BRANCH=HEAD, org.label-schema.build-date=20240612, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-3781e3a, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-06-18T02:11:31.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:31 smithi007 podman[108088]: 2024-06-18 02:11:31.448231769 +0000 UTC m=+0.605068996 container cleanup 48cea472f626d9085d34a4fbcf9019744de33f44b82f4d86dbd281f12392de32 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-a, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240612, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.36.0, RELEASE=squid-3781e3a, org.label-schema.license=GPLv2) 2024-06-18T02:11:31.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:31 smithi007 bash[108088]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-a 2024-06-18T02:11:31.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:31 smithi007 podman[108100]: 2024-06-18 02:11:31.691098139 +0000 UTC m=+0.636936523 container remove 48cea472f626d9085d34a4fbcf9019744de33f44b82f4d86dbd281f12392de32 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-a, org.label-schema.build-date=20240612, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-3781e3a, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, maintainer=Guillaume Abrioux ) 2024-06-18T02:11:31.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:31 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mon.a.service: Deactivated successfully. 2024-06-18T02:11:31.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:31 smithi007 systemd[1]: Stopped Ceph mon.a for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:11:32.257 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 systemd[1]: Starting Ceph mon.a for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:11:32.508 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 podman[108231]: 2024-06-18 02:11:32.259211754 +0000 UTC m=+0.105596853 container create ac1c3b8dd5987c8c8261eac75327de567e00851ed999458631d8f0770475a03d (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-a, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-3781e3a, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240612, GIT_CLEAN=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.vendor=CentOS) 2024-06-18T02:11:32.508 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 podman[108231]: 2024-06-18 02:11:32.171891872 +0000 UTC m=+0.018276983 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:11:32.508 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 podman[108231]: 2024-06-18 02:11:32.478576468 +0000 UTC m=+0.324961587 container init ac1c3b8dd5987c8c8261eac75327de567e00851ed999458631d8f0770475a03d (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-a, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-3781e3a, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240612, GIT_CLEAN=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_BRANCH=HEAD) 2024-06-18T02:11:32.509 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 podman[108231]: 2024-06-18 02:11:32.48235053 +0000 UTC m=+0.328735630 container start ac1c3b8dd5987c8c8261eac75327de567e00851ed999458631d8f0770475a03d (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-3781e3a, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240612, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, io.buildah.version=1.36.0) 2024-06-18T02:11:32.509 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: set uid:gid to 167:167 (ceph:ceph) 2024-06-18T02:11:32.509 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc), process ceph-mon, pid 2 2024-06-18T02:11:32.509 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: pidfile_write: ignore empty --pid-file 2024-06-18T02:11:32.509 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: load: jerasure load: lrc 2024-06-18T02:11:32.509 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: RocksDB version: 7.9.2 2024-06-18T02:11:32.509 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Git sha 0 2024-06-18T02:11:32.509 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Compile date 2024-06-17 15:21:02 2024-06-18T02:11:32.509 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: DB SUMMARY 2024-06-18T02:11:32.509 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: DB Session ID: F0NVKVEBPDLLIW72T0PK 2024-06-18T02:11:32.509 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: CURRENT file: CURRENT 2024-06-18T02:11:32.509 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: IDENTITY file: IDENTITY 2024-06-18T02:11:32.509 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: MANIFEST file: MANIFEST-000063 size: 293 Bytes 2024-06-18T02:11:32.510 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 2, files: 000058.sst 000061.sst 2024-06-18T02:11:32.510 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000062.log size: 248233 ; 2024-06-18T02:11:32.510 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.error_if_exists: 0 2024-06-18T02:11:32.510 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.create_if_missing: 0 2024-06-18T02:11:32.510 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.paranoid_checks: 1 2024-06-18T02:11:32.510 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.flush_verify_memtable_count: 1 2024-06-18T02:11:32.510 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-06-18T02:11:32.510 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-06-18T02:11:32.510 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.env: 0x560548124740 2024-06-18T02:11:32.510 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.fs: PosixFileSystem 2024-06-18T02:11:32.510 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.info_log: 0x5605494cd000 2024-06-18T02:11:32.510 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.max_file_opening_threads: 16 2024-06-18T02:11:32.510 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.statistics: (nil) 2024-06-18T02:11:32.511 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.use_fsync: 0 2024-06-18T02:11:32.511 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.max_log_file_size: 0 2024-06-18T02:11:32.511 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-06-18T02:11:32.511 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.log_file_time_to_roll: 0 2024-06-18T02:11:32.511 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.keep_log_file_num: 1000 2024-06-18T02:11:32.511 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.recycle_log_file_num: 0 2024-06-18T02:11:32.511 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.allow_fallocate: 1 2024-06-18T02:11:32.511 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.allow_mmap_reads: 0 2024-06-18T02:11:32.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.allow_mmap_writes: 0 2024-06-18T02:11:32.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.use_direct_reads: 0 2024-06-18T02:11:32.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-06-18T02:11:32.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.create_missing_column_families: 0 2024-06-18T02:11:32.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.db_log_dir: 2024-06-18T02:11:32.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.wal_dir: 2024-06-18T02:11:32.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.table_cache_numshardbits: 6 2024-06-18T02:11:32.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.WAL_ttl_seconds: 0 2024-06-18T02:11:32.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.WAL_size_limit_MB: 0 2024-06-18T02:11:32.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-06-18T02:11:32.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-06-18T02:11:32.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.is_fd_close_on_exec: 1 2024-06-18T02:11:32.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.advise_random_on_open: 1 2024-06-18T02:11:32.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.db_write_buffer_size: 0 2024-06-18T02:11:32.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.write_buffer_manager: 0x5605494dc1e0 2024-06-18T02:11:32.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-06-18T02:11:32.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-06-18T02:11:32.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.use_adaptive_mutex: 0 2024-06-18T02:11:32.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.rate_limiter: (nil) 2024-06-18T02:11:32.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-06-18T02:11:32.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.wal_recovery_mode: 2 2024-06-18T02:11:32.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.enable_thread_tracking: 0 2024-06-18T02:11:32.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.enable_pipelined_write: 0 2024-06-18T02:11:32.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.unordered_write: 0 2024-06-18T02:11:32.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-06-18T02:11:32.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-06-18T02:11:32.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-06-18T02:11:32.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-06-18T02:11:32.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.row_cache: None 2024-06-18T02:11:32.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.wal_filter: None 2024-06-18T02:11:32.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-06-18T02:11:32.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.allow_ingest_behind: 0 2024-06-18T02:11:32.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.two_write_queues: 0 2024-06-18T02:11:32.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.manual_wal_flush: 0 2024-06-18T02:11:32.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.wal_compression: 0 2024-06-18T02:11:32.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.atomic_flush: 0 2024-06-18T02:11:32.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-06-18T02:11:32.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.persist_stats_to_disk: 0 2024-06-18T02:11:32.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.write_dbid_to_manifest: 0 2024-06-18T02:11:32.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.log_readahead_size: 0 2024-06-18T02:11:32.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-06-18T02:11:32.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.best_efforts_recovery: 0 2024-06-18T02:11:32.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-06-18T02:11:32.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-06-18T02:11:32.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.allow_data_in_errors: 0 2024-06-18T02:11:32.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.db_host_id: __hostname__ 2024-06-18T02:11:32.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.enforce_single_del_contracts: true 2024-06-18T02:11:32.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.max_background_jobs: 2 2024-06-18T02:11:32.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.max_background_compactions: -1 2024-06-18T02:11:32.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.max_subcompactions: 1 2024-06-18T02:11:32.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-06-18T02:11:32.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-06-18T02:11:32.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.delayed_write_rate : 16777216 2024-06-18T02:11:32.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.max_total_wal_size: 0 2024-06-18T02:11:32.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-06-18T02:11:32.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.stats_dump_period_sec: 600 2024-06-18T02:11:32.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.stats_persist_period_sec: 600 2024-06-18T02:11:32.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-06-18T02:11:32.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.max_open_files: -1 2024-06-18T02:11:32.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.bytes_per_sync: 0 2024-06-18T02:11:32.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.wal_bytes_per_sync: 0 2024-06-18T02:11:32.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.strict_bytes_per_sync: 0 2024-06-18T02:11:32.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.compaction_readahead_size: 0 2024-06-18T02:11:32.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.max_background_flushes: -1 2024-06-18T02:11:32.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Compression algorithms supported: 2024-06-18T02:11:32.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: kZSTD supported: 0 2024-06-18T02:11:32.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: kXpressCompression supported: 0 2024-06-18T02:11:32.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: kBZip2Compression supported: 0 2024-06-18T02:11:32.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-06-18T02:11:32.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: kLZ4Compression supported: 1 2024-06-18T02:11:32.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: kZlibCompression supported: 1 2024-06-18T02:11:32.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: kLZ4HCCompression supported: 1 2024-06-18T02:11:32.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: kSnappyCompression supported: 1 2024-06-18T02:11:32.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Fast CRC32 supported: Supported on x86 2024-06-18T02:11:32.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: DMutex implementation: pthread_mutex_t 2024-06-18T02:11:32.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000063 2024-06-18T02:11:32.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-06-18T02:11:32.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-06-18T02:11:32.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.merge_operator: 2024-06-18T02:11:32.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.compaction_filter: None 2024-06-18T02:11:32.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.compaction_filter_factory: None 2024-06-18T02:11:32.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.sst_partitioner_factory: None 2024-06-18T02:11:32.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.memtable_factory: SkipListFactory 2024-06-18T02:11:32.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.table_factory: BlockBasedTable 2024-06-18T02:11:32.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5605494ccd00) 2024-06-18T02:11:32.940 INFO:journalctl@ceph.mon.a.smithi007.stdout: cache_index_and_filter_blocks: 1 2024-06-18T02:11:32.940 INFO:journalctl@ceph.mon.a.smithi007.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-06-18T02:11:32.941 INFO:journalctl@ceph.mon.a.smithi007.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-06-18T02:11:32.941 INFO:journalctl@ceph.mon.a.smithi007.stdout: pin_top_level_index_and_filter: 1 2024-06-18T02:11:32.941 INFO:journalctl@ceph.mon.a.smithi007.stdout: index_type: 0 2024-06-18T02:11:32.941 INFO:journalctl@ceph.mon.a.smithi007.stdout: data_block_index_type: 0 2024-06-18T02:11:32.941 INFO:journalctl@ceph.mon.a.smithi007.stdout: index_shortening: 1 2024-06-18T02:11:32.941 INFO:journalctl@ceph.mon.a.smithi007.stdout: data_block_hash_table_util_ratio: 0.750000 2024-06-18T02:11:32.941 INFO:journalctl@ceph.mon.a.smithi007.stdout: checksum: 4 2024-06-18T02:11:32.941 INFO:journalctl@ceph.mon.a.smithi007.stdout: no_block_cache: 0 2024-06-18T02:11:32.941 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_cache: 0x5605494c3090 2024-06-18T02:11:32.941 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_cache_name: BinnedLRUCache 2024-06-18T02:11:32.941 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_cache_options: 2024-06-18T02:11:32.941 INFO:journalctl@ceph.mon.a.smithi007.stdout: capacity : 536870912 2024-06-18T02:11:32.941 INFO:journalctl@ceph.mon.a.smithi007.stdout: num_shard_bits : 4 2024-06-18T02:11:32.941 INFO:journalctl@ceph.mon.a.smithi007.stdout: strict_capacity_limit : 0 2024-06-18T02:11:32.942 INFO:journalctl@ceph.mon.a.smithi007.stdout: high_pri_pool_ratio: 0.000 2024-06-18T02:11:32.942 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_cache_compressed: (nil) 2024-06-18T02:11:32.942 INFO:journalctl@ceph.mon.a.smithi007.stdout: persistent_cache: (nil) 2024-06-18T02:11:32.942 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_size: 4096 2024-06-18T02:11:32.942 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_size_deviation: 10 2024-06-18T02:11:32.942 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_restart_interval: 16 2024-06-18T02:11:32.942 INFO:journalctl@ceph.mon.a.smithi007.stdout: index_block_restart_interval: 1 2024-06-18T02:11:32.942 INFO:journalctl@ceph.mon.a.smithi007.stdout: metadata_block_size: 4096 2024-06-18T02:11:32.942 INFO:journalctl@ceph.mon.a.smithi007.stdout: partition_filters: 0 2024-06-18T02:11:32.942 INFO:journalctl@ceph.mon.a.smithi007.stdout: use_delta_encoding: 1 2024-06-18T02:11:32.942 INFO:journalctl@ceph.mon.a.smithi007.stdout: filter_policy: bloomfilter 2024-06-18T02:11:32.942 INFO:journalctl@ceph.mon.a.smithi007.stdout: whole_key_filtering: 1 2024-06-18T02:11:32.942 INFO:journalctl@ceph.mon.a.smithi007.stdout: verify_compression: 0 2024-06-18T02:11:32.942 INFO:journalctl@ceph.mon.a.smithi007.stdout: read_amp_bytes_per_bit: 0 2024-06-18T02:11:32.943 INFO:journalctl@ceph.mon.a.smithi007.stdout: format_version: 5 2024-06-18T02:11:32.943 INFO:journalctl@ceph.mon.a.smithi007.stdout: enable_index_compression: 1 2024-06-18T02:11:32.943 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_align: 0 2024-06-18T02:11:32.943 INFO:journalctl@ceph.mon.a.smithi007.stdout: max_auto_readahead_size: 262144 2024-06-18T02:11:32.943 INFO:journalctl@ceph.mon.a.smithi007.stdout: prepopulate_block_cache: 0 2024-06-18T02:11:32.943 INFO:journalctl@ceph.mon.a.smithi007.stdout: initial_auto_readahead_size: 8192 2024-06-18T02:11:32.943 INFO:journalctl@ceph.mon.a.smithi007.stdout: num_file_reads_for_auto_readahead: 2 2024-06-18T02:11:32.943 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.write_buffer_size: 33554432 2024-06-18T02:11:32.943 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.max_write_buffer_number: 2 2024-06-18T02:11:32.943 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.compression: NoCompression 2024-06-18T02:11:32.943 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.bottommost_compression: Disabled 2024-06-18T02:11:32.943 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.prefix_extractor: nullptr 2024-06-18T02:11:32.943 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-06-18T02:11:32.943 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.num_levels: 7 2024-06-18T02:11:32.944 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-06-18T02:11:32.944 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-06-18T02:11:32.944 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-06-18T02:11:32.944 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-06-18T02:11:32.944 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-06-18T02:11:32.944 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-06-18T02:11:32.944 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-06-18T02:11:32.944 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-06-18T02:11:32.944 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-06-18T02:11:32.944 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-06-18T02:11:32.944 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-06-18T02:11:32.945 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-06-18T02:11:32.945 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.compression_opts.window_bits: -14 2024-06-18T02:11:32.945 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.compression_opts.level: 32767 2024-06-18T02:11:32.945 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.compression_opts.strategy: 0 2024-06-18T02:11:32.945 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-06-18T02:11:32.945 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-06-18T02:11:32.945 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-06-18T02:11:32.945 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-06-18T02:11:32.945 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.compression_opts.enabled: false 2024-06-18T02:11:32.945 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-06-18T02:11:32.945 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-06-18T02:11:32.945 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-06-18T02:11:32.945 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-06-18T02:11:32.945 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.target_file_size_base: 67108864 2024-06-18T02:11:32.945 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.target_file_size_multiplier: 1 2024-06-18T02:11:32.946 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-06-18T02:11:32.946 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-06-18T02:11:32.946 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-06-18T02:11:32.946 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-06-18T02:11:32.946 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-06-18T02:11:32.946 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-06-18T02:11:32.946 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-06-18T02:11:32.946 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-06-18T02:11:32.946 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-06-18T02:11:32.946 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-06-18T02:11:32.946 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-06-18T02:11:32.946 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-06-18T02:11:32.946 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-06-18T02:11:32.946 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.arena_block_size: 1048576 2024-06-18T02:11:32.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-06-18T02:11:32.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-06-18T02:11:32.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.disable_auto_compactions: 0 2024-06-18T02:11:32.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-06-18T02:11:32.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-06-18T02:11:32.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-06-18T02:11:32.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-06-18T02:11:32.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-06-18T02:11:32.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-06-18T02:11:32.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-06-18T02:11:32.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-06-18T02:11:32.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-06-18T02:11:32.948 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-06-18T02:11:32.948 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.table_properties_collectors: 2024-06-18T02:11:32.948 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.inplace_update_support: 0 2024-06-18T02:11:32.948 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.inplace_update_num_locks: 10000 2024-06-18T02:11:32.948 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-06-18T02:11:32.948 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-06-18T02:11:32.948 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.memtable_huge_page_size: 0 2024-06-18T02:11:32.948 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.bloom_locality: 0 2024-06-18T02:11:32.948 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.max_successive_merges: 0 2024-06-18T02:11:32.948 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.optimize_filters_for_hits: 0 2024-06-18T02:11:32.948 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.paranoid_file_checks: 0 2024-06-18T02:11:32.949 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.force_consistency_checks: 1 2024-06-18T02:11:32.949 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.report_bg_io_stats: 0 2024-06-18T02:11:32.949 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.ttl: 2592000 2024-06-18T02:11:32.949 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.periodic_compaction_seconds: 0 2024-06-18T02:11:32.949 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-06-18T02:11:32.949 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-06-18T02:11:32.949 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.enable_blob_files: false 2024-06-18T02:11:32.949 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.min_blob_size: 0 2024-06-18T02:11:32.949 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.blob_file_size: 268435456 2024-06-18T02:11:32.950 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.blob_compression_type: NoCompression 2024-06-18T02:11:32.950 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.enable_blob_garbage_collection: false 2024-06-18T02:11:32.950 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-06-18T02:11:32.950 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-06-18T02:11:32.950 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-06-18T02:11:32.950 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.blob_file_starting_level: 0 2024-06-18T02:11:32.950 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-06-18T02:11:32.950 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-06-18T02:11:32.950 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000063 succeeded,manifest_file_number is 63, next_file_number is 65, last_sequence is 29042, log_number is 57,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 57 2024-06-18T02:11:32.950 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 57 2024-06-18T02:11:32.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: e87bb5f4-533e-44e3-a05d-92dfdc098920 2024-06-18T02:11:32.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: EVENT_LOG_v1 {"time_micros": 1718676692510086, "job": 1, "event": "recovery_started", "wal_files": [62]} 2024-06-18T02:11:32.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #62 mode 2 2024-06-18T02:11:32.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: EVENT_LOG_v1 {"time_micros": 1718676692511889, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 66, "file_size": 232472, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 29045, "largest_seqno": 29184, "table_properties": {"data_size": 230719, "index_size": 485, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 261, "raw_key_size": 2182, "raw_average_key_size": 25, "raw_value_size": 228783, "raw_average_value_size": 2660, "num_data_blocks": 21, "num_entries": 86, "num_filter_entries": 86, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1718676692, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "e87bb5f4-533e-44e3-a05d-92dfdc098920", "db_session_id": "F0NVKVEBPDLLIW72T0PK", "orig_file_number": 66, "seqno_to_time_mapping": "N/A"}} 2024-06-18T02:11:32.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: EVENT_LOG_v1 {"time_micros": 1718676692511989, "job": 1, "event": "recovery_finished"} 2024-06-18T02:11:32.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: [db/version_set.cc:5047] Creating manifest 68 2024-06-18T02:11:32.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-06-18T02:11:32.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000062.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-06-18T02:11:32.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5605494f0e00 2024-06-18T02:11:32.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: DB pointer 0x5605495e6000 2024-06-18T02:11:32.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-06-18T02:11:32.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-06-18T02:11:32.951 INFO:journalctl@ceph.mon.a.smithi007.stdout: ** DB Stats ** 2024-06-18T02:11:32.951 INFO:journalctl@ceph.mon.a.smithi007.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-18T02:11:32.952 INFO:journalctl@ceph.mon.a.smithi007.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-06-18T02:11:32.952 INFO:journalctl@ceph.mon.a.smithi007.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-18T02:11:32.952 INFO:journalctl@ceph.mon.a.smithi007.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-18T02:11:32.952 INFO:journalctl@ceph.mon.a.smithi007.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-06-18T02:11:32.952 INFO:journalctl@ceph.mon.a.smithi007.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-18T02:11:32.952 INFO:journalctl@ceph.mon.a.smithi007.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-18T02:11:32.952 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-06-18T02:11:32.952 INFO:journalctl@ceph.mon.a.smithi007.stdout: ** Compaction Stats [default] ** 2024-06-18T02:11:32.952 INFO:journalctl@ceph.mon.a.smithi007.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-06-18T02:11:32.952 INFO:journalctl@ceph.mon.a.smithi007.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-06-18T02:11:32.952 INFO:journalctl@ceph.mon.a.smithi007.stdout: L0 2/0 2.12 MB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 211.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-06-18T02:11:32.952 INFO:journalctl@ceph.mon.a.smithi007.stdout: L6 1/0 10.75 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-06-18T02:11:32.952 INFO:journalctl@ceph.mon.a.smithi007.stdout: Sum 3/0 12.87 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 211.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-06-18T02:11:32.952 INFO:journalctl@ceph.mon.a.smithi007.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 211.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-06-18T02:11:32.953 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-06-18T02:11:32.953 INFO:journalctl@ceph.mon.a.smithi007.stdout: ** Compaction Stats [default] ** 2024-06-18T02:11:32.953 INFO:journalctl@ceph.mon.a.smithi007.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-06-18T02:11:32.953 INFO:journalctl@ceph.mon.a.smithi007.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-06-18T02:11:32.953 INFO:journalctl@ceph.mon.a.smithi007.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 211.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-06-18T02:11:32.953 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-06-18T02:11:32.953 INFO:journalctl@ceph.mon.a.smithi007.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-06-18T02:11:32.953 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-06-18T02:11:32.953 INFO:journalctl@ceph.mon.a.smithi007.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-18T02:11:32.953 INFO:journalctl@ceph.mon.a.smithi007.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-06-18T02:11:32.953 INFO:journalctl@ceph.mon.a.smithi007.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-06-18T02:11:32.953 INFO:journalctl@ceph.mon.a.smithi007.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-06-18T02:11:32.953 INFO:journalctl@ceph.mon.a.smithi007.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-06-18T02:11:32.953 INFO:journalctl@ceph.mon.a.smithi007.stdout: AddFile(Keys): cumulative 0, interval 0 2024-06-18T02:11:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout: Cumulative compaction: 0.00 GB write, 52.52 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-18T02:11:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout: Interval compaction: 0.00 GB write, 52.52 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-18T02:11:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-06-18T02:11:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout: Block cache BinnedLRUCache@0x5605494c3090#2 capacity: 512.00 MB usage: 6.75 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-06-18T02:11:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,2.09 KB,0.000399351%) IndexBlock(2,4.66 KB,0.000888109%) Misc(1,0.00 KB,0%) 2024-06-18T02:11:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-06-18T02:11:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout: ** File Read Latency Histogram By Level [default] ** 2024-06-18T02:11:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: starting mon.a rank 0 at public addrs [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] at bind addrs [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 2024-06-18T02:11:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: mon.a@-1(???) e4 preinit fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 2024-06-18T02:11:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: mon.a@-1(???).mds e1 new map 2024-06-18T02:11:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: mon.a@-1(???).mds e1 print_map 2024-06-18T02:11:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout: e1 2024-06-18T02:11:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-06-18T02:11:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-18T02:11:32.955 INFO:journalctl@ceph.mon.a.smithi007.stdout: legacy client fscid: -1 2024-06-18T02:11:32.955 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-06-18T02:11:32.955 INFO:journalctl@ceph.mon.a.smithi007.stdout: No filesystems configured 2024-06-18T02:11:32.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: mon.a@-1(???).osd e115 crush map has features 3314933000854323200, adjusting msgr requires 2024-06-18T02:11:32.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: mon.a@-1(???).osd e115 crush map has features 432629239337189376, adjusting msgr requires 2024-06-18T02:11:32.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: mon.a@-1(???).osd e115 crush map has features 432629239337189376, adjusting msgr requires 2024-06-18T02:11:32.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: mon.a@-1(???).osd e115 crush map has features 432629239337189376, adjusting msgr requires 2024-06-18T02:11:32.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 ceph-mon[108250]: mon.a@-1(???).paxosservice(auth 1..29) refresh upgraded, format 0 -> 3 2024-06-18T02:11:32.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 bash[108231]: ac1c3b8dd5987c8c8261eac75327de567e00851ed999458631d8f0770475a03d 2024-06-18T02:11:32.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:32 smithi007 systemd[1]: Started Ceph mon.a for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:11:33.793 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:11:33 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:11:33.505Z caller=manager.go:609 level=warn component="rule manager" group=nodes msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on(instance) group_left(nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi007\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"cd9a3408-2d15-11ef-bc9d-c7b262605968\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-06-18T02:11:34.026 INFO:teuthology.orchestra.run.smithi007.stdout:true 2024-06-18T02:11:34.713 INFO:teuthology.orchestra.run.smithi007.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-18T02:11:34.713 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi007 smithi007 running 10s ago 14m - - 2024-06-18T02:11:34.713 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi130 smithi130 running 2s ago 14m - - 2024-06-18T02:11:34.713 INFO:teuthology.orchestra.run.smithi007.stdout:alertmanager.a smithi007 *:9093,9094 running (4m) 10s ago 9m 22.7M - 0.23.0 ba2b418f427c 5994e8525c64 2024-06-18T02:11:34.713 INFO:teuthology.orchestra.run.smithi007.stdout:grafana.a smithi130 *:3000 running (4m) 2s ago 9m 49.8M - 8.3.5 dad864ee21e9 70ba81d97c8e 2024-06-18T02:11:34.713 INFO:teuthology.orchestra.run.smithi007.stdout:iscsi.foo.smithi007.xvdrwd smithi007 running (2m) 10s ago 7m 51.1M - 3.5 e1d6a67b021e 94121ad2702c 2024-06-18T02:11:34.714 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.x smithi130 *:8443,9283,8765 running (3m) 2s ago 13m 515M - 19.0.0-3124-g3781e3a5 af93c036e016 01017e37bdbe 2024-06-18T02:11:34.714 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.y smithi007 *:8443,9283,8765 running (108s) 10s ago 15m 440M - 19.0.0-3124-g3781e3a5 af93c036e016 2141e131e896 2024-06-18T02:11:34.714 INFO:teuthology.orchestra.run.smithi007.stdout:mon.a smithi007 starting - - - 2048M 2024-06-18T02:11:34.714 INFO:teuthology.orchestra.run.smithi007.stdout:mon.b smithi130 running (45s) 2s ago 14m 35.6M 2048M 19.0.0-3124-g3781e3a5 af93c036e016 baacf2add994 2024-06-18T02:11:34.714 INFO:teuthology.orchestra.run.smithi007.stdout:mon.c smithi007 running (66s) 10s ago 14m 42.8M 2048M 19.0.0-3124-g3781e3a5 af93c036e016 39418356156e 2024-06-18T02:11:34.714 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.a smithi007 *:9100 running (4m) 10s ago 9m 18.0M - 1.3.1 1dbe0e931976 8128e558f099 2024-06-18T02:11:34.714 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.b smithi130 *:9100 running (4m) 2s ago 9m 16.7M - 1.3.1 1dbe0e931976 bab93b43cf16 2024-06-18T02:11:34.714 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0 smithi007 running (13m) 10s ago 13m 55.0M 4096M 17.2.0 e1d6a67b021e 1ef6e23afd55 2024-06-18T02:11:34.714 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1 smithi007 running (13m) 10s ago 13m 56.5M 4096M 17.2.0 e1d6a67b021e a967706523cb 2024-06-18T02:11:34.714 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2 smithi007 running (12m) 10s ago 12m 51.1M 4096M 17.2.0 e1d6a67b021e 2c1b76bd0876 2024-06-18T02:11:34.714 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3 smithi007 running (12m) 10s ago 12m 55.1M 4096M 17.2.0 e1d6a67b021e 8b91b2a07564 2024-06-18T02:11:34.714 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4 smithi130 running (12m) 2s ago 12m 56.7M 4096M 17.2.0 e1d6a67b021e c428dccffdf0 2024-06-18T02:11:34.715 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5 smithi130 running (11m) 2s ago 11m 55.0M 4096M 17.2.0 e1d6a67b021e f645d7f12378 2024-06-18T02:11:34.715 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6 smithi130 running (11m) 2s ago 11m 51.1M 4096M 17.2.0 e1d6a67b021e c7af86c14959 2024-06-18T02:11:34.715 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7 smithi130 running (10m) 2s ago 10m 54.7M 4096M 17.2.0 e1d6a67b021e 3688af8b2c46 2024-06-18T02:11:34.715 INFO:teuthology.orchestra.run.smithi007.stdout:prometheus.a smithi130 *:9095 running (3m) 2s ago 10m 75.6M - 2.33.4 514e6a882f6e e905fb2eb4a6 2024-06-18T02:11:34.715 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi007.dvbvbk smithi007 *:8000 running (8m) 10s ago 8m 76.6M - 17.2.0 e1d6a67b021e 1344b55b763c 2024-06-18T02:11:34.715 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi130.aakmof smithi130 *:8000 running (8m) 2s ago 8m 74.2M - 17.2.0 e1d6a67b021e e257e3230c6c 2024-06-18T02:11:34.715 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi007.hgrnmk smithi007 *:80 running (8m) 10s ago 8m 74.8M - 17.2.0 e1d6a67b021e 2173947bc4d6 2024-06-18T02:11:34.715 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi130.wwebfk smithi130 *:80 running (8m) 2s ago 8m 76.3M - 17.2.0 e1d6a67b021e 8662706b2231 2024-06-18T02:11:35.126 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:11:35.126 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": { 2024-06-18T02:11:35.126 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 3 2024-06-18T02:11:35.126 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:11:35.126 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": { 2024-06-18T02:11:35.126 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 2 2024-06-18T02:11:35.127 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:11:35.127 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": { 2024-06-18T02:11:35.127 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-06-18T02:11:35.127 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:11:35.127 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw": { 2024-06-18T02:11:35.127 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-06-18T02:11:35.127 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:11:35.127 INFO:teuthology.orchestra.run.smithi007.stdout: "overall": { 2024-06-18T02:11:35.127 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 12, 2024-06-18T02:11:35.127 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 5 2024-06-18T02:11:35.127 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-06-18T02:11:35.127 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:11:35.474 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:11:35.475 INFO:teuthology.orchestra.run.smithi007.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00", 2024-06-18T02:11:35.475 INFO:teuthology.orchestra.run.smithi007.stdout: "in_progress": true, 2024-06-18T02:11:35.475 INFO:teuthology.orchestra.run.smithi007.stdout: "which": "Upgrading all daemon types on all hosts", 2024-06-18T02:11:35.475 INFO:teuthology.orchestra.run.smithi007.stdout: "services_complete": [ 2024-06-18T02:11:35.475 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr" 2024-06-18T02:11:35.475 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-06-18T02:11:35.475 INFO:teuthology.orchestra.run.smithi007.stdout: "progress": "4/23 daemons upgraded", 2024-06-18T02:11:35.475 INFO:teuthology.orchestra.run.smithi007.stdout: "message": "Currently upgrading mon daemons", 2024-06-18T02:11:35.475 INFO:teuthology.orchestra.run.smithi007.stdout: "is_paused": false 2024-06-18T02:11:35.475 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:11:35.901 INFO:teuthology.orchestra.run.smithi007.stdout:HEALTH_OK 2024-06-18T02:11:35.902 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[108250]: pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:11:35.902 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[108250]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:11:35.902 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[108250]: mon.a calling monitor election 2024-06-18T02:11:35.902 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[108250]: pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:11:35.902 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[108250]: from='client.64124 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:11:35.902 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[108250]: from='client.64130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:11:35.902 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[108250]: from='client.64136 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:11:35.902 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[108250]: from='client.? 172.21.15.7:0/1053238641' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:35.902 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[108250]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-06-18T02:11:35.902 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[108250]: monmap epoch 4 2024-06-18T02:11:35.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[108250]: fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 2024-06-18T02:11:35.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[108250]: last_changed 2024-06-18T02:10:50.706088+0000 2024-06-18T02:11:35.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[108250]: created 2024-06-18T01:55:37.939231+0000 2024-06-18T02:11:35.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[108250]: min_mon_release 19 (squid) 2024-06-18T02:11:35.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[108250]: election_strategy: 1 2024-06-18T02:11:35.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[108250]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-06-18T02:11:35.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[108250]: 1: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-06-18T02:11:35.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[108250]: 2: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-06-18T02:11:35.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[108250]: fsmap 2024-06-18T02:11:35.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[108250]: osdmap e115: 8 total, 8 up, 8 in 2024-06-18T02:11:35.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[108250]: mgrmap e47: x(active, since 2m), standbys: y 2024-06-18T02:11:35.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[108250]: overall HEALTH_OK 2024-06-18T02:11:35.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='' 2024-06-18T02:11:35.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='' 2024-06-18T02:11:35.904 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:35.904 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:35.904 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:35.904 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:35.904 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:35.904 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:35.904 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[99735]: pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:11:35.904 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[99735]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:11:35.904 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[99735]: mon.a calling monitor election 2024-06-18T02:11:35.904 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[99735]: pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:11:35.904 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[99735]: from='client.64124 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:11:35.904 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[99735]: from='client.64130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:11:35.904 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[99735]: from='client.64136 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:11:35.905 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[99735]: from='client.? 172.21.15.7:0/1053238641' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:35.905 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[99735]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-06-18T02:11:35.905 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[99735]: monmap epoch 4 2024-06-18T02:11:35.905 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[99735]: fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 2024-06-18T02:11:35.905 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[99735]: last_changed 2024-06-18T02:10:50.706088+0000 2024-06-18T02:11:35.905 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[99735]: created 2024-06-18T01:55:37.939231+0000 2024-06-18T02:11:35.905 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[99735]: min_mon_release 19 (squid) 2024-06-18T02:11:35.905 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[99735]: election_strategy: 1 2024-06-18T02:11:35.905 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[99735]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-06-18T02:11:35.905 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[99735]: 1: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-06-18T02:11:35.905 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[99735]: 2: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-06-18T02:11:35.905 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[99735]: fsmap 2024-06-18T02:11:35.905 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[99735]: osdmap e115: 8 total, 8 up, 8 in 2024-06-18T02:11:35.905 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[99735]: mgrmap e47: x(active, since 2m), standbys: y 2024-06-18T02:11:35.905 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[99735]: overall HEALTH_OK 2024-06-18T02:11:35.905 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='' 2024-06-18T02:11:35.906 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='' 2024-06-18T02:11:35.906 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:35.906 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:35.906 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:35.906 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:35.906 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:35.906 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:35 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:36.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:35 smithi130 ceph-mon[84407]: pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:11:36.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:35 smithi130 ceph-mon[84407]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:11:36.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:35 smithi130 ceph-mon[84407]: mon.a calling monitor election 2024-06-18T02:11:36.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:35 smithi130 ceph-mon[84407]: pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:11:36.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:35 smithi130 ceph-mon[84407]: from='client.64124 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:11:36.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:35 smithi130 ceph-mon[84407]: from='client.64130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:11:36.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:35 smithi130 ceph-mon[84407]: from='client.64136 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:11:36.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:35 smithi130 ceph-mon[84407]: from='client.? 172.21.15.7:0/1053238641' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:36.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:35 smithi130 ceph-mon[84407]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-06-18T02:11:36.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:35 smithi130 ceph-mon[84407]: monmap epoch 4 2024-06-18T02:11:36.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:35 smithi130 ceph-mon[84407]: fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 2024-06-18T02:11:36.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:35 smithi130 ceph-mon[84407]: last_changed 2024-06-18T02:10:50.706088+0000 2024-06-18T02:11:36.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:35 smithi130 ceph-mon[84407]: created 2024-06-18T01:55:37.939231+0000 2024-06-18T02:11:36.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:35 smithi130 ceph-mon[84407]: min_mon_release 19 (squid) 2024-06-18T02:11:36.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:35 smithi130 ceph-mon[84407]: election_strategy: 1 2024-06-18T02:11:36.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:35 smithi130 ceph-mon[84407]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-06-18T02:11:36.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:35 smithi130 ceph-mon[84407]: 1: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-06-18T02:11:36.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:35 smithi130 ceph-mon[84407]: 2: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-06-18T02:11:36.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:35 smithi130 ceph-mon[84407]: fsmap 2024-06-18T02:11:36.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:35 smithi130 ceph-mon[84407]: osdmap e115: 8 total, 8 up, 8 in 2024-06-18T02:11:36.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:35 smithi130 ceph-mon[84407]: mgrmap e47: x(active, since 2m), standbys: y 2024-06-18T02:11:36.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:35 smithi130 ceph-mon[84407]: overall HEALTH_OK 2024-06-18T02:11:36.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:35 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='' 2024-06-18T02:11:36.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:35 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='' 2024-06-18T02:11:36.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:35 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:36.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:35 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:36.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:35 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:36.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:36.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:36.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:35 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:36.822 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[99735]: from='client.64148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:11:36.822 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:36.822 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:36.823 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:36.823 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:36.823 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:36.823 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:36.823 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:36.823 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:36.823 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:36.823 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:36.823 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:36.823 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:36.823 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:36.823 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[99735]: pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:11:36.823 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[99735]: from='client.? 172.21.15.7:0/4165501616' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:11:36.823 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:36.824 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:36.824 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:36.824 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:36.824 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:36.824 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:36.824 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:36.824 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:36.824 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:36.824 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:36.824 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:36.824 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:36.824 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:36.825 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[108250]: from='client.64148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:11:36.825 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:36.825 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:36.825 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:36.825 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:36.825 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:36.825 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:36.825 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:36.825 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:36.825 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:36.825 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:36.826 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:36.826 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:36.826 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:36.826 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[108250]: pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:11:36.826 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[108250]: from='client.? 172.21.15.7:0/4165501616' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:11:36.826 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:36.826 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:36.826 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:36.826 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:36.826 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:36.827 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:36.827 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:36.827 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:36.827 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:36.827 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:36.827 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:36.827 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:36.827 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:36.827 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:36.828 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:36.828 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:36.828 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:36.828 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:36.828 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:36.828 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:36.828 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:36.828 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:36.828 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:36.828 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:36.828 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:36.828 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:36.829 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:36.829 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:36.829 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:36.829 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:36.829 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:36.829 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:36.829 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:36.829 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:36.829 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:36.830 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:36.830 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:36.830 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:36.830 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:36.830 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:36.830 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:36.830 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:36.830 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:36.831 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:36.831 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:36.831 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:36.831 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:36.831 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:36.831 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:36.831 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:36.831 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:36.831 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:36.831 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:36.831 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:36.831 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:36.831 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:36.831 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:36.832 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:36.832 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:36.832 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:36.832 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:36 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:37.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:36 smithi130 ceph-mon[84407]: from='client.64148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:11:37.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:36 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:37.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:37.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:37.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:37.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:37.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:36 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:37.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:36 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:37.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:37.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:37.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:37.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:37.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:36 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:37.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:36 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:37.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:36 smithi130 ceph-mon[84407]: pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:11:37.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:36 smithi130 ceph-mon[84407]: from='client.? 172.21.15.7:0/4165501616' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:11:37.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:37.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:37.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:37.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:37.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:36 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:37.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:36 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:37.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:37.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:37.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:37.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:37.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:36 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:37.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:36 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:37.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:37.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:37.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:37.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:37.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:36 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:37.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:37.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:37.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:37.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:37.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:36 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:37.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:37.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:37.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:37.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:37.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:36 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:37.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:37.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:37.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:37.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:37.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:36 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:37.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:37.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:37.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:37.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:37.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:36 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:37.902 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:37.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:37.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:37.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:37.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:37.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:37.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:37.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:37.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:37.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:37.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:37.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:37.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:37.904 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:37.904 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:37.904 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:37.904 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:37.904 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:37.904 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:37.904 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:37.904 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:37.904 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:37.904 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:37.904 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:37.904 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:37.904 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:37.904 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:37.905 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:37.905 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:37.905 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:37.905 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:37.905 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:37.905 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:37.905 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:37.905 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:37.905 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:37.906 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:37.906 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:37.906 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:37.906 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:37.906 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:37.906 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:37.906 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:37.906 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:37.906 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:37.906 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:37.906 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:37.906 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:37.906 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:37.906 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:37.907 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:37.907 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:37.907 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:37.907 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:37.907 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:37.907 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:37.907 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:37.907 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:37.907 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:37.907 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:37.907 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:37.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:37.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:37.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:37.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:37.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:37.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:37.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:37.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:37.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:37.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:37.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:37.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:37.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:37.909 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:37.909 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:37.909 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:37.909 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:37.909 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:37.909 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:37.909 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:37.909 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:37.909 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:37.909 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:37.909 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:37.910 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:37.910 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:37.910 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:37.910 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:37.910 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:37.910 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:37.910 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:37.910 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:37.910 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:37.910 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:37.910 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:37.910 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:37.910 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:37 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:38.043 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:11:37 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:11:37] "GET /metrics HTTP/1.1" 200 38196 "" "Prometheus/2.33.4" 2024-06-18T02:11:38.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:37 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:38.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:37 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:38.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:37 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:38.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:37 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:38.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:37 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:38.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:38.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:38.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:38.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:38.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:37 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:38.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:37 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:38.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:38.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:38.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:38.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:38.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:37 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:38.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:37 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:38.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:38.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:38.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:38.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:38.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:37 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:38.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:37 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:38.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:38.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:38.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:38.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:38.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:37 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:38.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:37 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:38.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:38.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:38.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:38.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:38.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:37 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:38.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:38.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:38.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:38.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:38.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:37 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:38.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:38.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:38.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:38.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:38.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:37 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:38.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:38.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:38.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:38.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:38.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:37 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:38.829 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:38.829 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:38.829 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:38.829 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:38.829 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:38.829 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:38.830 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:38.830 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:38.830 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:38.830 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:38.830 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:38.830 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:38.830 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:38.830 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:38.830 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:38.830 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:38.830 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:38.830 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:38.830 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:38.830 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:38.831 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:38.831 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:38.831 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[99735]: pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:11:38.831 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:38.831 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:38.831 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:38.831 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:38.831 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:38.831 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:38.831 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:38.831 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:38.832 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:38.832 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:38.832 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:38.832 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:38.832 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:38.832 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:38.832 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:38.832 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:38.832 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:38.832 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:38.832 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:38.832 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:38.832 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:38.832 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:38.833 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:38.833 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:38.833 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:38.833 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:38.833 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:38.833 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:38.833 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:38.833 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[108250]: pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:11:38.833 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:38.833 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:38.833 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:38.833 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:38.833 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:38.833 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:38.833 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:38.834 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:38.834 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:38.834 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:38.834 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:38.834 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:38.834 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:38.834 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:38.834 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:38.834 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:38.834 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:38.835 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:38.835 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:38.835 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:38.835 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:38.835 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:38.835 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:38.835 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:38.835 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:38.835 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:38.835 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:38.835 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:38.835 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:38.835 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:38.835 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:38.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:38.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:38.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:38.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:38.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:38.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:38.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:38.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:38.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:38.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:38.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:38.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:38.837 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:38.837 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:38.837 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:38.837 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:38.837 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:38.837 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:38.837 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:38.837 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:38.837 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:38.837 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:38.837 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:38.837 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:38 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:39.043 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:11:38 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:11:38.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.7\", device_class=\"ssd\", hostname=\"smithi007\", instance=\"172.21.15.130:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.7\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"cd9a3408-2d15-11ef-bc9d-c7b262605968\", cluster_addr=\"172.21.15.7\", device_class=\"ssd\", hostname=\"smithi007\", instance=\"smithi130:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.7\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-06-18T02:11:39.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:38 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:39.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:38 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:39.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:38 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:39.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:38 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:39.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:39.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:39.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:39.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:39.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:38 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:39.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:38 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:39.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:39.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:39.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:39.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:39.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:38 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:39.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:38 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:39.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:39.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:39.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:39.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:39.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:38 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:39.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:38 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:39.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:38 smithi130 ceph-mon[84407]: pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:11:39.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:39.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:39.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:39.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:39.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:38 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:39.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:38 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:39.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:39.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:39.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:39.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:39.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:38 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:39.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:39.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:39.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:39.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:39.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:38 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:39.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:39.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:39.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:39.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:39.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:38 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:39.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:39.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:39.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:39.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:39.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:38 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:39.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:39.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:39.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:39.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:39.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:38 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:39.850 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:39.850 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:39.851 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:39.851 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:39.851 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:39.851 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:39.851 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:39.851 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:39.851 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:39.851 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:39.851 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:39.851 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:39.851 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:39.851 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:39.851 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:39.851 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:39.851 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:39.852 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:39.852 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:39.852 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:39.852 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:39.852 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:39.852 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:39.852 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:39.852 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:39.852 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:39.852 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:39.852 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:39.852 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:39.852 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:39.853 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:39.853 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:39.853 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:39.853 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:39.853 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:39.853 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:39.853 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:39.853 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:39.853 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:39.853 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:39.853 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:39.854 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:39.854 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:39.854 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:39.854 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:39.854 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:39.854 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:39.854 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:39.854 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:39.854 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:39.854 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:39.854 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:39.854 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:39.854 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:39.855 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:39.855 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:39.855 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:39.855 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:39.855 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:39.855 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:39.855 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:39.855 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:39.855 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:39.855 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:39.855 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:39.855 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:39.856 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:39.856 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:39.856 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:39.856 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:39.856 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:39.856 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:39.856 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:39.856 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:39.856 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:39.856 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:39.856 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:39.856 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:39.856 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:39.856 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:39.856 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:39.857 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:39.857 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:39.857 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:39.857 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:39.857 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:39.857 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:39.857 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:39.857 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:39.857 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:39.857 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:39.857 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:39.857 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:39.858 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:39.858 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:39.858 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:39.858 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:39.858 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:39.858 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:39.858 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:39.858 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:39.858 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:39.858 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:39.858 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:39.858 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:39.858 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:39.858 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:39.859 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:39 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:40.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:39 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:40.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:39 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:40.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:39 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:40.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:39 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:40.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:39 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:40.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:40.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:40.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:40.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:40.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:39 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:40.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:39 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:40.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:40.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:40.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:40.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:40.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:39 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:40.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:39 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:40.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:40.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:40.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:40.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:40.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:39 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:40.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:39 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:40.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:40.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:40.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:40.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:40.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:39 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:40.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:39 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:40.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:40.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:40.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:40.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:40.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:39 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:40.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:40.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:40.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:40.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:40.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:39 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:40.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:40.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:40.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:40.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:40.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:39 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:40.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:40.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:40.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:40.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:40.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:39 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:40.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:40.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:40.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:40.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:40.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:39 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:40.873 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:40.874 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:40.874 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:40.874 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:40.874 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:40.874 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:40.874 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:40.874 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:40.874 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:40.874 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:40.875 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:40.875 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:40.875 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:40.875 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:40.875 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:40.875 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:40.875 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:40.875 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[99735]: pgmap v106: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:11:40.875 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:40.875 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:40.875 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:40.875 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:40.876 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:40.876 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:40.876 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:40.876 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:40.876 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:40.876 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:40.876 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:40.876 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:40.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:40.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:40.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:40.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:40.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:40.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:40.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:40.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:40.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:40.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:40.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:40.878 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:40.878 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:40.878 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:40.878 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:40.878 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:40.878 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:40.878 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[108250]: pgmap v106: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:11:40.878 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:40.878 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:40.878 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:40.878 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:40.879 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:40.879 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:40.879 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:40.879 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:40.879 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:40.879 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:40.879 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:40.879 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:40.879 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:40.880 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:40.880 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:40.880 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:40.880 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:40.880 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:40.880 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:40.880 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:40.880 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:40.880 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:40.880 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:40.880 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:40.881 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:40.881 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:40.881 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:40.881 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:40.881 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:40.881 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:40.881 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:40.881 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:40.881 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:40.881 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:40.881 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:40.881 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:40.882 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:40.882 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:40.882 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:40.882 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:40.882 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:40.882 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:40.882 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:40.882 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:40.882 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:40.883 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:40.883 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:40.883 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:40.883 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:40.883 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:40.883 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:40.883 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:40.883 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:40.883 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:40.883 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:40.883 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:40.883 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:40.884 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:40.884 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:40.884 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:40.884 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:40.884 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:40 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:41.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:40 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:41.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:40 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:41.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:40 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:41.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:40 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:41.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:40 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:41.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:41.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:41.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:41.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:41.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:40 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:41.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:40 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:41.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:41.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:41.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:41.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:41.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:40 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:41.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:40 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:41.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:40 smithi130 ceph-mon[84407]: pgmap v106: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:11:41.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:41.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:41.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:41.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:41.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:40 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:41.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:40 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:41.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:41.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:41.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:41.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:41.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:40 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:41.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:40 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:41.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:41.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:41.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:41.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:41.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:40 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:41.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:41.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:41.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:41.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:41.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:40 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:41.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:41.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:41.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:41.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:41.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:40 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:41.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:41.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:41.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:41.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:41.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:40 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:41.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:41.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:41.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:41.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:41.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:40 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:41.872 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:41.872 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:41.872 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:41.872 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:41.872 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:41.873 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:41.873 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:41.873 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:41.873 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:41.873 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:41.873 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:41.873 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:41.873 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:41.873 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:41.873 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:41.873 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:41.873 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:41.873 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:41.874 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:41.874 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:41.874 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:41.874 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:41.874 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:41.874 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:41.874 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:41.874 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:41.874 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:41.874 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:41.874 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:41.874 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:41.875 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:41.875 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:41.875 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:41.875 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:41.875 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:41.875 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:41.875 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:41.875 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:41.875 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:41.876 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:41.876 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:41.876 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:41.876 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:41.876 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:41.876 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:41.876 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:41.876 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:41.876 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:41.876 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:41.876 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:41.876 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:41.876 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:41.876 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:41.877 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:41.877 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:41.877 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:41.877 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:41.877 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:41.877 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:41.877 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:41.877 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:41.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:41.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:41.878 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:41.878 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:41.878 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:11:41.878 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:41.878 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:41.878 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:41.878 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:41.878 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:41.878 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:41.878 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:41.878 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:41.879 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:41.879 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:41.879 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:41.879 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:41.879 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:41.879 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:41.879 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:41.879 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:41.879 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:41.879 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:41.879 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:11:41.879 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:41.880 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:41.880 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:41.880 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:41.880 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:41.880 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:41.880 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:41.880 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:41.880 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:41.880 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:41.880 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:41.880 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:41.880 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:41.880 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:41.880 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:41 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:42.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:41 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:42.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:41 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:42.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:41 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:42.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:41 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:42.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:41 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:42.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:42.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:42.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:42.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:42.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:41 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:42.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:41 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:42.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:42.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:42.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:42.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:42.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:41 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:42.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:41 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:42.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:42.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:42.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:42.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:42.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:41 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:42.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:41 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:42.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:42.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:42.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:42.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:42.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:41 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:42.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:41 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:42.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:42.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:42.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:42.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:42.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:41 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:42.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:11:42.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:42.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:42.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:42.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:42.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:41 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:42.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:42.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:42.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:42.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:42.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:41 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:42.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:42.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:42.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:42.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:42.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:41 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:42.903 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:42.903 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:42.903 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:42.904 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:42.904 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:42.904 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:42.904 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:42.904 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:42.904 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:42.904 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:42.904 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:42.904 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:42.904 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:42.904 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:42.904 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:42.904 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:42.905 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:42.905 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:42.905 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:42.905 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:42.905 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:42.905 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:42.905 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[99735]: pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:11:42.905 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:42.905 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:42.905 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:42.905 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:42.905 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:42.905 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:42.905 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[99735]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:11:42.906 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:42.906 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:42.906 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:42.906 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:42.906 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:42.906 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:42.906 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:42.906 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:42.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:42.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:42.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:42.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:42.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:42.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:42.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:42.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:42.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:42.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:42.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:42.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:42.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:42.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:42.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[108250]: pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:11:42.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:42.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:42.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:42.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:42.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:42.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:42.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[108250]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:11:42.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:42.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:42.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:42.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:42.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:42.909 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:42.909 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:42.909 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:42.909 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:42.909 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:42.909 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:42.909 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:42.909 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:42.909 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:42.909 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:42.909 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:42.909 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:42.909 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:42.909 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:42.909 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:42.910 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:42.910 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:42.910 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:42.910 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:42.910 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:42.910 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:42.910 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:42.910 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:42.910 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:42.910 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:42.910 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:42.911 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:42.911 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:42.911 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:42.911 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:42.911 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:42.911 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:42.911 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:42.911 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:42.911 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:42.911 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:42.911 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:42.911 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:42.911 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:42.911 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:42.911 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:42.912 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:42.912 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:42.912 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:42.912 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:43.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:42 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:43.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:42 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:43.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:42 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:43.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:42 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:43.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:43.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:43.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:43.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:43.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:42 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:43.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:42 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:43.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:43.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:43.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:43.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:43.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:42 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:43.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:42 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:43.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:43.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:43.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:43.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:43.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:42 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:43.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:42 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:43.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:42 smithi130 ceph-mon[84407]: pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:11:43.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:43.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:43.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:43.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:43.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:42 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:43.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:42 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:43.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:42 smithi130 ceph-mon[84407]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:11:43.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:43.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:43.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:43.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:43.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:42 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:43.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:43.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:43.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:43.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:43.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:42 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:43.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:43.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:43.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:43.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:43.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:42 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:43.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:43.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:43.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:43.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:43.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:42 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:43.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:43.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:43.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:43.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:43.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:42 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:43.793 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:11:43 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:11:43.505Z caller=manager.go:609 level=warn component="rule manager" group=nodes msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on(instance) group_left(nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi007\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"cd9a3408-2d15-11ef-bc9d-c7b262605968\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-06-18T02:11:43.840 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:43 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:43.840 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:43 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:43.841 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:43 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:43.841 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:43 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:43.841 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:43 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:43.841 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:43.841 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:43.841 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:43.841 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:43.841 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:43 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:43.841 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:43 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:43.841 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:43.841 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:43.841 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:43.841 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:43.842 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:43 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:43.842 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:43 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:43.842 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:43.842 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:43.842 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:43.842 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:43.842 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:43 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:43.842 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:43 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:43.842 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:43.842 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:43.842 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:43.842 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:43.842 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:43 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:43.842 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:43 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:43.843 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:43.843 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:43.843 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:43.843 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:43.843 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:43 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:43.843 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:43.843 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:43.843 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:43.843 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:43.843 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:43 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:43.843 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:43.843 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:43.843 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:43.843 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:43.844 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:43 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:43.844 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:43.844 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:43.844 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:43.844 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:43.844 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:43 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:43.844 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:43.844 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:43.844 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:43.844 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:43.844 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:43 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:43.845 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:43.845 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:43.845 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:43.845 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:43.845 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:43.845 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:43.845 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:43.845 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:43.845 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:43.845 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:43.845 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:43.845 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:43.846 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:43.846 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:43.846 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:43.846 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:43.846 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:43.846 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:43.846 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:43.846 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:43.846 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:43.846 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:43.846 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:43.846 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:43.846 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:43.846 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:43.847 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:43.847 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:43.847 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:43.847 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:43.847 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:43.847 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:43.847 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:43.847 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:43.847 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:43.847 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:43.847 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:43.848 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:43.848 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:43.848 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:43.848 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:43.848 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:43.848 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:43.848 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:43.848 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:43.848 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:43.848 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:43.848 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:43.848 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:43.848 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:43.848 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:43.848 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:43.849 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:43.849 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:43.849 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:43.849 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:43.849 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:43.849 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:43.849 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:43.849 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:43.849 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:43.849 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:43.849 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:43.850 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:43.850 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:43.850 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:43.850 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:43.850 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:43.850 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:43.850 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:43.850 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:43.850 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:43.850 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:43.850 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:43.850 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:43.850 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:43.851 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:43.851 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:43.851 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:43.851 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:43.851 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:43.851 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:43.851 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:43.851 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:43.851 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:43.851 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:43.851 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:43.851 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:43.852 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:43.852 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:43.852 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:43.852 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:43.852 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:43.852 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:43.852 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:43.852 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:43.852 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:43.852 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:43.852 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:43.852 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:43.852 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:43.852 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:43.852 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:43.853 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:43.853 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:43.853 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:43.853 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:43.853 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:43 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:44.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:44.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:44.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:44.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:44.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:44.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:44.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:44.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:44.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:44.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:44.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:44.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:44.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:44.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:44.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:44.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:44.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:44.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[99735]: pgmap v108: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:11:44.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:44.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:44.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:44.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:44.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:44.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:44.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:44.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:44.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:44.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:44.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:44.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:44.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:44.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:44.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:44.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:44.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:44.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:44.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:44.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:44.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:44.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:44.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:44.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:44.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:44.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:44.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:44.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:44.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:44.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[108250]: pgmap v108: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:11:44.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:44.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:44.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:44.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:44.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:44.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:44.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:44.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:44.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:44.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:44.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:44.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:44.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:44.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:44.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:44.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:44.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:44.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:44.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:44.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:44.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:44.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:44.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:44.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:44.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:44.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:44.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:44.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:44.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:44.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:44.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:44.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:44.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:44.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:44.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:44.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:44.942 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:44.942 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:44.942 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:44.942 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:44.942 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:44.942 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:44.942 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:44.942 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:44.942 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:44.942 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:44.942 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:44.943 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:44.943 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:44.943 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:44.943 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:44.943 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:44.943 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:44.943 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:44.943 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:44.943 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:44.943 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:44.943 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:44.943 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:44.943 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:44 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:45.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:44 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:45.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:44 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:45.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:44 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:45.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:44 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:45.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:44 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:45.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:45.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:45.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:45.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:45.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:44 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:45.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:44 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:45.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:45.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:45.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:45.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:45.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:44 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:45.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:44 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:45.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:44 smithi130 ceph-mon[84407]: pgmap v108: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:11:45.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:45.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:45.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:45.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:45.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:44 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:45.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:44 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:45.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:45.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:45.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:45.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:45.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:44 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:45.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:44 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:45.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:45.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:45.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:45.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:45.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:44 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:45.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:45.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:45.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:45.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:45.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:44 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:45.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:45.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:45.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:45.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:45.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:44 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:45.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:45.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:45.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:45.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:45.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:44 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:45.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:45.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:45.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:45.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:45.924 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:45.924 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:45.924 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:45.924 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:45.924 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:45.924 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:45.924 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:45.924 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:45.924 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:45.925 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:45.925 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:45.925 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:45.925 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:45.925 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:45.925 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:45.925 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:45.925 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:45.925 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:45.925 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:45.925 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:45.925 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:45.925 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:45.925 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:45.926 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:45.926 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:45.926 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:45.926 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:45.926 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:45.926 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:45.926 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:45.926 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:45.926 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:45.926 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:45.927 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:45.927 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:45.927 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:45.927 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:45.927 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:45.927 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:45.927 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:45.927 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:45.927 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:45.927 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:45.927 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:45.927 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:45.927 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:45.928 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:45.928 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:45.928 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:45.928 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:45.928 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:45.928 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:45.928 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:45.928 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:45.928 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:45.928 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:45.928 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:45.928 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:45.928 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:45.928 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:45.928 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:45.929 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:45.929 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:45.929 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:45.929 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:45.929 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:45.929 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:45.929 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:45.929 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:45.929 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:45.929 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:45.930 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:45.930 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:45.930 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:45.930 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:45.930 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:45.930 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:45.930 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:45.930 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:45.930 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:45.931 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:45.931 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:45.931 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:45.931 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:45.931 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:45.931 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:45.931 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:45.931 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:45.931 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:45.931 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:45.931 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:45.931 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:45.931 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:45.931 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:45.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:45.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:45.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:45.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:45 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:46.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:45 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:46.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:45 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:46.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:45 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:46.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:45 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:46.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:45 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:46.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:45 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:46.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:46.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:46.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:46.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:46.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:45 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:46.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:45 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:46.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:46.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:46.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:46.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:46.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:45 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:46.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:45 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:46.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:46.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:46.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:46.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:46.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:45 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:46.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:45 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:46.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:46.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:46.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:46.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:46.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:45 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:46.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:46.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:46.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:46.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:46.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:45 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:46.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:46.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:46.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:46.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:46.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:45 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:46.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:46.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:46.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:46.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:46.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:45 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:46.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:46.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:46.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:46.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:46.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:45 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:46.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:46.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:46.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:46.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:46.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:46.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:46.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:46.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:46.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:46.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:46.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:46.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:46.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:46.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:46.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:46.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:46.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:46.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:46.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:46.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:46.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:46.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:46.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:46.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[108250]: pgmap v109: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:11:46.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:46.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:46.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:46.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:46.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:46.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:46.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:46.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:46.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:46.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:46.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:46.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:46.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:46.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:46.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:46.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:46.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:46.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:46.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:46.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:46.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:46.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:46.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:46.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:46.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:46.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:46.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:46.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:46.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:46.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[99735]: pgmap v109: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:11:46.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:46.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:46.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:46.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:46.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:46.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:46.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:46.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:46.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:46.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:46.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:46.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:46.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:46.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:46.942 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:46.942 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:46.942 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:46.942 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:46.942 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:46.943 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:46.943 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:46.943 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:46.943 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:46.943 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:46.944 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:46.944 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:46.944 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:46.944 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:46.944 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:46.944 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:46.945 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:46.945 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:46.945 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:46.945 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:46.945 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:46.946 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:46.946 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:46.946 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:46.946 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:46.946 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:46.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:46.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:46.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:46.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:46.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:46.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:46.948 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:46.948 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:46.948 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:46.948 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:46.948 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:46.948 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:46.949 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:46.949 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:46.949 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:46.949 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:46 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:47.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:46 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:47.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:46 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:47.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:46 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:47.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:46 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:47.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:46 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:47.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:47.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:47.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:47.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:47.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:46 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:47.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:46 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:47.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:47.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:47.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:47.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:47.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:46 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:47.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:46 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:47.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:47.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:47.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:47.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:47.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:46 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:47.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:46 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:47.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:46 smithi130 ceph-mon[84407]: pgmap v109: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:11:47.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:47.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:47.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:47.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:47.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:46 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:47.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:46 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:47.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:47.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:47.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:47.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:47.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:46 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:47.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:47.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:47.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:47.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:47.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:46 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:47.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:47.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:47.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:47.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:47.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:46 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:47.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:47.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:47.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:47.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:47.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:46 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:47.049 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:47.049 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:47.049 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:47.049 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:47.049 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:46 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:47.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:47 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:47.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:47 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:47.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:47 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:47.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:47 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:47.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:47 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:47.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:47.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:47.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:47.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:47.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:47 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:47.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:47 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:47.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:47.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:47.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:47.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:47.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:47 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:47.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:47 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:47.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:47.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:47.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:47.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:47.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:47 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:47.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:47 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:47.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:47 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:47.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:47 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:47.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:47 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:47.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:47.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:47.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-06-18T02:11:47.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-06-18T02:11:47.797 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:47.798 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:47.798 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:47.798 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:47.798 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:47.798 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:47.798 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:47.798 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:47.798 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:47.798 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:47.798 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:47.798 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:47.798 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:47.799 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:47.799 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:47.799 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:47.799 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:47.799 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:47.799 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:47.799 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:47.799 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:47.799 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:47.799 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[108250]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:47.799 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:47.799 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:47.799 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:47.799 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:47.799 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:47.800 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-06-18T02:11:47.800 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-06-18T02:11:47.800 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:47.800 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:47.800 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:47.800 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:47.800 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:47.800 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:47.800 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:47.800 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:47.800 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:47.801 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:47.801 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:47.801 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:47.801 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:47.801 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:47.801 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:47.801 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:47.801 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:47.801 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:47.801 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:47.801 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:47.801 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:47.801 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:47.801 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:47.801 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:47.802 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:47.802 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:47.802 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:47.802 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:47.802 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-06-18T02:11:47.802 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-06-18T02:11:48.279 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:11:47 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:11:47] "GET /metrics HTTP/1.1" 200 38264 "" "Prometheus/2.33.4" 2024-06-18T02:11:48.885 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:48 smithi007 ceph-mon[108250]: Upgrade: It appears safe to stop mon.a 2024-06-18T02:11:48.885 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:48 smithi007 ceph-mon[108250]: pgmap v110: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:11:48.885 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:48 smithi007 ceph-mon[99735]: Upgrade: It appears safe to stop mon.a 2024-06-18T02:11:48.885 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:48 smithi007 ceph-mon[99735]: pgmap v110: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:11:49.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:48 smithi130 ceph-mon[84407]: Upgrade: It appears safe to stop mon.a 2024-06-18T02:11:49.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:48 smithi130 ceph-mon[84407]: pgmap v110: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:11:49.044 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:11:48 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:11:48.659Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.7\", device_class=\"ssd\", hostname=\"smithi007\", instance=\"172.21.15.130:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.7\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"cd9a3408-2d15-11ef-bc9d-c7b262605968\", cluster_addr=\"172.21.15.7\", device_class=\"ssd\", hostname=\"smithi007\", instance=\"smithi130:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.7\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-06-18T02:11:49.749 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-18T02:11:49.749 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-18T02:11:49.750 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:49.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:49 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-18T02:11:49.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:49 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-18T02:11:49.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:49 smithi007 ceph-mon[108250]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:49.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-18T02:11:49.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-18T02:11:49.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:50.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:50 smithi007 ceph-mon[108250]: Upgrade: Updating mon.a 2024-06-18T02:11:50.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:50 smithi007 ceph-mon[108250]: Deploying daemon mon.a on smithi007 2024-06-18T02:11:50.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:50 smithi007 ceph-mon[108250]: pgmap v111: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:11:50.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:50 smithi007 ceph-mon[99735]: Upgrade: Updating mon.a 2024-06-18T02:11:50.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:50 smithi007 ceph-mon[99735]: Deploying daemon mon.a on smithi007 2024-06-18T02:11:50.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:50 smithi007 ceph-mon[99735]: pgmap v111: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:11:51.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:50 smithi130 ceph-mon[84407]: Upgrade: Updating mon.a 2024-06-18T02:11:51.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:50 smithi130 ceph-mon[84407]: Deploying daemon mon.a on smithi007 2024-06-18T02:11:51.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:50 smithi130 ceph-mon[84407]: pgmap v111: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:11:52.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:52 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:52.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:52 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:52.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:52 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:52.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:52 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:52.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:52 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:52.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:52 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:52.390 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:52 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:52.390 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:52 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:52.390 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:52 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:52.390 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:52 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:52.390 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:52 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:52.390 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:52 smithi007 ceph-mon[108250]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:52.391 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:52 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:52.391 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:52 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:52.391 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:52 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:52.391 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:52 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:52.391 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:52 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:52.391 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:52 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:52.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:52 smithi007 systemd[1]: Stopping Ceph mon.a for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:11:53.353 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:52 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-a[108245]: 2024-06-18T02:11:52.936+0000 7f357c58a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-06-18T02:11:53.354 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:52 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-a[108245]: 2024-06-18T02:11:52.936+0000 7f357c58a640 -1 mon.a@0(leader) e4 *** Got Signal Terminated *** 2024-06-18T02:11:53.354 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:53 smithi007 podman[113176]: 2024-06-18 02:11:53.090811676 +0000 UTC m=+0.262276788 container died ac1c3b8dd5987c8c8261eac75327de567e00851ed999458631d8f0770475a03d (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-a, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240612, CEPH_POINT_RELEASE=, RELEASE=squid-3781e3a, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-06-18T02:11:53.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:53 smithi007 podman[113176]: 2024-06-18 02:11:53.453755735 +0000 UTC m=+0.625220838 container cleanup ac1c3b8dd5987c8c8261eac75327de567e00851ed999458631d8f0770475a03d (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-a, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-3781e3a, GIT_CLEAN=True, org.label-schema.build-date=20240612, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-18T02:11:53.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:53 smithi007 bash[113176]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-a 2024-06-18T02:11:53.793 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:11:53 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:11:53.505Z caller=manager.go:609 level=warn component="rule manager" group=nodes msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on(instance) group_left(nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi007\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"cd9a3408-2d15-11ef-bc9d-c7b262605968\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-06-18T02:11:54.097 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:53 smithi007 podman[113188]: 2024-06-18 02:11:53.746708962 +0000 UTC m=+0.655786440 container remove ac1c3b8dd5987c8c8261eac75327de567e00851ed999458631d8f0770475a03d (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-a, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240612, maintainer=Guillaume Abrioux , RELEASE=squid-3781e3a, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-06-18T02:11:54.098 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:53 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mon.a.service: Deactivated successfully. 2024-06-18T02:11:54.098 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:53 smithi007 systemd[1]: Stopped Ceph mon.a for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:11:54.098 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:53 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mon.a.service: Consumed 1.763s CPU time. 2024-06-18T02:11:54.393 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 systemd[1]: Starting Ceph mon.a for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:11:54.394 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 podman[113315]: 2024-06-18 02:11:54.306021421 +0000 UTC m=+0.106123099 container create 7bbe646cd5b70575ab99b276f779bc3de110ae8df5abfe7c6cc37a2172dadf22 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-a, GIT_BRANCH=HEAD, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-3781e3a, ceph=True, org.label-schema.build-date=20240612, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-06-18T02:11:54.394 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 podman[113315]: 2024-06-18 02:11:54.218377451 +0000 UTC m=+0.018479099 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:11:54.761 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 podman[113315]: 2024-06-18 02:11:54.491991589 +0000 UTC m=+0.292093241 container init 7bbe646cd5b70575ab99b276f779bc3de110ae8df5abfe7c6cc37a2172dadf22 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-a, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240612, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-3781e3a, io.buildah.version=1.36.0) 2024-06-18T02:11:54.762 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 podman[113315]: 2024-06-18 02:11:54.495389582 +0000 UTC m=+0.295491230 container start 7bbe646cd5b70575ab99b276f779bc3de110ae8df5abfe7c6cc37a2172dadf22 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-a, org.label-schema.build-date=20240612, RELEASE=squid-3781e3a, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-18T02:11:54.762 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: set uid:gid to 167:167 (ceph:ceph) 2024-06-18T02:11:54.762 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc), process ceph-mon, pid 2 2024-06-18T02:11:54.762 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: pidfile_write: ignore empty --pid-file 2024-06-18T02:11:54.762 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: load: jerasure load: lrc 2024-06-18T02:11:54.762 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: RocksDB version: 7.9.2 2024-06-18T02:11:54.762 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Git sha 0 2024-06-18T02:11:54.762 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Compile date 2024-06-17 15:21:02 2024-06-18T02:11:54.762 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: DB SUMMARY 2024-06-18T02:11:54.762 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: DB Session ID: 30YW34XS1JEED3NZK4I8 2024-06-18T02:11:54.762 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: CURRENT file: CURRENT 2024-06-18T02:11:54.762 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: IDENTITY file: IDENTITY 2024-06-18T02:11:54.763 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: MANIFEST file: MANIFEST-000068 size: 634 Bytes 2024-06-18T02:11:54.763 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000073.sst 2024-06-18T02:11:54.763 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000071.log size: 457949 ; 2024-06-18T02:11:54.763 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.error_if_exists: 0 2024-06-18T02:11:54.763 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.create_if_missing: 0 2024-06-18T02:11:54.763 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.paranoid_checks: 1 2024-06-18T02:11:54.763 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.flush_verify_memtable_count: 1 2024-06-18T02:11:54.763 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-06-18T02:11:54.763 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-06-18T02:11:54.763 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.env: 0x562e0209a740 2024-06-18T02:11:54.763 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.fs: PosixFileSystem 2024-06-18T02:11:54.763 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.info_log: 0x562e02f89000 2024-06-18T02:11:54.763 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.max_file_opening_threads: 16 2024-06-18T02:11:54.763 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.statistics: (nil) 2024-06-18T02:11:54.764 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.use_fsync: 0 2024-06-18T02:11:54.764 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.max_log_file_size: 0 2024-06-18T02:11:54.764 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-06-18T02:11:54.764 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.log_file_time_to_roll: 0 2024-06-18T02:11:54.764 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.keep_log_file_num: 1000 2024-06-18T02:11:54.764 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.recycle_log_file_num: 0 2024-06-18T02:11:54.764 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.allow_fallocate: 1 2024-06-18T02:11:54.764 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.allow_mmap_reads: 0 2024-06-18T02:11:54.764 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.allow_mmap_writes: 0 2024-06-18T02:11:54.764 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.use_direct_reads: 0 2024-06-18T02:11:54.764 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-06-18T02:11:54.764 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.create_missing_column_families: 0 2024-06-18T02:11:54.764 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.db_log_dir: 2024-06-18T02:11:54.764 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.wal_dir: 2024-06-18T02:11:54.764 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.table_cache_numshardbits: 6 2024-06-18T02:11:54.765 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.WAL_ttl_seconds: 0 2024-06-18T02:11:54.765 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.WAL_size_limit_MB: 0 2024-06-18T02:11:54.765 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-06-18T02:11:54.765 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-06-18T02:11:54.765 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.is_fd_close_on_exec: 1 2024-06-18T02:11:54.765 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.advise_random_on_open: 1 2024-06-18T02:11:54.765 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.db_write_buffer_size: 0 2024-06-18T02:11:54.765 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.write_buffer_manager: 0x562e02f981e0 2024-06-18T02:11:54.765 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-06-18T02:11:54.765 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-06-18T02:11:54.765 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.use_adaptive_mutex: 0 2024-06-18T02:11:54.765 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.rate_limiter: (nil) 2024-06-18T02:11:54.765 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-06-18T02:11:54.765 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.wal_recovery_mode: 2 2024-06-18T02:11:54.766 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.enable_thread_tracking: 0 2024-06-18T02:11:54.766 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.enable_pipelined_write: 0 2024-06-18T02:11:54.766 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.unordered_write: 0 2024-06-18T02:11:54.766 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-06-18T02:11:54.766 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-06-18T02:11:54.766 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-06-18T02:11:54.766 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-06-18T02:11:54.766 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.row_cache: None 2024-06-18T02:11:54.766 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.wal_filter: None 2024-06-18T02:11:54.766 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-06-18T02:11:54.767 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.allow_ingest_behind: 0 2024-06-18T02:11:54.767 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.two_write_queues: 0 2024-06-18T02:11:54.767 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.manual_wal_flush: 0 2024-06-18T02:11:54.767 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.wal_compression: 0 2024-06-18T02:11:54.768 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.atomic_flush: 0 2024-06-18T02:11:54.768 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-06-18T02:11:54.768 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.persist_stats_to_disk: 0 2024-06-18T02:11:54.768 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.write_dbid_to_manifest: 0 2024-06-18T02:11:54.768 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.log_readahead_size: 0 2024-06-18T02:11:54.768 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-06-18T02:11:54.768 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.best_efforts_recovery: 0 2024-06-18T02:11:54.768 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-06-18T02:11:54.768 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-06-18T02:11:54.768 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.allow_data_in_errors: 0 2024-06-18T02:11:54.769 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.db_host_id: __hostname__ 2024-06-18T02:11:54.769 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.enforce_single_del_contracts: true 2024-06-18T02:11:54.769 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.max_background_jobs: 2 2024-06-18T02:11:54.769 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.max_background_compactions: -1 2024-06-18T02:11:54.769 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.max_subcompactions: 1 2024-06-18T02:11:54.769 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-06-18T02:11:54.769 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-06-18T02:11:54.769 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.delayed_write_rate : 16777216 2024-06-18T02:11:54.769 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.max_total_wal_size: 0 2024-06-18T02:11:54.769 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-06-18T02:11:54.769 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.stats_dump_period_sec: 600 2024-06-18T02:11:54.769 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.stats_persist_period_sec: 600 2024-06-18T02:11:54.769 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-06-18T02:11:54.769 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.max_open_files: -1 2024-06-18T02:11:54.770 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.bytes_per_sync: 0 2024-06-18T02:11:54.770 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.wal_bytes_per_sync: 0 2024-06-18T02:11:54.770 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.strict_bytes_per_sync: 0 2024-06-18T02:11:54.770 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.compaction_readahead_size: 0 2024-06-18T02:11:54.770 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.max_background_flushes: -1 2024-06-18T02:11:54.770 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Compression algorithms supported: 2024-06-18T02:11:54.770 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: kZSTD supported: 0 2024-06-18T02:11:54.770 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: kXpressCompression supported: 0 2024-06-18T02:11:54.770 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: kBZip2Compression supported: 0 2024-06-18T02:11:54.770 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-06-18T02:11:54.770 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: kLZ4Compression supported: 1 2024-06-18T02:11:54.770 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: kZlibCompression supported: 1 2024-06-18T02:11:54.770 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: kLZ4HCCompression supported: 1 2024-06-18T02:11:54.770 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: kSnappyCompression supported: 1 2024-06-18T02:11:54.771 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Fast CRC32 supported: Supported on x86 2024-06-18T02:11:54.771 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: DMutex implementation: pthread_mutex_t 2024-06-18T02:11:54.771 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000068 2024-06-18T02:11:54.771 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-06-18T02:11:54.771 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-06-18T02:11:54.771 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.merge_operator: 2024-06-18T02:11:54.771 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.compaction_filter: None 2024-06-18T02:11:54.771 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.compaction_filter_factory: None 2024-06-18T02:11:54.771 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.sst_partitioner_factory: None 2024-06-18T02:11:54.771 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.memtable_factory: SkipListFactory 2024-06-18T02:11:54.771 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.table_factory: BlockBasedTable 2024-06-18T02:11:54.771 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x562e02f88d00) 2024-06-18T02:11:54.771 INFO:journalctl@ceph.mon.a.smithi007.stdout: cache_index_and_filter_blocks: 1 2024-06-18T02:11:54.771 INFO:journalctl@ceph.mon.a.smithi007.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-06-18T02:11:54.772 INFO:journalctl@ceph.mon.a.smithi007.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-06-18T02:11:54.772 INFO:journalctl@ceph.mon.a.smithi007.stdout: pin_top_level_index_and_filter: 1 2024-06-18T02:11:54.772 INFO:journalctl@ceph.mon.a.smithi007.stdout: index_type: 0 2024-06-18T02:11:54.772 INFO:journalctl@ceph.mon.a.smithi007.stdout: data_block_index_type: 0 2024-06-18T02:11:54.772 INFO:journalctl@ceph.mon.a.smithi007.stdout: index_shortening: 1 2024-06-18T02:11:54.772 INFO:journalctl@ceph.mon.a.smithi007.stdout: data_block_hash_table_util_ratio: 0.750000 2024-06-18T02:11:54.772 INFO:journalctl@ceph.mon.a.smithi007.stdout: checksum: 4 2024-06-18T02:11:54.772 INFO:journalctl@ceph.mon.a.smithi007.stdout: no_block_cache: 0 2024-06-18T02:11:54.772 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_cache: 0x562e02f7f090 2024-06-18T02:11:54.772 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_cache_name: BinnedLRUCache 2024-06-18T02:11:54.772 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_cache_options: 2024-06-18T02:11:54.772 INFO:journalctl@ceph.mon.a.smithi007.stdout: capacity : 536870912 2024-06-18T02:11:54.772 INFO:journalctl@ceph.mon.a.smithi007.stdout: num_shard_bits : 4 2024-06-18T02:11:54.772 INFO:journalctl@ceph.mon.a.smithi007.stdout: strict_capacity_limit : 0 2024-06-18T02:11:54.772 INFO:journalctl@ceph.mon.a.smithi007.stdout: high_pri_pool_ratio: 0.000 2024-06-18T02:11:54.773 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_cache_compressed: (nil) 2024-06-18T02:11:54.773 INFO:journalctl@ceph.mon.a.smithi007.stdout: persistent_cache: (nil) 2024-06-18T02:11:54.773 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_size: 4096 2024-06-18T02:11:54.773 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_size_deviation: 10 2024-06-18T02:11:54.773 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_restart_interval: 16 2024-06-18T02:11:54.773 INFO:journalctl@ceph.mon.a.smithi007.stdout: index_block_restart_interval: 1 2024-06-18T02:11:54.773 INFO:journalctl@ceph.mon.a.smithi007.stdout: metadata_block_size: 4096 2024-06-18T02:11:54.773 INFO:journalctl@ceph.mon.a.smithi007.stdout: partition_filters: 0 2024-06-18T02:11:54.773 INFO:journalctl@ceph.mon.a.smithi007.stdout: use_delta_encoding: 1 2024-06-18T02:11:54.773 INFO:journalctl@ceph.mon.a.smithi007.stdout: filter_policy: bloomfilter 2024-06-18T02:11:54.773 INFO:journalctl@ceph.mon.a.smithi007.stdout: whole_key_filtering: 1 2024-06-18T02:11:54.773 INFO:journalctl@ceph.mon.a.smithi007.stdout: verify_compression: 0 2024-06-18T02:11:54.773 INFO:journalctl@ceph.mon.a.smithi007.stdout: read_amp_bytes_per_bit: 0 2024-06-18T02:11:54.773 INFO:journalctl@ceph.mon.a.smithi007.stdout: format_version: 5 2024-06-18T02:11:54.774 INFO:journalctl@ceph.mon.a.smithi007.stdout: enable_index_compression: 1 2024-06-18T02:11:54.774 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_align: 0 2024-06-18T02:11:54.774 INFO:journalctl@ceph.mon.a.smithi007.stdout: max_auto_readahead_size: 262144 2024-06-18T02:11:54.774 INFO:journalctl@ceph.mon.a.smithi007.stdout: prepopulate_block_cache: 0 2024-06-18T02:11:54.774 INFO:journalctl@ceph.mon.a.smithi007.stdout: initial_auto_readahead_size: 8192 2024-06-18T02:11:54.774 INFO:journalctl@ceph.mon.a.smithi007.stdout: num_file_reads_for_auto_readahead: 2 2024-06-18T02:11:54.774 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.write_buffer_size: 33554432 2024-06-18T02:11:54.774 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.max_write_buffer_number: 2 2024-06-18T02:11:54.774 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.compression: NoCompression 2024-06-18T02:11:54.774 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.bottommost_compression: Disabled 2024-06-18T02:11:54.774 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.prefix_extractor: nullptr 2024-06-18T02:11:54.774 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-06-18T02:11:54.774 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.num_levels: 7 2024-06-18T02:11:54.774 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-06-18T02:11:54.775 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-06-18T02:11:54.775 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-06-18T02:11:54.775 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-06-18T02:11:54.775 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-06-18T02:11:54.775 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-06-18T02:11:54.775 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-06-18T02:11:54.775 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-06-18T02:11:54.775 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-06-18T02:11:54.775 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-06-18T02:11:54.775 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-06-18T02:11:54.775 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-06-18T02:11:54.775 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.compression_opts.window_bits: -14 2024-06-18T02:11:54.775 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.compression_opts.level: 32767 2024-06-18T02:11:54.775 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.compression_opts.strategy: 0 2024-06-18T02:11:54.776 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-06-18T02:11:54.776 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-06-18T02:11:54.776 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-06-18T02:11:54.776 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-06-18T02:11:54.776 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.compression_opts.enabled: false 2024-06-18T02:11:54.776 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-06-18T02:11:54.776 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-06-18T02:11:54.776 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-06-18T02:11:54.776 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-06-18T02:11:54.776 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.target_file_size_base: 67108864 2024-06-18T02:11:54.776 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.target_file_size_multiplier: 1 2024-06-18T02:11:54.776 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-06-18T02:11:54.776 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-06-18T02:11:54.776 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-06-18T02:11:54.777 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-06-18T02:11:54.777 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-06-18T02:11:54.777 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-06-18T02:11:54.777 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-06-18T02:11:54.777 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-06-18T02:11:54.777 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-06-18T02:11:54.777 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-06-18T02:11:54.777 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-06-18T02:11:54.777 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-06-18T02:11:54.777 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-06-18T02:11:54.777 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.arena_block_size: 1048576 2024-06-18T02:11:54.777 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-06-18T02:11:54.777 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-06-18T02:11:54.777 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.disable_auto_compactions: 0 2024-06-18T02:11:54.777 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-06-18T02:11:54.778 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-06-18T02:11:54.778 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-06-18T02:11:54.778 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-06-18T02:11:54.778 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-06-18T02:11:54.778 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-06-18T02:11:54.778 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-06-18T02:11:54.778 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-06-18T02:11:54.778 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-06-18T02:11:54.778 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-06-18T02:11:54.778 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.table_properties_collectors: 2024-06-18T02:11:54.778 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.inplace_update_support: 0 2024-06-18T02:11:54.778 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.inplace_update_num_locks: 10000 2024-06-18T02:11:54.778 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-06-18T02:11:54.779 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-06-18T02:11:54.779 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.memtable_huge_page_size: 0 2024-06-18T02:11:54.779 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.bloom_locality: 0 2024-06-18T02:11:54.779 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.max_successive_merges: 0 2024-06-18T02:11:54.779 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.optimize_filters_for_hits: 0 2024-06-18T02:11:54.779 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.paranoid_file_checks: 0 2024-06-18T02:11:54.779 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.force_consistency_checks: 1 2024-06-18T02:11:54.779 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.report_bg_io_stats: 0 2024-06-18T02:11:54.779 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.ttl: 2592000 2024-06-18T02:11:54.779 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.periodic_compaction_seconds: 0 2024-06-18T02:11:54.779 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-06-18T02:11:54.779 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-06-18T02:11:54.779 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.enable_blob_files: false 2024-06-18T02:11:54.779 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.min_blob_size: 0 2024-06-18T02:11:54.780 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.blob_file_size: 268435456 2024-06-18T02:11:54.780 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.blob_compression_type: NoCompression 2024-06-18T02:11:54.780 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.enable_blob_garbage_collection: false 2024-06-18T02:11:54.780 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-06-18T02:11:54.780 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-06-18T02:11:54.780 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-06-18T02:11:54.780 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.blob_file_starting_level: 0 2024-06-18T02:11:54.780 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-06-18T02:11:54.780 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-06-18T02:11:54.780 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000068 succeeded,manifest_file_number is 68, next_file_number is 75, last_sequence is 30683, log_number is 71,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 71 2024-06-18T02:11:54.780 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 71 2024-06-18T02:11:54.780 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: e87bb5f4-533e-44e3-a05d-92dfdc098920 2024-06-18T02:11:54.780 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: EVENT_LOG_v1 {"time_micros": 1718676714522528, "job": 1, "event": "recovery_started", "wal_files": [71]} 2024-06-18T02:11:54.780 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #71 mode 2 2024-06-18T02:11:54.781 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: EVENT_LOG_v1 {"time_micros": 1718676714524940, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 76, "file_size": 418279, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 30684, "largest_seqno": 31091, "table_properties": {"data_size": 415679, "index_size": 946, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 5758, "raw_average_key_size": 24, "raw_value_size": 411323, "raw_average_value_size": 1742, "num_data_blocks": 41, "num_entries": 236, "num_filter_entries": 236, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1718676714, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "e87bb5f4-533e-44e3-a05d-92dfdc098920", "db_session_id": "30YW34XS1JEED3NZK4I8", "orig_file_number": 76, "seqno_to_time_mapping": "N/A"}} 2024-06-18T02:11:54.781 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: EVENT_LOG_v1 {"time_micros": 1718676714525042, "job": 1, "event": "recovery_finished"} 2024-06-18T02:11:54.781 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: [db/version_set.cc:5047] Creating manifest 78 2024-06-18T02:11:54.781 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-06-18T02:11:54.781 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000071.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-06-18T02:11:54.781 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x562e02face00 2024-06-18T02:11:54.781 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: DB pointer 0x562e030a2000 2024-06-18T02:11:54.781 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-06-18T02:11:54.781 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-06-18T02:11:54.781 INFO:journalctl@ceph.mon.a.smithi007.stdout: ** DB Stats ** 2024-06-18T02:11:54.781 INFO:journalctl@ceph.mon.a.smithi007.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-18T02:11:54.781 INFO:journalctl@ceph.mon.a.smithi007.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-06-18T02:11:54.781 INFO:journalctl@ceph.mon.a.smithi007.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-18T02:11:54.781 INFO:journalctl@ceph.mon.a.smithi007.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-18T02:11:54.781 INFO:journalctl@ceph.mon.a.smithi007.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-06-18T02:11:54.782 INFO:journalctl@ceph.mon.a.smithi007.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-18T02:11:54.782 INFO:journalctl@ceph.mon.a.smithi007.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-18T02:11:54.782 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-06-18T02:11:54.782 INFO:journalctl@ceph.mon.a.smithi007.stdout: ** Compaction Stats [default] ** 2024-06-18T02:11:54.782 INFO:journalctl@ceph.mon.a.smithi007.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-06-18T02:11:54.782 INFO:journalctl@ceph.mon.a.smithi007.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-06-18T02:11:54.782 INFO:journalctl@ceph.mon.a.smithi007.stdout: L0 1/0 408.48 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 256.7 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-06-18T02:11:54.782 INFO:journalctl@ceph.mon.a.smithi007.stdout: L6 1/0 12.37 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-06-18T02:11:54.782 INFO:journalctl@ceph.mon.a.smithi007.stdout: Sum 2/0 12.77 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 256.7 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-06-18T02:11:54.782 INFO:journalctl@ceph.mon.a.smithi007.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 256.7 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-06-18T02:11:54.782 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-06-18T02:11:54.782 INFO:journalctl@ceph.mon.a.smithi007.stdout: ** Compaction Stats [default] ** 2024-06-18T02:11:54.782 INFO:journalctl@ceph.mon.a.smithi007.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-06-18T02:11:54.782 INFO:journalctl@ceph.mon.a.smithi007.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-06-18T02:11:54.783 INFO:journalctl@ceph.mon.a.smithi007.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 256.7 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-06-18T02:11:54.783 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-06-18T02:11:54.783 INFO:journalctl@ceph.mon.a.smithi007.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-06-18T02:11:54.783 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-06-18T02:11:54.783 INFO:journalctl@ceph.mon.a.smithi007.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-18T02:11:54.783 INFO:journalctl@ceph.mon.a.smithi007.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-06-18T02:11:54.783 INFO:journalctl@ceph.mon.a.smithi007.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-06-18T02:11:54.783 INFO:journalctl@ceph.mon.a.smithi007.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-06-18T02:11:54.783 INFO:journalctl@ceph.mon.a.smithi007.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-06-18T02:11:54.783 INFO:journalctl@ceph.mon.a.smithi007.stdout: AddFile(Keys): cumulative 0, interval 0 2024-06-18T02:11:54.783 INFO:journalctl@ceph.mon.a.smithi007.stdout: Cumulative compaction: 0.00 GB write, 84.64 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-18T02:11:54.783 INFO:journalctl@ceph.mon.a.smithi007.stdout: Interval compaction: 0.00 GB write, 84.64 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-18T02:11:54.783 INFO:journalctl@ceph.mon.a.smithi007.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-06-18T02:11:54.783 INFO:journalctl@ceph.mon.a.smithi007.stdout: Block cache BinnedLRUCache@0x562e02f7f090#2 capacity: 512.00 MB usage: 1.80 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-06-18T02:11:54.784 INFO:journalctl@ceph.mon.a.smithi007.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.72 KB,0.000137091%) IndexBlock(1,1.08 KB,0.000205636%) Misc(1,0.00 KB,0%) 2024-06-18T02:11:54.784 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-06-18T02:11:54.784 INFO:journalctl@ceph.mon.a.smithi007.stdout: ** File Read Latency Histogram By Level [default] ** 2024-06-18T02:11:54.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: starting mon.a rank 0 at public addrs [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] at bind addrs [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 2024-06-18T02:11:54.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: mon.a@-1(???) e4 preinit fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 2024-06-18T02:11:54.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: mon.a@-1(???).mds e1 new map 2024-06-18T02:11:54.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: mon.a@-1(???).mds e1 print_map 2024-06-18T02:11:54.784 INFO:journalctl@ceph.mon.a.smithi007.stdout: e1 2024-06-18T02:11:54.784 INFO:journalctl@ceph.mon.a.smithi007.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-06-18T02:11:54.784 INFO:journalctl@ceph.mon.a.smithi007.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-18T02:11:54.784 INFO:journalctl@ceph.mon.a.smithi007.stdout: legacy client fscid: -1 2024-06-18T02:11:54.784 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-06-18T02:11:54.784 INFO:journalctl@ceph.mon.a.smithi007.stdout: No filesystems configured 2024-06-18T02:11:54.785 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: mon.a@-1(???).osd e115 crush map has features 3314933000854323200, adjusting msgr requires 2024-06-18T02:11:54.785 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: mon.a@-1(???).osd e115 crush map has features 432629239337189376, adjusting msgr requires 2024-06-18T02:11:54.785 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: mon.a@-1(???).osd e115 crush map has features 432629239337189376, adjusting msgr requires 2024-06-18T02:11:54.785 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: mon.a@-1(???).osd e115 crush map has features 432629239337189376, adjusting msgr requires 2024-06-18T02:11:54.785 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 ceph-mon[113333]: mon.a@-1(???).paxosservice(auth 1..31) refresh upgraded, format 0 -> 3 2024-06-18T02:11:54.785 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 bash[113315]: 7bbe646cd5b70575ab99b276f779bc3de110ae8df5abfe7c6cc37a2172dadf22 2024-06-18T02:11:54.785 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:54 smithi007 systemd[1]: Started Ceph mon.a for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:11:57.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:57 smithi007 ceph-mon[99735]: pgmap v113: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:11:57.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:57 smithi007 ceph-mon[99735]: mon.a calling monitor election 2024-06-18T02:11:57.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:57 smithi007 ceph-mon[99735]: pgmap v114: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:11:57.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:11:57.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:57 smithi007 ceph-mon[99735]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-06-18T02:11:57.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:57 smithi007 ceph-mon[99735]: monmap epoch 4 2024-06-18T02:11:57.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:57 smithi007 ceph-mon[99735]: fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 2024-06-18T02:11:57.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:57 smithi007 ceph-mon[99735]: last_changed 2024-06-18T02:10:50.706088+0000 2024-06-18T02:11:57.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:57 smithi007 ceph-mon[99735]: created 2024-06-18T01:55:37.939231+0000 2024-06-18T02:11:57.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:57 smithi007 ceph-mon[99735]: min_mon_release 19 (squid) 2024-06-18T02:11:57.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:57 smithi007 ceph-mon[99735]: election_strategy: 1 2024-06-18T02:11:57.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:57 smithi007 ceph-mon[99735]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-06-18T02:11:57.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:57 smithi007 ceph-mon[99735]: 1: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-06-18T02:11:57.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:57 smithi007 ceph-mon[99735]: 2: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-06-18T02:11:57.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:57 smithi007 ceph-mon[99735]: fsmap 2024-06-18T02:11:57.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:57 smithi007 ceph-mon[99735]: osdmap e115: 8 total, 8 up, 8 in 2024-06-18T02:11:57.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:57 smithi007 ceph-mon[99735]: mgrmap e47: x(active, since 3m), standbys: y 2024-06-18T02:11:57.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:57 smithi007 ceph-mon[99735]: overall HEALTH_OK 2024-06-18T02:11:57.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:57 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='' 2024-06-18T02:11:57.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:57 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='' 2024-06-18T02:11:57.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:57 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:57.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:57.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:57 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:57.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:57.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:57 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:57.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:57 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:57.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:57 smithi007 ceph-mon[113333]: pgmap v113: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:11:57.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:57 smithi007 ceph-mon[113333]: mon.a calling monitor election 2024-06-18T02:11:57.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:57 smithi007 ceph-mon[113333]: pgmap v114: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:11:57.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:11:57.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:57 smithi007 ceph-mon[113333]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-06-18T02:11:57.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:57 smithi007 ceph-mon[113333]: monmap epoch 4 2024-06-18T02:11:57.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:57 smithi007 ceph-mon[113333]: fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 2024-06-18T02:11:57.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:57 smithi007 ceph-mon[113333]: last_changed 2024-06-18T02:10:50.706088+0000 2024-06-18T02:11:57.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:57 smithi007 ceph-mon[113333]: created 2024-06-18T01:55:37.939231+0000 2024-06-18T02:11:57.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:57 smithi007 ceph-mon[113333]: min_mon_release 19 (squid) 2024-06-18T02:11:57.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:57 smithi007 ceph-mon[113333]: election_strategy: 1 2024-06-18T02:11:57.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:57 smithi007 ceph-mon[113333]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-06-18T02:11:57.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:57 smithi007 ceph-mon[113333]: 1: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-06-18T02:11:57.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:57 smithi007 ceph-mon[113333]: 2: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-06-18T02:11:57.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:57 smithi007 ceph-mon[113333]: fsmap 2024-06-18T02:11:57.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:57 smithi007 ceph-mon[113333]: osdmap e115: 8 total, 8 up, 8 in 2024-06-18T02:11:57.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:57 smithi007 ceph-mon[113333]: mgrmap e47: x(active, since 3m), standbys: y 2024-06-18T02:11:57.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:57 smithi007 ceph-mon[113333]: overall HEALTH_OK 2024-06-18T02:11:57.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:57 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='' 2024-06-18T02:11:57.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:57 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='' 2024-06-18T02:11:57.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:57 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:57.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:57.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:57 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:57.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:57.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:57 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:57.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:57 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:58.043 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:11:57 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:11:57] "GET /metrics HTTP/1.1" 200 38195 "" "Prometheus/2.33.4" 2024-06-18T02:11:58.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:57 smithi130 ceph-mon[84407]: pgmap v113: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:11:58.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:57 smithi130 ceph-mon[84407]: mon.a calling monitor election 2024-06-18T02:11:58.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:57 smithi130 ceph-mon[84407]: pgmap v114: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:11:58.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:11:58.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:57 smithi130 ceph-mon[84407]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-06-18T02:11:58.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:57 smithi130 ceph-mon[84407]: monmap epoch 4 2024-06-18T02:11:58.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:57 smithi130 ceph-mon[84407]: fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 2024-06-18T02:11:58.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:57 smithi130 ceph-mon[84407]: last_changed 2024-06-18T02:10:50.706088+0000 2024-06-18T02:11:58.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:57 smithi130 ceph-mon[84407]: created 2024-06-18T01:55:37.939231+0000 2024-06-18T02:11:58.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:57 smithi130 ceph-mon[84407]: min_mon_release 19 (squid) 2024-06-18T02:11:58.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:57 smithi130 ceph-mon[84407]: election_strategy: 1 2024-06-18T02:11:58.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:57 smithi130 ceph-mon[84407]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-06-18T02:11:58.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:57 smithi130 ceph-mon[84407]: 1: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2024-06-18T02:11:58.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:57 smithi130 ceph-mon[84407]: 2: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-06-18T02:11:58.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:57 smithi130 ceph-mon[84407]: fsmap 2024-06-18T02:11:58.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:57 smithi130 ceph-mon[84407]: osdmap e115: 8 total, 8 up, 8 in 2024-06-18T02:11:58.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:57 smithi130 ceph-mon[84407]: mgrmap e47: x(active, since 3m), standbys: y 2024-06-18T02:11:58.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:57 smithi130 ceph-mon[84407]: overall HEALTH_OK 2024-06-18T02:11:58.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:57 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='' 2024-06-18T02:11:58.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:57 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='' 2024-06-18T02:11:58.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:57 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:58.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:58.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:57 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:58.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:58.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:57 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:58.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:57 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:58.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:58.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:58.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:58.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:58.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:58.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:58.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:58.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:58.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:58.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:58.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:58.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:58.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:58.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[99735]: pgmap v115: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:11:58.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:58.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:58.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:58.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:58.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:58.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:58.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:58.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:58.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:58.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:58.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:58.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:58.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:58.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:58.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:58.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:58.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:58.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:58.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:58.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:58.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:58.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:58.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:58.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:58.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:58.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:58.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:58.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:58.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:58.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:58.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:58.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:58.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:58.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:58.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:58.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:58.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:58.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:58.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:58.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:58.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:58.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:58.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:58.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:58.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:58.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[113333]: pgmap v115: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:11:58.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:58.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:58.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:58.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:58.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:58.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:58.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:58.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:58.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:58.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:58.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:58.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:58.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:58.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:58.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:58.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:58.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:58.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:58.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:58.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:58.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:58.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:58.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:58.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:58.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:58.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:58.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:58.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:58.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:58.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:58.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:58.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:58 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:59.043 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:11:58 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:11:58.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.7\", device_class=\"ssd\", hostname=\"smithi007\", instance=\"172.21.15.130:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.7\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"cd9a3408-2d15-11ef-bc9d-c7b262605968\", cluster_addr=\"172.21.15.7\", device_class=\"ssd\", hostname=\"smithi007\", instance=\"smithi130:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.7\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-06-18T02:11:59.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:58 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:59.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:59.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:59.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:59.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:59.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:58 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:59.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:58 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:59.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:59.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:59.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:59.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:59.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:58 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:59.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:58 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:59.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:58 smithi130 ceph-mon[84407]: pgmap v115: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:11:59.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:59.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:59.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:59.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:59.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:58 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:59.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:58 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:59.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:59.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:59.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:59.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:59.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:58 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:59.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:58 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:59.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:59.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:59.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:59.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:59.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:58 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:59.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:59.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:59.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:59.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:59.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:58 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:59.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:59.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:59.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:59.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:59.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:58 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:59.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:59.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:59.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:59.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:59.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:58 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:59.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:59.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:59.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:59.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:59.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:59.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:59.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:59.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:59.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:59.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:59.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:59.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:59.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:59.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:59.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:59.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:59.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:59.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:59.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:59.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:59.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:59.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:59.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:59.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:59.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:59.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:59.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:59.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:59.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:59.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:59.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:59.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:59.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:59.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:59.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:59.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:59.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:59.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:59.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:59.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:59.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:59.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:59.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:59.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:59.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:59.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:59.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:59.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:59.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:59.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:59.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:59.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:59.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:59.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:59.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:59.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:59.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:59.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:11:59.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:59.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:59.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:59.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:59.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:59.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:59.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:59.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:59.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:59.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:59.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:59.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:59.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:59.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:59.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:59.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:59.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:59.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:59.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:59.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:59.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:59.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:59.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:59.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:59.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:59.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:59.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:59.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:59.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:59.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:59.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:59.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:59.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:59.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:59.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:59.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:59.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:59.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:59.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:59.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:59.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:59.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:59.941 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:11:59.941 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:11:59.941 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:11:59.941 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:11:59.941 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:11:59.941 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:11:59 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:00.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:59 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:00.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:59 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:00.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:59 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:00.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:59 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:00.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:00.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:00.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:00.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:00.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:59 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:00.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:59 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:00.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:00.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:00.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:00.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:00.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:59 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:00.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:59 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:00.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:00.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:00.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:00.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:00.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:59 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:00.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:59 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:00.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:00.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:00.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:00.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:00.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:59 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:00.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:59 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:00.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:00.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:00.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:00.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:00.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:59 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:00.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:00.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:00.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:00.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:00.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:59 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:00.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:00.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:00.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:00.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:00.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:59 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:00.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:00.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:00.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:00.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:00.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:59 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:00.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:00.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:00.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:00.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:00.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:11:59 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:00.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:00.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:00.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:00.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:00.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:00.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:00.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:00.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:00.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:00.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:00.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:00.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:00.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:00.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:00.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:00.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:00.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:00.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:00.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:00.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[113333]: pgmap v116: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:12:00.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:00.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:00.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:00.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:00.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:00.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:00.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:00.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:00.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:00.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:00.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:00.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:00.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:00.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:00.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:00.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:00.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:00.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:00.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:00.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:00.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:00.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:00.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:00.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:00.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:00.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:00.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:00.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:00.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:00.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[99735]: pgmap v116: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:12:00.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:00.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:00.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:00.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:00.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:00.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:00.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:00.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:00.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:00.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:00.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:00.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:00.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:00.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:00.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:00.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:00.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:00.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:00.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:00.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:00.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:00.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:00.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:00.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:00.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:00.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:00.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:00.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:00.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:00.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:00.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:00.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:00.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:00.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:00.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:00.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:00.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:00.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:00.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:00.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:00.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:00.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:00.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:00.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:00.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:00.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:00.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:00.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:00.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:00.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:00.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:00.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:00.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:00.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:00.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:00.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:00.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:00.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:00.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:00.941 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:00 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:01.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:00 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:01.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:00 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:01.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:00 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:01.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:00 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:01.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:00 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:01.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:01.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:01.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:01.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:01.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:00 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:01.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:00 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:01.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:01.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:01.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:01.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:01.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:00 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:01.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:00 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:01.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:01.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:01.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:00 smithi130 ceph-mon[84407]: pgmap v116: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:12:01.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:01.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:01.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:00 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:01.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:00 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:01.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:01.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:01.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:01.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:01.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:00 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:01.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:00 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:01.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:01.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:01.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:01.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:01.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:00 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:01.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:01.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:01.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:01.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:01.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:00 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:01.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:01.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:01.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:01.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:01.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:00 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:01.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:01.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:01.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:01.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:01.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:00 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:01.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:01.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:01.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:01.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:01.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:00 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:01.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:01.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:01.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:01.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:01.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:01.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:01.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:01.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:01.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:01.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:01.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:01.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:01.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:01.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:01.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:01.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:01.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:01.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:01.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:01.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:01.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:01.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:01.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:01.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:01.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:01.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:01.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:01.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:01.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:01.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:01.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:01.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:01.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:01.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:01.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:01.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:01.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:01.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:01.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:01.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:01.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:01.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:01.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:01.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:01.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:01.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:01.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:01.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:01.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:01.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:01.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:01.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:01.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:01.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:01.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:01.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:01.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:01.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:01.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:01.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:01.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:01.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:01.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:01.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:01.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:01.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:01.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:01.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:01.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:01.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:01.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:01.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:01.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:01.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:01.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:01.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:01.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:01.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:01.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:01.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:01.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:01.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:01.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:01.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:01.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:01.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:01.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:01.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:01.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:01.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:01.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:01.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:01.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:01.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:01.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:01.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:01.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:01.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:01.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:01.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:01.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:01.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:01.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:01.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:01.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:01.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:02.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:01 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:02.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:01 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:02.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:01 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:02.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:01 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:02.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:01 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:02.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:02.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:02.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:02.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:02.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:01 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:02.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:01 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:02.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:02.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:02.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:02.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:02.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:01 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:02.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:01 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:02.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:02.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:02.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:02.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:02.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:01 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:02.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:01 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:02.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:02.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:02.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:02.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:02.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:01 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:02.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:01 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:02.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:02.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:02.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:02.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:02.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:01 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:02.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:02.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:02.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:02.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:02.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:01 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:02.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:02.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:02.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:02.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:02.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:01 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:02.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:02.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:02.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:02.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:02.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:01 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:02.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:02.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:02.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:02.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:02.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:02.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:02.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:02.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:02.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:02.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:02.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:02.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:02.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:02.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:02.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:02.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:02.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:02.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:02.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:02.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:02.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:02.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:02.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[99735]: pgmap v117: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:12:02.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:02.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:02.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:02.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:02.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:02.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:02.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[99735]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:12:02.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:02.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:02.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:02.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:02.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:02.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:02.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:02.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:02.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:02.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:02.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:02.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:02.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:02.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:02.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:02.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:02.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:02.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:02.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:02.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:02.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:02.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:02.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:02.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[113333]: pgmap v117: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:12:02.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:02.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:02.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:02.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:02.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:02.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:02.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[113333]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:12:02.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:02.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:02.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:02.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:02.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:02.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:02.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:02.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:02.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:02.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:02.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:02.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:02.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:02.941 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:02.941 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:02.941 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:02.941 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:02.941 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:02.941 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:02.941 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:02.941 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:02.941 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:02.941 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:02.941 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:02.941 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:02.942 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:02.942 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:02.942 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:02.942 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:02.942 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:02.942 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:02.942 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:02.942 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:02.942 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:02.942 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:02.943 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:02.943 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:02.943 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:02.943 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:02.943 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:02.943 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:02.943 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:02.943 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:02.943 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:02.943 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:02.943 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:02.943 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:02 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:03.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:02 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:03.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:02 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:03.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:02 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:03.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:02 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:03.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:02 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:03.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:02 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:03.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:03.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:03.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:03.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:03.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:02 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:03.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:02 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:03.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:03.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:03.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:03.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:03.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:02 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:03.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:02 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:03.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:02 smithi130 ceph-mon[84407]: pgmap v117: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:12:03.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:03.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:03.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:03.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:03.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:02 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:03.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:02 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:03.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:02 smithi130 ceph-mon[84407]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:12:03.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:03.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:03.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:03.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:03.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:02 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:03.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:02 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:03.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:03.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:03.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:03.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:03.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:02 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:03.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:03.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:03.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:03.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:03.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:02 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:03.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:03.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:03.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:03.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:03.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:02 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:03.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:03.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:03.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:03.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:03.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:02 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:03.793 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:12:03 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:12:03.505Z caller=manager.go:609 level=warn component="rule manager" group=nodes msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on(instance) group_left(nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi007\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"cd9a3408-2d15-11ef-bc9d-c7b262605968\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-06-18T02:12:03.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:03 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:03.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:03 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:03.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:03 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:03.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:03 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:03.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:03.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:03.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:03.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:03.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:03 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:03.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:03 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:03.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:03.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:03.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:03.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:03.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:03 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:03.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:03 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:03.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:03.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:03.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:03.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:03.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:03 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:03.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:03 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:03.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:03.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:03.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:03.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:03.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:03 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:03.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:03 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:03.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:03.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:03.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:03.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:03.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:03 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:03.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:03.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:03.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:03.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:03.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:03 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:03.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:03.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:03.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:03.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:03.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:03 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:03.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:03.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:03.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:03.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:03.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:03 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:03.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:03.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:03.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:03.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:03.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:03 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:03.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:03.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:03.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:03.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:03.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:03.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:03.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:03.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:03.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:03.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:03.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:03.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:03.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:03.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:03.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:03.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:03.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:03.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:03.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:03.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:03.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:03.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:03.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:03.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:03.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:03.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:03.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:03.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:03.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:03.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:03.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:03.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:03.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:03.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:03.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:03.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:03.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:03.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:03.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:03.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:03.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:03.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:03.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:03.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:03.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:03.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:03.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:03.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:03.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:03.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:03.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:03.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:03.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:03.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:03.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:03.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:03.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:03.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:03.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:03.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:03.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:03.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:03.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:03.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:03.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:03.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:03.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:03.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:03.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:03.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:03.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:03.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:03.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:03.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:03.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:03.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:03.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:03.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:03.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:03.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:03.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:03.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:03.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:03.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:03.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:03.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:03.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:03.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:03.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:03.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:03.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:03.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:03.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:03.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:03.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:03.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:03.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:03.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:03.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:03.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:03.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:03.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:03.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:03.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:03.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:03.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:03 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:04.838 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:04.839 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:04.839 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:04.839 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:04.839 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:04.839 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:04.839 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:04.839 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:04.839 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:04.839 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:04.839 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:04.840 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:04.840 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:04.840 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:04.840 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:04.840 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:04.840 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:04.840 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:04.840 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:04.840 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:04.840 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:04.840 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:04.840 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:04.840 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[99735]: pgmap v118: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:12:04.840 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:04.841 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:04.841 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:04.841 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:04.841 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:04.841 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:04.841 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:04.841 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:04.841 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:04.841 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:04.841 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:04.842 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:04.842 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:04.842 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:04.842 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:04.842 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:04.842 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:04.842 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:04.842 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:04.842 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:04.842 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:04.842 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:04.842 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:04.843 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:04.843 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:04.843 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:04.843 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:04.843 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:04.843 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:04.843 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[113333]: pgmap v118: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:12:04.843 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:04.843 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:04.843 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:04.843 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:04.843 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:04.843 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:04.844 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:04.844 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:04.844 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:04.844 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:04.844 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:04.844 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:04.844 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:04.844 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:04.844 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:04.844 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:04.844 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:04.845 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:04.845 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:04.845 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:04.845 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:04.845 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:04.845 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:04.845 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:04.845 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:04.845 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:04.845 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:04.845 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:04.845 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:04.845 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:04.845 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:04.846 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:04.846 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:04.846 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:04.846 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:04.846 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:04.846 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:04.846 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:04.846 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:04.846 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:04.846 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:04.846 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:04.846 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:04.847 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:04.847 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:04.847 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:04.847 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:04.847 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:04.847 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:04.847 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:04.847 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:04.847 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:04.847 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:04.847 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:04.847 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:04.847 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:04 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:05.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:04 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:05.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:04 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:05.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:04 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:05.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:04 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:05.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:04 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:05.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:05.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:05.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:05.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:05.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:04 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:05.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:04 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:05.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:05.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:05.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:05.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:05.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:04 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:05.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:04 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:05.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:05.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:05.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:05.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:05.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:04 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:05.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:04 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:05.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:04 smithi130 ceph-mon[84407]: pgmap v118: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:12:05.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:05.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:05.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:05.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:05.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:04 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:05.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:04 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:05.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:05.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:05.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:05.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:05.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:04 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:05.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:05.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:05.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:05.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:05.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:04 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:05.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:05.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:05.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:05.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:05.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:04 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:05.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:05.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:05.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:05.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:05.049 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:04 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:05.049 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:05.049 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:05.049 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:05.049 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:05.049 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:04 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:05.863 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:05.863 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:05.863 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:05.863 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:05.863 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:05.863 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:05.864 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:05.864 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:05.864 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:05.864 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:05.864 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:05.864 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:05.864 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:05.864 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:05.864 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:05.864 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:05.864 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:05.864 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:05.864 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:05.864 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:05.865 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:05.865 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:05.865 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:05.865 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:05.865 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:05.865 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:05.865 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:05.865 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:05.865 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:05.865 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:05.865 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:05.866 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:05.866 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:05.866 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:05.866 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:05.866 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:05.866 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:05.866 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:05.866 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:05.866 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:05.866 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:05.866 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:05.866 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:05.866 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:05.866 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:05.867 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:05.867 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:05.867 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:05.867 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:05.867 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:05.867 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:05.867 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:05.867 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:05.867 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:05.867 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:05.867 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:05.867 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:05.867 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:05.867 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:05.868 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:05.868 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:05.868 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:05.868 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:05.868 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:05.868 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:05.868 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:05.868 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:05.868 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:05.868 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:05.868 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:05.869 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:05.869 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:05.869 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:05.869 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:05.869 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:05.869 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:05.869 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:05.869 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:05.869 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:05.869 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:05.869 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:05.869 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:05.869 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:05.870 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:05.870 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:05.870 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:05.870 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:05.870 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:05.870 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:05.870 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:05.870 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:05.870 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:05.870 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:05.870 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:05.870 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:05.870 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:05.870 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:05.871 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:05 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:06.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:05 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:06.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:05 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:06.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:05 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:06.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:05 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:06.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:05 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:06.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:06.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:06.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:06.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:06.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:05 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:06.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:05 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:06.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:06.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:06.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:06.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:06.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:05 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:06.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:05 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:06.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:06.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:06.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:06.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:06.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:05 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:06.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:05 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:06.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:06.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:06.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:06.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:06.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:05 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:06.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:05 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:06.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:06.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:06.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:06.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:06.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:05 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:06.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:06.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:06.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:06.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:06.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:05 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:06.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:06.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:06.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:06.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:06.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:05 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:06.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:06.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:06.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:06.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:06.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:05 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:06.285 INFO:teuthology.orchestra.run.smithi007.stdout:true 2024-06-18T02:12:06.730 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:06.731 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:06.731 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:06.731 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:06.731 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:06.731 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:06.731 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:06.731 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:06.731 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:06.731 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:06.731 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:06.731 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:06.731 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:06.732 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:06.732 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:06.732 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:06.732 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:06.732 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:06.732 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:06.732 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:06.732 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:06.732 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:06.732 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[113333]: pgmap v119: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:12:06.732 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:06.732 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:06.732 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:06.733 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:06.733 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:06.733 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:06.733 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:06.733 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:06.733 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:06.733 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:06.733 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:06.733 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:06.734 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:06.734 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:06.734 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:06.734 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:06.734 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:06.734 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:06.734 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:06.734 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:06.734 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:06.734 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:06.734 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:06.734 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:06.734 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:06.735 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:06.735 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:06.735 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:06.735 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:06.735 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[99735]: pgmap v119: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:12:06.735 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:06.735 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:06.735 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:06.735 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:06.736 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:06.736 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:06.736 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:06.736 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:06.736 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:06.736 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:06.736 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:06.736 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:06.736 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:06.736 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:06.737 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:06.737 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:06.737 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:06.737 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:06.737 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:06.737 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:06.737 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:06.737 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:06.737 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:06.737 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:06.737 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:06.737 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:06.737 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:06.737 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:06.738 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:06.738 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:06.738 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:06.738 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:06.738 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:06.738 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:06.738 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:06.738 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:06.738 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:06.738 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:06.738 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:06.738 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:06.739 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:06.739 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:06.739 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:06.739 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:06.739 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:06.739 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:06.739 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:06.739 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:06.739 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:06.739 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:06.739 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:06.739 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:06.739 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:06.739 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:06.739 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:06 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:07.037 INFO:teuthology.orchestra.run.smithi007.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-18T02:12:07.037 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi007 smithi007 running 15s ago 15m - - 2024-06-18T02:12:07.038 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi130 smithi130 running 12s ago 15m - - 2024-06-18T02:12:07.038 INFO:teuthology.orchestra.run.smithi007.stdout:alertmanager.a smithi007 *:9093,9094 running (5m) 15s ago 9m 22.7M - 0.23.0 ba2b418f427c 5994e8525c64 2024-06-18T02:12:07.038 INFO:teuthology.orchestra.run.smithi007.stdout:grafana.a smithi130 *:3000 running (4m) 12s ago 9m 49.8M - 8.3.5 dad864ee21e9 70ba81d97c8e 2024-06-18T02:12:07.038 INFO:teuthology.orchestra.run.smithi007.stdout:iscsi.foo.smithi007.xvdrwd smithi007 running (3m) 15s ago 8m 52.1M - 3.5 e1d6a67b021e 94121ad2702c 2024-06-18T02:12:07.038 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.x smithi130 *:8443,9283,8765 running (4m) 12s ago 14m 516M - 19.0.0-3124-g3781e3a5 af93c036e016 01017e37bdbe 2024-06-18T02:12:07.038 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.y smithi007 *:8443,9283,8765 running (2m) 15s ago 16m 441M - 19.0.0-3124-g3781e3a5 af93c036e016 2141e131e896 2024-06-18T02:12:07.038 INFO:teuthology.orchestra.run.smithi007.stdout:mon.a smithi007 starting - - - 2048M 2024-06-18T02:12:07.038 INFO:teuthology.orchestra.run.smithi007.stdout:mon.b smithi130 running (78s) 12s ago 14m 43.5M 2048M 19.0.0-3124-g3781e3a5 af93c036e016 baacf2add994 2024-06-18T02:12:07.038 INFO:teuthology.orchestra.run.smithi007.stdout:mon.c smithi007 running (99s) 15s ago 14m 47.0M 2048M 19.0.0-3124-g3781e3a5 af93c036e016 39418356156e 2024-06-18T02:12:07.039 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.a smithi007 *:9100 running (5m) 15s ago 10m 17.1M - 1.3.1 1dbe0e931976 8128e558f099 2024-06-18T02:12:07.039 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.b smithi130 *:9100 running (4m) 12s ago 10m 17.0M - 1.3.1 1dbe0e931976 bab93b43cf16 2024-06-18T02:12:07.039 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0 smithi007 running (14m) 15s ago 14m 55.1M 4096M 17.2.0 e1d6a67b021e 1ef6e23afd55 2024-06-18T02:12:07.039 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1 smithi007 running (13m) 15s ago 13m 56.6M 4096M 17.2.0 e1d6a67b021e a967706523cb 2024-06-18T02:12:07.039 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2 smithi007 running (13m) 15s ago 13m 51.2M 4096M 17.2.0 e1d6a67b021e 2c1b76bd0876 2024-06-18T02:12:07.039 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3 smithi007 running (12m) 15s ago 12m 55.4M 4096M 17.2.0 e1d6a67b021e 8b91b2a07564 2024-06-18T02:12:07.039 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4 smithi130 running (12m) 12s ago 12m 56.8M 4096M 17.2.0 e1d6a67b021e c428dccffdf0 2024-06-18T02:12:07.039 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5 smithi130 running (12m) 12s ago 12m 55.1M 4096M 17.2.0 e1d6a67b021e f645d7f12378 2024-06-18T02:12:07.039 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6 smithi130 running (11m) 12s ago 11m 51.2M 4096M 17.2.0 e1d6a67b021e c7af86c14959 2024-06-18T02:12:07.039 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7 smithi130 running (11m) 12s ago 11m 54.8M 4096M 17.2.0 e1d6a67b021e 3688af8b2c46 2024-06-18T02:12:07.039 INFO:teuthology.orchestra.run.smithi007.stdout:prometheus.a smithi130 *:9095 running (3m) 12s ago 10m 75.7M - 2.33.4 514e6a882f6e e905fb2eb4a6 2024-06-18T02:12:07.040 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi007.dvbvbk smithi007 *:8000 running (8m) 15s ago 8m 76.8M - 17.2.0 e1d6a67b021e 1344b55b763c 2024-06-18T02:12:07.040 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi130.aakmof smithi130 *:8000 running (8m) 12s ago 8m 74.3M - 17.2.0 e1d6a67b021e e257e3230c6c 2024-06-18T02:12:07.040 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi007.hgrnmk smithi007 *:80 running (8m) 15s ago 8m 75.0M - 17.2.0 e1d6a67b021e 2173947bc4d6 2024-06-18T02:12:07.040 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi130.wwebfk smithi130 *:80 running (8m) 12s ago 8m 76.4M - 17.2.0 e1d6a67b021e 8662706b2231 2024-06-18T02:12:07.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:06 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:07.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:06 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:07.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:06 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:07.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:06 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:07.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:07.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:07.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:07.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:07.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:06 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:07.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:06 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:07.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:07.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:07.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:07.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:07.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:06 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:07.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:06 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:07.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:07.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:07.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:07.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:07.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:06 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:07.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:06 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:07.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:06 smithi130 ceph-mon[84407]: pgmap v119: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:12:07.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:07.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:07.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:07.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:07.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:06 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:07.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:06 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:07.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:07.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:07.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:07.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:07.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:06 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:07.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:07.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:07.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:07.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:07.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:06 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:07.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:07.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:07.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:07.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:07.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:06 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:07.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:07.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:07.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:07.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:07.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:06 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:07.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:07.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:07.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:07.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:07.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:06 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:07.464 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:12:07.464 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": { 2024-06-18T02:12:07.464 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 3 2024-06-18T02:12:07.464 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:12:07.464 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": { 2024-06-18T02:12:07.464 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 2 2024-06-18T02:12:07.464 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:12:07.464 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": { 2024-06-18T02:12:07.464 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-06-18T02:12:07.465 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:12:07.465 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw": { 2024-06-18T02:12:07.465 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-06-18T02:12:07.465 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:12:07.465 INFO:teuthology.orchestra.run.smithi007.stdout: "overall": { 2024-06-18T02:12:07.465 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 12, 2024-06-18T02:12:07.465 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 5 2024-06-18T02:12:07.465 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-06-18T02:12:07.465 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:12:07.726 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:07.726 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:07.726 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[113333]: from='client.64160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:12:07.726 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:07.726 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:07.727 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:07.727 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[113333]: from='client.54151 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:12:07.727 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:07.727 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:07.727 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:07.727 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:07.727 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:07.727 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:07.727 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:07.727 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:07.727 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:07.727 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:07.727 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:07.727 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:07.728 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:07.728 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:07.728 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:07.728 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:07.728 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:07.728 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:07.728 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[113333]: from='client.54157 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:12:07.728 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:07.728 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:07.728 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:07.729 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:07.729 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:07.729 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[99735]: from='client.64160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:12:07.729 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:07.729 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:07.729 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:07.729 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[99735]: from='client.54151 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:12:07.729 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:07.729 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:07.730 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:07.730 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:07.730 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:07.730 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:07.730 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:07.730 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:07.730 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:07.730 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:07.730 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:07.730 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:07.730 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:07.730 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:07.731 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:07.731 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:07.731 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:07.731 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:07.731 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[99735]: from='client.54157 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:12:07.731 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:07.731 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:07.731 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:07.731 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:07.731 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:07.731 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:07.732 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:07.732 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:07.732 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:07.732 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:07.732 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:07.732 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:07.732 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:07.732 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:07.732 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:07.732 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:07.732 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:07.733 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:07.733 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:07.733 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:07.733 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:07.733 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[99735]: from='client.? 172.21.15.7:0/1427639605' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:07.733 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:07.733 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:07.733 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:07.733 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:07.733 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:07.733 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:07.734 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:07.734 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:07.734 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:07.734 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:07.734 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:07.734 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:07.734 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:07.734 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:07.734 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:07.734 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:07.734 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:07.734 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:07.734 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:07.735 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:07.735 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:07.735 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:07.735 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:07.735 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[113333]: from='client.? 172.21.15.7:0/1427639605' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:07.735 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:07.735 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:07.735 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:07.735 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:07.735 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:07 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:07.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:07 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:07.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:07 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:07.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:07 smithi130 ceph-mon[84407]: from='client.64160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:12:07.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:07 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:07.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:07 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:07.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:07 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:07.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:07 smithi130 ceph-mon[84407]: from='client.54151 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:12:07.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:07.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:07.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:07.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:07.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:07 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:07.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:07 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:07.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:07.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:07.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:07.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:07.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:07 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:07.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:07 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:07.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:07.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:07.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:07.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:07.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:07 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:07.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:07 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:07.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:07 smithi130 ceph-mon[84407]: from='client.54157 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:12:07.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:07.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:07.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:07.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:07.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:07 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:07.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:07 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:07.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:07.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:07.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:07.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:07.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:07 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:07.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:07.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:07.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:07.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:07.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:07 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:07.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:07.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:07.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:07.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:07.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:07 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:07.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:07 smithi130 ceph-mon[84407]: from='client.? 172.21.15.7:0/1427639605' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:07.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:07.799 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:07.799 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:07.799 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:07.799 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:07 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:07.841 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:12:07.842 INFO:teuthology.orchestra.run.smithi007.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00", 2024-06-18T02:12:07.842 INFO:teuthology.orchestra.run.smithi007.stdout: "in_progress": true, 2024-06-18T02:12:07.842 INFO:teuthology.orchestra.run.smithi007.stdout: "which": "Upgrading all daemon types on all hosts", 2024-06-18T02:12:07.842 INFO:teuthology.orchestra.run.smithi007.stdout: "services_complete": [ 2024-06-18T02:12:07.842 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr" 2024-06-18T02:12:07.842 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-06-18T02:12:07.842 INFO:teuthology.orchestra.run.smithi007.stdout: "progress": "4/23 daemons upgraded", 2024-06-18T02:12:07.842 INFO:teuthology.orchestra.run.smithi007.stdout: "message": "Currently upgrading mon daemons", 2024-06-18T02:12:07.842 INFO:teuthology.orchestra.run.smithi007.stdout: "is_paused": false 2024-06-18T02:12:07.842 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:12:08.250 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:12:07 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:12:07] "GET /metrics HTTP/1.1" 200 38195 "" "Prometheus/2.33.4" 2024-06-18T02:12:08.280 INFO:teuthology.orchestra.run.smithi007.stdout:HEALTH_OK 2024-06-18T02:12:08.834 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:12:08 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:12:08.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.7\", device_class=\"ssd\", hostname=\"smithi007\", instance=\"172.21.15.130:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.7\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"cd9a3408-2d15-11ef-bc9d-c7b262605968\", cluster_addr=\"172.21.15.7\", device_class=\"ssd\", hostname=\"smithi007\", instance=\"smithi130:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.7\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-06-18T02:12:08.835 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:08 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:08.835 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:08 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:08.835 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:08 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:08.835 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:08 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:08.835 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:08.835 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:08.835 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:08.835 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:08.835 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:08 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:08.835 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:08 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:08.835 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:08.835 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:08.836 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:08.836 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:08.836 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:08 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:08.836 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:08 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:08.836 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:08 smithi130 ceph-mon[84407]: from='client.54169 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:12:08.836 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:08.836 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:08.836 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:08.836 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:08.836 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:08 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:08.836 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:08 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:08.836 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:08 smithi130 ceph-mon[84407]: pgmap v120: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:12:08.836 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:08.836 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:08.837 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:08.837 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:08.837 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:08 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:08.837 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:08 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:08.837 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:08.837 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:08.837 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:08.837 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:08.837 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:08 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:08.837 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:08.837 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:08.837 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:08.837 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:08.838 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:08 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:08.838 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:08 smithi130 ceph-mon[84407]: from='client.? 172.21.15.7:0/1598591439' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:12:08.838 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:08.838 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:08.838 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:08.838 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:08.838 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:08 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:08.838 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:08.838 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:08.838 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:08.838 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:08.838 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:08 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:08.838 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:08.839 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:08.839 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:08.839 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:08.839 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:08 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:08.892 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:08.892 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:08.892 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:08.892 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:08.892 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:08.892 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:08.892 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:08.892 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:08.892 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:08.893 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:08.893 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:08.893 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:08.893 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:08.893 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:08.893 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:08.893 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:08.893 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[99735]: from='client.54169 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:12:08.893 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:08.893 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:08.893 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:08.893 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:08.893 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:08.893 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:08.894 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[99735]: pgmap v120: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:12:08.894 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:08.894 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:08.894 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:08.894 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:08.894 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:08.894 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:08.894 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:08.894 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:08.894 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:08.895 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:08.895 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:08.895 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:08.895 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:08.895 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:08.895 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:08.895 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:08.895 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:08.895 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:08.895 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:08.895 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:08.895 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:08.895 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:08.896 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[113333]: from='client.54169 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:12:08.896 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:08.896 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:08.896 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:08.896 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:08.896 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:08.896 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:08.896 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[113333]: pgmap v120: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:12:08.896 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:08.896 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:08.896 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:08.896 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:08.896 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:08.896 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:08.897 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:08.897 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:08.897 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:08.897 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:08.897 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:08.897 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:08.897 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:08.897 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:08.897 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:08.897 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:08.898 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[99735]: from='client.? 172.21.15.7:0/1598591439' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:12:08.898 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:08.898 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:08.898 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:08.898 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:08.898 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:08.898 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:08.898 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:08.898 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:08.898 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:08.898 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:08.898 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:08.898 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:08.899 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:08.899 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:08.899 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:08.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:08.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:08.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:08.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:08.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:08.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:08.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:08.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:08.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:08.900 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:08.900 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[113333]: from='client.? 172.21.15.7:0/1598591439' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:12:08.900 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:08.900 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:08.900 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:08.900 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:08.900 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:08.900 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:08.900 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:08.900 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:08.900 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:08.900 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:08.900 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:08.901 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:08.901 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:08.901 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:08.901 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:08 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:09.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:09 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:09.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:09 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:09.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:09 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:09.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:09 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:09.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:09 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:09.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:09.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:09.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:09.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:09.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:09 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:09.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:09 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:09.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:09.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:09.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:09.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:09.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:09 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:09.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:09 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:09.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:09.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:09.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:09.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:09.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:09 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:09.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:09 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:09.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:09.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:09.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:09.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:09.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:09 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:09.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:09 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:09.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:09.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:09.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:09.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:09.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:09 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:09.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:09.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:09.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:09.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:09.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:09 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:09.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:09.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:09.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:09.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:09.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:09 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:09.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:09.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:09.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:09.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:09.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:09 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:09.923 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:09.923 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:09.924 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:09.924 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:09.924 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:09.924 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:09.924 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:09.924 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:09.924 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:09.924 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:09.924 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:09.924 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:09.924 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:09.924 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:09.924 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:09.925 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:09.925 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:09.925 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:09.925 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:09.925 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:09.925 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:09.925 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:09.925 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:09.925 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:09.925 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:09.925 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:09.925 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:09.925 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:09.925 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:09.926 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:09.926 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:09.926 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:09.926 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:09.926 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:09.926 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:09.926 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:09.926 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:09.926 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:09.926 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:09.926 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:09.926 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:09.926 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:09.926 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:09.927 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:09.927 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:09.927 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:09.927 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:09.927 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:09.927 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:09.927 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:09.927 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:09.927 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:09.927 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:09.928 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:09.928 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:09.928 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:09.928 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:09.928 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:09.928 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:09.928 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:09.928 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:09.928 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:09.928 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:09.928 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:09.928 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:09.928 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:09.928 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:09.929 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:09.929 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:09.929 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:09.929 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:09.929 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:09.929 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:09.929 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:09.929 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:09.929 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:09.929 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:09.929 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:09.929 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:09.929 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:09.930 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:09.930 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:09.930 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:09.930 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:09.930 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:09.930 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:09.930 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:09.930 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:09.930 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:09.930 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:09.930 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:09.930 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:09.930 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:09.931 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:09.931 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:09.931 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:09.931 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:09.931 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:09 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:10.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:10.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:10.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:10.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:10.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:10.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:10.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:10.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:10.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:10.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:10.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:10.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:10.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:10.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:10.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:10.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:10.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:10.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:10.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:10.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:10.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:10.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:10.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[113333]: pgmap v121: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:12:10.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:10.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:10.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:10.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:10.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:10.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:10.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:10.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:10.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:10.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:10.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:10.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:10.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:10.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:10.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:10.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:10.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:10.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:10.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:10.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:10.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:10.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:10.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:10.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:10.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:10.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:10.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:10.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:10.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:10.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[99735]: pgmap v121: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:12:10.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:10.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:10.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:10.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:10.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:10.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:10.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:10.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:10.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:10.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:10.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:10.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:10.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:10.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:10.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:10.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:10.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:10.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:10.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:10.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:10.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:10.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:10.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:10.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:10.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:10.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:10.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:10.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:10.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:10.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:10.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:10.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:10.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:10.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:10.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:10.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:10.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:10.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:10.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:10.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:10.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:10.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:10.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:10.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:10.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:10.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:10.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:10.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:10.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:10.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:10.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:10.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:10.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:10.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:10.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:10 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:11.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:10 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:11.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:10 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:11.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:10 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:11.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:10 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:11.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:11.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:11.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:11.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:11.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:10 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:11.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:10 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:11.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:11.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:11.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:11.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:11.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:10 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:11.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:10 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:11.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:11.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:11.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:11.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:11.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:10 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:11.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:10 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:11.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:10 smithi130 ceph-mon[84407]: pgmap v121: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:12:11.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:11.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:11.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:11.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:11.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:10 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:11.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:10 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:11.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:11.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:11.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:11.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:11.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:10 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:11.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:11.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:11.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:11.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:11.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:10 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:11.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:11.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:11.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:11.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:11.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:10 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:11.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:11.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:11.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:11.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:11.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:10 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:11.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:11.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:11.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:11.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:11.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:10 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:11.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:11.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:11.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:11.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:11.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:11.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:11.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:11.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:11.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:11.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:11.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:11.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:11.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:11.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:11.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:11.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:11.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:11.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:11.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:11.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:11.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:11.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:11.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:11.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:11.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:11.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:11.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:11.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:11.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:11.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[113333]: Upgrade: Setting container_image for all mon 2024-06-18T02:12:11.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:11.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-06-18T02:12:11.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:11.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:11.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:11.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:11.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:11.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:11.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:11.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:11.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:11.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:11.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:11.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:11.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:11.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:11.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:11.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:11.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:11.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:11.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:11.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:11.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:11.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:11.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:11.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:11.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:11.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:11.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:11.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:11.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:11.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[99735]: Upgrade: Setting container_image for all mon 2024-06-18T02:12:11.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:11.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-06-18T02:12:11.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-06-18T02:12:11.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2024-06-18T02:12:11.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-06-18T02:12:11.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-06-18T02:12:11.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2024-06-18T02:12:11.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-06-18T02:12:11.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-06-18T02:12:11.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2024-06-18T02:12:11.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:11.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[113333]: Upgrade: Setting container_image for all crash 2024-06-18T02:12:11.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:11.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-06-18T02:12:11.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[113333]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-06-18T02:12:11.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[113333]: Upgrade: osd.0 is safe to restart 2024-06-18T02:12:11.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:12:11.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:11.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:11.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:11.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-06-18T02:12:11.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2024-06-18T02:12:11.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-06-18T02:12:11.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-06-18T02:12:11.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2024-06-18T02:12:11.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-06-18T02:12:11.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-06-18T02:12:11.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2024-06-18T02:12:11.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:11.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[99735]: Upgrade: Setting container_image for all crash 2024-06-18T02:12:11.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:11.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-06-18T02:12:11.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[99735]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-06-18T02:12:11.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[99735]: Upgrade: osd.0 is safe to restart 2024-06-18T02:12:11.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:12:11.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:11.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:11.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:11 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:12.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:11 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:12.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:11 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:12.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:11 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:12.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:11 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:12.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:11 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:12.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:12.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:12.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:12.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:12.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:11 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:12.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:11 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:12.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:12.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:12.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:12.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:12.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:11 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:12.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:11 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:12.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:12.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:12.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:12.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:12.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:11 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:12.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:11 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:12.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:11 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:12.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:11 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:12.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:11 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:12.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:12.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:12.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:12.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:11 smithi130 ceph-mon[84407]: Upgrade: Setting container_image for all mon 2024-06-18T02:12:12.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:11 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:12.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-06-18T02:12:12.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:11 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-06-18T02:12:12.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:11 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2024-06-18T02:12:12.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-06-18T02:12:12.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:11 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-06-18T02:12:12.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:11 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2024-06-18T02:12:12.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-06-18T02:12:12.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:11 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-06-18T02:12:12.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:11 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2024-06-18T02:12:12.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:12.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:11 smithi130 ceph-mon[84407]: Upgrade: Setting container_image for all crash 2024-06-18T02:12:12.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:11 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:12.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-06-18T02:12:12.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:11 smithi130 ceph-mon[84407]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-06-18T02:12:12.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:11 smithi130 ceph-mon[84407]: Upgrade: osd.0 is safe to restart 2024-06-18T02:12:12.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:12:12.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:11 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:12.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:11 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:12.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:11 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:12.733 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:12 smithi007 ceph-mon[113333]: pgmap v122: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:12:12.733 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:12 smithi007 ceph-mon[113333]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:12:12.733 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:12 smithi007 ceph-mon[99735]: pgmap v122: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:12:12.734 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:12 smithi007 ceph-mon[99735]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:12:13.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:12 smithi130 ceph-mon[84407]: pgmap v122: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:12:13.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:12 smithi130 ceph-mon[84407]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:12:13.793 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:12:13 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:12:13.506Z caller=manager.go:609 level=warn component="rule manager" group=nodes msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on(instance) group_left(nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi007\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"cd9a3408-2d15-11ef-bc9d-c7b262605968\", domainname=\"(none)\", instance=\"smithi007\", job=\"node\", machine=\"x86_64\", nodename=\"smithi007\", release=\"5.14.0-460.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Jun 6 12:49:42 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-06-18T02:12:15.279 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:14 smithi007 ceph-mon[113333]: pgmap v123: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:12:15.280 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:14 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:15.280 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-06-18T02:12:15.280 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:15.280 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:14 smithi007 ceph-mon[99735]: pgmap v123: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:12:15.280 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:14 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:15.280 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-06-18T02:12:15.280 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:15.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:14 smithi130 ceph-mon[84407]: pgmap v123: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:12:15.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:14 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:15.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-06-18T02:12:15.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:16.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:15 smithi130 ceph-mon[84407]: Upgrade: Updating osd.0 2024-06-18T02:12:16.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:15 smithi130 ceph-mon[84407]: Deploying daemon osd.0 on smithi007 2024-06-18T02:12:16.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:15 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:16.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:15 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:16.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:15 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:16.097 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:15 smithi007 ceph-mon[113333]: Upgrade: Updating osd.0 2024-06-18T02:12:16.097 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:15 smithi007 ceph-mon[113333]: Deploying daemon osd.0 on smithi007 2024-06-18T02:12:16.097 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:15 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:16.097 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:15 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:16.097 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:15 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:16.097 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:15 smithi007 ceph-mon[99735]: Upgrade: Updating osd.0 2024-06-18T02:12:16.097 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:15 smithi007 ceph-mon[99735]: Deploying daemon osd.0 on smithi007 2024-06-18T02:12:16.097 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:15 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:16.097 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:15 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:16.097 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:15 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:17.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:16 smithi007 ceph-mon[99735]: pgmap v124: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:12:17.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:16 smithi007 ceph-mon[113333]: pgmap v124: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:12:17.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:16 smithi130 ceph-mon[84407]: pgmap v124: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:12:17.931 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:17 smithi007 systemd[1]: Stopping Ceph osd.0 for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:12:18.194 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:12:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:12:17] "GET /metrics HTTP/1.1" 200 38263 "" "Prometheus/2.33.4" 2024-06-18T02:12:18.431 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:18 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0[33109]: 2024-06-18T02:12:18.035+0000 7f0d6558c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-18T02:12:18.432 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:18 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0[33109]: 2024-06-18T02:12:18.035+0000 7f0d6558c700 -1 osd.0 115 *** Got signal Terminated *** 2024-06-18T02:12:18.432 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:18 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0[33109]: 2024-06-18T02:12:18.035+0000 7f0d6558c700 -1 osd.0 115 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-18T02:12:19.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:18 smithi130 ceph-mon[84407]: pgmap v125: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:12:19.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:18 smithi130 ceph-mon[84407]: osd.0 marked itself down and dead 2024-06-18T02:12:19.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:18 smithi007 ceph-mon[113333]: pgmap v125: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:12:19.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:18 smithi007 ceph-mon[113333]: osd.0 marked itself down and dead 2024-06-18T02:12:19.306 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:18 smithi007 ceph-mon[99735]: pgmap v125: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:12:19.306 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:18 smithi007 ceph-mon[99735]: osd.0 marked itself down and dead 2024-06-18T02:12:19.561 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:19 smithi007 podman[119024]: 2024-06-18 02:12:19.30751393 +0000 UTC m=+1.384410147 container died 1ef6e23afd552176a2b38f4d426d2e6f510dbbac5c33737d151431513334bd0c (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0, com.redhat.component=centos-stream-container, release=754, io.openshift.expose-services=, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, RELEASE=HEAD, GIT_BRANCH=HEAD, io.buildah.version=1.19.8, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.openshift.tags=base centos centos-stream, maintainer=Guillaume Abrioux , architecture=x86_64, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, CEPH_POINT_RELEASE=-17.2.0, version=8, build-date=2022-05-03T08:36:31.336870, GIT_CLEAN=True, ceph=True, distribution-scope=public, GIT_REPO=https://github.com/ceph/ceph-container.git, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.k8s.display-name=CentOS Stream 8, vendor=Red Hat, Inc., com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, vcs-type=git, name=centos-stream) 2024-06-18T02:12:19.836 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:19 smithi007 podman[119024]: 2024-06-18 02:12:19.635135153 +0000 UTC m=+1.712031372 container cleanup 1ef6e23afd552176a2b38f4d426d2e6f510dbbac5c33737d151431513334bd0c (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0, GIT_REPO=https://github.com/ceph/ceph-container.git, CEPH_POINT_RELEASE=-17.2.0, io.k8s.display-name=CentOS Stream 8, name=centos-stream, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.buildah.version=1.19.8, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, vcs-type=git, version=8, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.openshift.expose-services=, vendor=Red Hat, Inc., com.redhat.component=centos-stream-container, ceph=True, build-date=2022-05-03T08:36:31.336870, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, architecture=x86_64, io.openshift.tags=base centos centos-stream, release=754, RELEASE=HEAD, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, GIT_CLEAN=True, distribution-scope=public) 2024-06-18T02:12:19.836 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:19 smithi007 bash[119024]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0 2024-06-18T02:12:20.096 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:19 smithi007 ceph-mon[113333]: Health check failed: 1 osds down (OSD_DOWN) 2024-06-18T02:12:20.096 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:19 smithi007 ceph-mon[113333]: osdmap e116: 8 total, 7 up, 8 in 2024-06-18T02:12:20.097 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:19 smithi007 ceph-mon[99735]: Health check failed: 1 osds down (OSD_DOWN) 2024-06-18T02:12:20.097 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:19 smithi007 ceph-mon[99735]: osdmap e116: 8 total, 7 up, 8 in 2024-06-18T02:12:20.097 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:19 smithi007 podman[119040]: 2024-06-18 02:12:19.836876477 +0000 UTC m=+0.525003562 container remove 1ef6e23afd552176a2b38f4d426d2e6f510dbbac5c33737d151431513334bd0c (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0, io.k8s.display-name=CentOS Stream 8, vcs-type=git, io.openshift.tags=base centos centos-stream, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, version=8, distribution-scope=public, architecture=x86_64, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.buildah.version=1.19.8, GIT_CLEAN=True, release=754, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, CEPH_POINT_RELEASE=-17.2.0, GIT_BRANCH=HEAD, RELEASE=HEAD, io.openshift.expose-services=, name=centos-stream, vendor=Red Hat, Inc., GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, build-date=2022-05-03T08:36:31.336870, com.redhat.component=centos-stream-container) 2024-06-18T02:12:20.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:19 smithi130 ceph-mon[84407]: Health check failed: 1 osds down (OSD_DOWN) 2024-06-18T02:12:20.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:19 smithi130 ceph-mon[84407]: osdmap e116: 8 total, 7 up, 8 in 2024-06-18T02:12:20.419 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:20 smithi007 podman[119129]: 2024-06-18 02:12:20.186809941 +0000 UTC m=+0.017488042 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:12:20.419 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:20 smithi007 podman[119129]: 2024-06-18 02:12:20.321113507 +0000 UTC m=+0.151791594 container create c7217a58ffc2919e5d10d2a44a82afe00b28ad861ac1abb6f9a3381309492168 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240612, org.label-schema.license=GPLv2, RELEASE=squid-3781e3a, ceph=True, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-06-18T02:12:20.681 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:20 smithi007 podman[119129]: 2024-06-18 02:12:20.51529478 +0000 UTC m=+0.345972882 container init c7217a58ffc2919e5d10d2a44a82afe00b28ad861ac1abb6f9a3381309492168 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-3781e3a, org.label-schema.schema-version=1.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240612) 2024-06-18T02:12:20.682 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:20 smithi007 podman[119129]: 2024-06-18 02:12:20.518684661 +0000 UTC m=+0.349362750 container start c7217a58ffc2919e5d10d2a44a82afe00b28ad861ac1abb6f9a3381309492168 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, RELEASE=squid-3781e3a, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240612, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0) 2024-06-18T02:12:20.682 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:20 smithi007 podman[119129]: 2024-06-18 02:12:20.590158859 +0000 UTC m=+0.420836957 container attach c7217a58ffc2919e5d10d2a44a82afe00b28ad861ac1abb6f9a3381309492168 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0-deactivate, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-3781e3a, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240612) 2024-06-18T02:12:21.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:20 smithi007 ceph-mon[113333]: pgmap v127: 161 pgs: 21 stale+active+clean, 140 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-06-18T02:12:21.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:20 smithi007 ceph-mon[113333]: osdmap e117: 8 total, 7 up, 8 in 2024-06-18T02:12:21.085 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:20 smithi007 ceph-mon[99735]: pgmap v127: 161 pgs: 21 stale+active+clean, 140 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-06-18T02:12:21.085 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:20 smithi007 ceph-mon[99735]: osdmap e117: 8 total, 7 up, 8 in 2024-06-18T02:12:21.085 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:20 smithi007 podman[119129]: 2024-06-18 02:12:20.793190289 +0000 UTC m=+0.623868378 container died c7217a58ffc2919e5d10d2a44a82afe00b28ad861ac1abb6f9a3381309492168 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-3781e3a, org.label-schema.schema-version=1.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240612, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-18T02:12:21.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:20 smithi130 ceph-mon[84407]: pgmap v127: 161 pgs: 21 stale+active+clean, 140 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-06-18T02:12:21.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:20 smithi130 ceph-mon[84407]: osdmap e117: 8 total, 7 up, 8 in 2024-06-18T02:12:21.337 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:21 smithi007 podman[119152]: 2024-06-18 02:12:21.335493398 +0000 UTC m=+0.536498351 container remove c7217a58ffc2919e5d10d2a44a82afe00b28ad861ac1abb6f9a3381309492168 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3781e3a, org.label-schema.build-date=20240612, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47) 2024-06-18T02:12:21.681 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:21 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.0.service: Deactivated successfully. 2024-06-18T02:12:21.682 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:21 smithi007 systemd[1]: Stopped Ceph osd.0 for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:12:21.682 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:21 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.0.service: Consumed 9.288s CPU time. 2024-06-18T02:12:21.682 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:21 smithi007 systemd[1]: Starting Ceph osd.0 for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:12:22.063 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:21 smithi007 podman[119256]: 2024-06-18 02:12:21.705526649 +0000 UTC m=+0.018140302 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:12:22.064 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:21 smithi007 podman[119256]: 2024-06-18 02:12:21.82840868 +0000 UTC m=+0.141022333 container create 3cfb562ce6580d4a3120105a97cb614f39fc5a2f0c1f34d7360c7905f656937f (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0-activate, org.label-schema.build-date=20240612, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, RELEASE=squid-3781e3a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-06-18T02:12:22.432 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:22 smithi007 podman[119256]: 2024-06-18 02:12:22.065052875 +0000 UTC m=+0.377666538 container init 3cfb562ce6580d4a3120105a97cb614f39fc5a2f0c1f34d7360c7905f656937f (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0-activate, RELEASE=squid-3781e3a, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240612, io.buildah.version=1.36.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, ceph=True, org.label-schema.schema-version=1.0) 2024-06-18T02:12:22.432 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:22 smithi007 podman[119256]: 2024-06-18 02:12:22.069227362 +0000 UTC m=+0.381841016 container start 3cfb562ce6580d4a3120105a97cb614f39fc5a2f0c1f34d7360c7905f656937f (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.36.0, RELEASE=squid-3781e3a, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240612, org.label-schema.vendor=CentOS) 2024-06-18T02:12:22.432 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:22 smithi007 podman[119256]: 2024-06-18 02:12:22.156091576 +0000 UTC m=+0.468705246 container attach 3cfb562ce6580d4a3120105a97cb614f39fc5a2f0c1f34d7360c7905f656937f (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0-activate, GIT_CLEAN=True, io.buildah.version=1.36.0, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240612, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, maintainer=Guillaume Abrioux , RELEASE=squid-3781e3a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-06-18T02:12:22.831 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:22 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0-activate[119271]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-06-18T02:12:22.831 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:22 smithi007 bash[119256]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-06-18T02:12:22.831 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:22 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0-activate[119271]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-06-18T02:12:22.831 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:22 smithi007 bash[119256]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-06-18T02:12:22.831 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:22 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0-activate[119271]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-06-18T02:12:22.831 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:22 smithi007 bash[119256]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-06-18T02:12:22.831 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:22 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0-activate[119271]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-06-18T02:12:22.831 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:22 smithi007 bash[119256]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-06-18T02:12:22.831 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:22 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0-activate[119271]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-06-18T02:12:22.832 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:22 smithi007 bash[119256]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-06-18T02:12:22.832 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:22 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0-activate[119271]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-06-18T02:12:22.832 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:22 smithi007 bash[119256]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-06-18T02:12:22.832 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:22 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0-activate[119271]: --> ceph-volume raw activate successful for osd ID: 0 2024-06-18T02:12:22.832 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:22 smithi007 bash[119256]: --> ceph-volume raw activate successful for osd ID: 0 2024-06-18T02:12:22.832 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:22 smithi007 podman[119256]: 2024-06-18 02:12:22.505817019 +0000 UTC m=+0.818430679 container died 3cfb562ce6580d4a3120105a97cb614f39fc5a2f0c1f34d7360c7905f656937f (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0-activate, RELEASE=squid-3781e3a, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240612, GIT_CLEAN=True, io.buildah.version=1.36.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, ceph=True) 2024-06-18T02:12:23.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:22 smithi007 ceph-mon[99735]: pgmap v129: 161 pgs: 21 stale+active+clean, 140 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-06-18T02:12:23.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:22 smithi007 ceph-mon[99735]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:12:23.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:22 smithi007 ceph-mon[113333]: pgmap v129: 161 pgs: 21 stale+active+clean, 140 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-06-18T02:12:23.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:22 smithi007 ceph-mon[113333]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:12:23.183 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:23 smithi007 podman[119389]: 2024-06-18 02:12:23.001570404 +0000 UTC m=+0.489358858 container remove 3cfb562ce6580d4a3120105a97cb614f39fc5a2f0c1f34d7360c7905f656937f (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0-activate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240612, RELEASE=squid-3781e3a, io.buildah.version=1.36.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-06-18T02:12:23.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:22 smithi130 ceph-mon[84407]: pgmap v129: 161 pgs: 21 stale+active+clean, 140 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-06-18T02:12:23.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:22 smithi130 ceph-mon[84407]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:12:23.512 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:23 smithi007 podman[119450]: 2024-06-18 02:12:23.120855318 +0000 UTC m=+0.018042145 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:12:23.513 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:23 smithi007 podman[119450]: 2024-06-18 02:12:23.236133703 +0000 UTC m=+0.133320519 container create a5158dba820c01f2fe2b6fa3bc1916cb39c8577831d26c16ff6943005c15cb24 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240612, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-3781e3a, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-06-18T02:12:23.513 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:23 smithi007 podman[119450]: 2024-06-18 02:12:23.413857425 +0000 UTC m=+0.311044255 container init a5158dba820c01f2fe2b6fa3bc1916cb39c8577831d26c16ff6943005c15cb24 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.build-date=20240612, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-3781e3a) 2024-06-18T02:12:23.513 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:23 smithi007 podman[119450]: 2024-06-18 02:12:23.417544771 +0000 UTC m=+0.314731588 container start a5158dba820c01f2fe2b6fa3bc1916cb39c8577831d26c16ff6943005c15cb24 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0, io.buildah.version=1.36.0, RELEASE=squid-3781e3a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240612, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True) 2024-06-18T02:12:23.513 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:23 smithi007 ceph-osd[119468]: -- 172.21.15.7:0/2234446754 <== mon.1 v2:172.21.15.7:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a739f97a40 con 0x55a73ad56400 2024-06-18T02:12:23.513 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:23 smithi007 bash[119450]: a5158dba820c01f2fe2b6fa3bc1916cb39c8577831d26c16ff6943005c15cb24 2024-06-18T02:12:23.931 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:23 smithi007 systemd[1]: Started Ceph osd.0 for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:12:24.431 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:23 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0[119464]: 2024-06-18T02:12:23.958+0000 7f88f9ce2640 -1 Falling back to public interface 2024-06-18T02:12:24.822 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:24.822 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:24.822 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:24.822 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:24.822 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:24.822 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:24.822 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:24.823 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:24.823 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:24.823 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:24.823 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:24.823 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:24.823 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:24.823 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:24.823 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:24.823 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:24.823 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:24.823 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:24.823 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[113333]: pgmap v130: 161 pgs: 37 active+undersized, 21 active+undersized+degraded, 103 active+clean; 585 KiB data, 101 MiB used, 715 GiB / 715 GiB avail; 127 B/s rd, 0 op/s; 76/726 objects degraded (10.468%) 2024-06-18T02:12:24.824 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:24.824 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:24.824 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:24.824 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:24.824 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:24.824 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:24.824 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:24.824 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:24.824 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:24.824 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:24.824 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:24.825 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:24.825 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:24.825 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:24.825 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:24.825 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:24.825 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:24.825 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:24.825 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:24.825 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:24.825 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:24.825 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:24.825 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:24.825 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:24.826 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:24.826 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:24.826 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:24.826 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:24.826 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:24.826 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[99735]: pgmap v130: 161 pgs: 37 active+undersized, 21 active+undersized+degraded, 103 active+clean; 585 KiB data, 101 MiB used, 715 GiB / 715 GiB avail; 127 B/s rd, 0 op/s; 76/726 objects degraded (10.468%) 2024-06-18T02:12:24.826 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:24.826 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:24.826 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:24.826 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:24.826 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:24.826 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:24.826 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:24.826 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:24.827 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:24.827 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:24.827 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:24.827 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:24.827 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:24.827 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:24.827 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:24.827 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:24.827 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:24.827 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:24.827 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:24.827 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:24.828 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:24.828 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:24.828 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:24.828 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:24.828 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:24.828 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:24.828 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:24.828 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:24.828 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:24.828 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:24.828 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:24.828 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:24.829 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:24.829 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:24.829 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:24.829 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:24.829 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:24.829 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:24.829 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:24.829 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:24.829 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:24.829 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:24.829 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:24.829 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:24.829 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:24.830 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:24.830 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:24.830 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:24.830 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:24.830 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:24.830 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:24.830 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:24.830 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:24 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:25.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:24 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:25.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:24 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:25.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:25.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:25.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:24 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:25.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:24 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:25.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:25.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:25.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:25.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:25.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:24 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:25.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:24 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:25.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:25.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:25.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:25.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:25.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:24 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:25.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:24 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:25.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:24 smithi130 ceph-mon[84407]: pgmap v130: 161 pgs: 37 active+undersized, 21 active+undersized+degraded, 103 active+clean; 585 KiB data, 101 MiB used, 715 GiB / 715 GiB avail; 127 B/s rd, 0 op/s; 76/726 objects degraded (10.468%) 2024-06-18T02:12:25.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:25.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:25.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:25.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:25.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:24 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:25.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:24 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:25.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:25.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:25.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:25.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:25.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:24 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:25.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:24 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:25.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:25.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:25.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:25.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:25.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:24 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:25.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:25.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:25.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:25.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:25.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:24 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:25.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:25.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:25.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:25.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:25.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:24 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:25.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:25.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:25.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:25.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:25.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:24 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:25.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:25.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:25.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:25.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:25.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:25.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:25.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:25.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:25.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:25.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:25.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:25.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:25.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:25.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:25.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:25.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:25.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[99735]: Health check failed: Degraded data redundancy: 76/726 objects degraded (10.468%), 21 pgs degraded (PG_DEGRADED) 2024-06-18T02:12:25.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:25.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:25.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:25.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:25.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:25.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:25.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:25.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:25.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:25.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:25.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:25.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:25.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:25.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:25.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:25.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:25.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:25.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:25.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:25.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:25.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:25.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:25.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:25.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:25.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:25.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:25.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:25.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:25.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:25.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[113333]: Health check failed: Degraded data redundancy: 76/726 objects degraded (10.468%), 21 pgs degraded (PG_DEGRADED) 2024-06-18T02:12:25.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:25.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:25.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:25.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:25.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:25.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:25.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:25.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:25.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:25.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:25.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:25.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:25.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:25.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:25.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:25.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:25.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:25.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:25.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:25.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:25.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:25.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:25.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:25.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:25.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:25.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:25.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:25.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:25.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:25.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:25.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:25.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:25.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:25.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:25.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:25.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:25.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:25.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:25.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:25.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:25.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:25.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:25.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:25.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:25.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:25.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:25.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:25.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:25.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:25.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:25.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:25 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:26.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:25 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:26.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:25 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:26.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:25 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:26.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:25 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:26.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:26.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:26.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:26.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:26.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:25 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:26.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:25 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:26.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:26.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:26.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:26.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:26.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:25 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:26.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:25 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:26.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:25 smithi130 ceph-mon[84407]: Health check failed: Degraded data redundancy: 76/726 objects degraded (10.468%), 21 pgs degraded (PG_DEGRADED) 2024-06-18T02:12:26.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:26.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:26.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:26.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:26.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:25 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:26.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:25 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:26.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:26.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:26.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:26.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:26.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:25 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:26.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:25 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:26.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:26.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:26.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:26.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:26.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:25 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:26.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:26.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:26.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:26.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:26.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:25 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:26.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:26.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:26.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:26.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:26.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:25 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:26.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:26.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:26.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:26.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:26.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:25 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:26.907 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0[119464]: 2024-06-18T02:12:26.701+0000 7f88f9ce2640 -1 osd.0 0 read_superblock omap replica is missing. 2024-06-18T02:12:26.907 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0[119464]: 2024-06-18T02:12:26.729+0000 7f88f9ce2640 -1 osd.0 115 log_to_monitors true 2024-06-18T02:12:26.908 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:26.908 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:26.908 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:26.908 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:26.908 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:26.908 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:26.908 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:26.908 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:26.909 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:26.909 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:26.909 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:26.909 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:26.909 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:26.909 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:26.909 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:26.909 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:26.909 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:26.909 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:26.909 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:26.909 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:26.909 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:26.909 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:26.909 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[99735]: pgmap v131: 161 pgs: 37 active+undersized, 21 active+undersized+degraded, 103 active+clean; 585 KiB data, 101 MiB used, 715 GiB / 715 GiB avail; 76/726 objects degraded (10.468%) 2024-06-18T02:12:26.910 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:26.910 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:26.910 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:26.910 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:26.910 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:26.910 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:26.910 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:26.910 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:26.910 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:26.910 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:26.911 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:26.911 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:26.911 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:26.911 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:26.911 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:26.911 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:26.911 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:26.911 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:26.911 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:26.911 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:26.911 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:26.911 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:26.911 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:26.911 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:26.912 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:26.912 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:26.912 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:26.912 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:26.912 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:26.912 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[113333]: pgmap v131: 161 pgs: 37 active+undersized, 21 active+undersized+degraded, 103 active+clean; 585 KiB data, 101 MiB used, 715 GiB / 715 GiB avail; 76/726 objects degraded (10.468%) 2024-06-18T02:12:26.912 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:26.912 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:26.912 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:26.912 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:26.912 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:26.912 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:26.912 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:26.913 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:26.913 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:26.913 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:26.913 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:26.913 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:26.913 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:26.913 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:26.913 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:26.913 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:26.913 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:26.913 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:26.913 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:12:26.914 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:26.914 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:26.914 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:26.914 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:26.914 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:26.914 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:26.914 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:26.914 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:26.914 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:26.914 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:26.914 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:26.914 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:26.914 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:26.914 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:26.915 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:26.915 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:26.915 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:26.915 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:26.915 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:26.915 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:26.915 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:26.915 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:26.915 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:26.915 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:26.915 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:26.915 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:26.915 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:12:26.915 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:26.916 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:26.916 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:26.916 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:26.916 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:26.916 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:26.916 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:26.916 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:26.916 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:26.916 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:26.916 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:26.916 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:26.916 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:26.916 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:26.916 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:26 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:27.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:26 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:27.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:26 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:27.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:26 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:27.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:26 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:27.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:27.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:27.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:27.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:27.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:27.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:26 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:27.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:27.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:27.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:27.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:27.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:27.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:26 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:27.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:27.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:27.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:27.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:27.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:27.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:26 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:27.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:26 smithi130 ceph-mon[84407]: pgmap v131: 161 pgs: 37 active+undersized, 21 active+undersized+degraded, 103 active+clean; 585 KiB data, 101 MiB used, 715 GiB / 715 GiB avail; 76/726 objects degraded (10.468%) 2024-06-18T02:12:27.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:27.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:27.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:27.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:27.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:27.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:26 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:27.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:27.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:27.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:27.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:27.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:27.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:26 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:27.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:27.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:27.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:27.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:27.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:27.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:27.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:12:27.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:27.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:27.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:27.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:27.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:27.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:27.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:27.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:27.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:27.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:27.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:27.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:27.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:27.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:27.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:27.635 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:27.635 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:27.635 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:27.636 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:27.636 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:27.636 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:27.636 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:27.636 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:27.636 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:27.636 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:27.636 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[99735]: from='osd.0 [v2:172.21.15.7:6800/321556293,v1:172.21.15.7:6801/321556293]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-18T02:12:27.636 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:27.636 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:27.636 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:27.636 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:27.636 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:27.637 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:27.637 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:27.637 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:27.637 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:27.637 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:27.637 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:27.637 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:27.637 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:27.637 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:27.637 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:27.637 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:27.637 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:27.637 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:27.637 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:27.638 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:27.638 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:27.638 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:27.638 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:27.638 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:27.638 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:27.638 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:27.638 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:27.638 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:27.638 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:27.639 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[113333]: from='osd.0 [v2:172.21.15.7:6800/321556293,v1:172.21.15.7:6801/321556293]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-18T02:12:27.639 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:27.639 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:27.639 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:27.639 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:27.639 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:27.639 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:27.639 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:27.639 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:27.639 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:27.639 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:27.639 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:27.640 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:27.640 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:27.640 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:27.640 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:27.640 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:27.640 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:27.640 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:27.640 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:27.640 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:27.640 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:27.641 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:27.641 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:27.641 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:27.641 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:27.641 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:27.641 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:27.641 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:27.641 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:27.641 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:27.641 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:27.641 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:27.641 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:27.641 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:27.641 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:27.642 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:27.642 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:27.642 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:27.642 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:27.642 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:27.642 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:27.642 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:27.642 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:27.642 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:27.642 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:27.642 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:27.642 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:27.643 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:27.643 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:27.643 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:27.643 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:27.643 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:27.643 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:27.643 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:27.643 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:27.643 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:27.643 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:27.834 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:27 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:27.834 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:27 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:27.834 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:27 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:27.834 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:27 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:27.834 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:27.835 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:27.835 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:27.835 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:27.835 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:27 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:27.835 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:27 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:27.835 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:27 smithi130 ceph-mon[84407]: from='osd.0 [v2:172.21.15.7:6800/321556293,v1:172.21.15.7:6801/321556293]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-18T02:12:27.835 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:27.835 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:27.835 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:27.835 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:27.835 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:27 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:27.835 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:27 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:27.835 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:27.836 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:27.836 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:27.836 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:27.836 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:27 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:27.836 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:27 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:27.836 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:27.836 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:27.836 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:27.836 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:27.836 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:27 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:27.836 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:27 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:27.836 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:27.836 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:27.836 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:27.836 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:27.836 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:27 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:27.837 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:27.837 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:27.837 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:27.837 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:27.837 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:27 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:27.837 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:27.837 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:27.837 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:27.837 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:27.837 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:27 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:27.837 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:27.837 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:27.838 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:27.838 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:27.838 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:27 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:28.181 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:27 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0[119464]: 2024-06-18T02:12:27.953+0000 7f88eda85640 -1 osd.0 115 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-18T02:12:28.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:12:27 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:12:27] "GET /metrics HTTP/1.1" 200 38393 "" "Prometheus/2.33.4" 2024-06-18T02:12:28.637 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:28.637 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:28.637 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:28.637 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:28.637 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:28.637 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:28.637 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:28.637 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:28.637 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:28.638 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:28.638 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: from='osd.0 [v2:172.21.15.7:6800/321556293,v1:172.21.15.7:6801/321556293]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-06-18T02:12:28.638 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: osdmap e118: 8 total, 7 up, 8 in 2024-06-18T02:12:28.638 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: from='osd.0 [v2:172.21.15.7:6800/321556293,v1:172.21.15.7:6801/321556293]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-06-18T02:12:28.638 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:28.638 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:28.638 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:28.638 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:28.638 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:28.638 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:28.638 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:28.638 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:28.638 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:28.639 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:28.639 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:28.639 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:28.639 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: pgmap v133: 161 pgs: 37 active+undersized, 21 active+undersized+degraded, 103 active+clean; 585 KiB data, 116 MiB used, 715 GiB / 715 GiB avail; 127 B/s rd, 0 op/s; 76/726 objects degraded (10.468%) 2024-06-18T02:12:28.639 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: from='osd.0 [v2:172.21.15.7:6800/321556293,v1:172.21.15.7:6801/321556293]' entity='osd.0' 2024-06-18T02:12:28.639 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:28.639 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:28.639 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:28.639 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:28.639 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:28.640 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:28.640 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:28.640 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:28.640 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:28.640 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:28.640 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:28.640 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:28.640 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:28.640 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:28.640 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:28.640 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:28.640 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:28.640 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:28.640 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:28.640 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:28.640 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:28.641 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:28.641 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:28.641 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:28.641 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:28.641 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:28.641 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:28.641 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:28.641 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:28.641 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:28.641 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:28.641 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:28 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:28.777 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:28.777 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:28.777 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:28.777 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:28.777 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:28.778 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:28.778 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:28.778 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:28.778 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:28.778 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:28.778 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: from='osd.0 [v2:172.21.15.7:6800/321556293,v1:172.21.15.7:6801/321556293]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-06-18T02:12:28.778 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: osdmap e118: 8 total, 7 up, 8 in 2024-06-18T02:12:28.778 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: from='osd.0 [v2:172.21.15.7:6800/321556293,v1:172.21.15.7:6801/321556293]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-06-18T02:12:28.778 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:28.778 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:28.778 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:28.778 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:28.778 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:28.779 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:28.779 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:28.779 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:28.779 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:28.779 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:28.779 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:28.779 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:28.779 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: pgmap v133: 161 pgs: 37 active+undersized, 21 active+undersized+degraded, 103 active+clean; 585 KiB data, 116 MiB used, 715 GiB / 715 GiB avail; 127 B/s rd, 0 op/s; 76/726 objects degraded (10.468%) 2024-06-18T02:12:28.779 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: from='osd.0 [v2:172.21.15.7:6800/321556293,v1:172.21.15.7:6801/321556293]' entity='osd.0' 2024-06-18T02:12:28.779 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:28.779 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:28.780 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:28.780 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:28.780 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:28.780 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:28.780 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:28.780 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:28.780 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:28.780 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:28.780 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:28.780 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: from='osd.0 [v2:172.21.15.7:6800/321556293,v1:172.21.15.7:6801/321556293]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-06-18T02:12:28.780 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: osdmap e118: 8 total, 7 up, 8 in 2024-06-18T02:12:28.780 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: from='osd.0 [v2:172.21.15.7:6800/321556293,v1:172.21.15.7:6801/321556293]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-06-18T02:12:28.781 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:28.781 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:28.781 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:28.781 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:28.781 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:28.781 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:28.781 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:28.781 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:28.781 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:28.781 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:28.782 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:28.782 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:28.782 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: pgmap v133: 161 pgs: 37 active+undersized, 21 active+undersized+degraded, 103 active+clean; 585 KiB data, 116 MiB used, 715 GiB / 715 GiB avail; 127 B/s rd, 0 op/s; 76/726 objects degraded (10.468%) 2024-06-18T02:12:28.782 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: from='osd.0 [v2:172.21.15.7:6800/321556293,v1:172.21.15.7:6801/321556293]' entity='osd.0' 2024-06-18T02:12:28.782 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:28.782 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:28.782 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:28.782 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:28.782 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:28.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:28.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:28.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:28.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:28.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:28.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:28.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:28.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:28.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:28.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:28.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:28.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:28.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:28.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:28.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:28.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:28.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:28.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:28.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:28.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:28.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:28.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:28.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:28.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:28.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:28.784 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:28.785 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:28.785 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:28.785 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:28.785 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:28.785 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:28.785 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:28.785 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:28.785 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:28.785 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:28.785 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:28.785 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:28.785 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:28.785 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:28.785 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:28.786 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:28.786 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:28.786 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:28.786 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:28.786 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:28.786 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:28.786 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:28.786 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:28.786 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:28.786 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:28.786 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:28.786 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:28.786 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:28.787 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:28.787 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:28.787 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:28.787 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:28.787 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:28 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:29.784 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:29 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:29.784 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:29 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:29.784 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:29 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:29.784 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:29 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:29.784 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:29.784 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:29.784 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:29.785 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:29.785 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:29 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:29.785 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:29 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:29.785 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:29.785 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:29.785 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:29.785 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:29.785 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:29 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:29.785 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:29 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:29.785 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:29.785 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:29.785 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:29.785 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:29.785 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:29 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:29.786 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:29 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:29.786 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:29 smithi130 ceph-mon[84407]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-06-18T02:12:29.786 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-18T02:12:29.786 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:29 smithi130 ceph-mon[84407]: osd.0 [v2:172.21.15.7:6800/321556293,v1:172.21.15.7:6801/321556293] boot 2024-06-18T02:12:29.786 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:29 smithi130 ceph-mon[84407]: osdmap e119: 8 total, 8 up, 8 in 2024-06-18T02:12:29.786 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:29.786 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:29.786 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:29.786 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:29.786 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:29 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:29.786 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:29 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:29.786 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:29.786 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:29.787 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:29.787 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:29.787 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:29 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:29.787 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:29.787 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:29.787 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:29.787 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:29.787 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:29 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:29.787 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:29.787 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:29.787 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:29.787 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:29.787 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:29 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:29.787 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:29.788 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:29.788 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:29.788 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:29.788 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:29 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:29.843 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:29.843 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:29.843 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:29.843 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:29.843 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:29.843 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:29.843 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:29.843 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:29.843 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:29.843 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:29.843 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:29.844 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:29.844 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:29.844 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:29.844 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:29.844 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:29.844 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:29.844 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:29.844 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:29.844 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:29.845 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:29.845 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:29.845 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[113333]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-06-18T02:12:29.845 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-18T02:12:29.845 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[113333]: osd.0 [v2:172.21.15.7:6800/321556293,v1:172.21.15.7:6801/321556293] boot 2024-06-18T02:12:29.845 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[113333]: osdmap e119: 8 total, 8 up, 8 in 2024-06-18T02:12:29.845 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:29.845 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:29.845 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:29.845 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:29.845 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:29.846 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:29.846 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:29.846 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:29.846 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:29.846 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:29.846 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:29.846 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:29.846 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:29.846 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:29.846 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:29.846 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:29.847 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:29.847 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:29.847 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:29.847 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:29.847 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:29.847 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:29.847 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:29.847 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:29.847 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:29.847 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:29.847 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:29.847 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[99735]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-06-18T02:12:29.847 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-18T02:12:29.847 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[99735]: osd.0 [v2:172.21.15.7:6800/321556293,v1:172.21.15.7:6801/321556293] boot 2024-06-18T02:12:29.847 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[99735]: osdmap e119: 8 total, 8 up, 8 in 2024-06-18T02:12:29.847 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:29.848 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:29.848 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:29.848 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:29.848 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:29.848 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:29.848 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:29.848 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:29.848 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:29.848 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:29.848 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:29.848 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:29.848 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:29.849 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:29.849 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:29.849 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:29.849 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:29.849 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:29.849 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:29.849 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:29.849 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:29.849 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:29.849 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:29.849 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:29.849 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:29.849 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:29.850 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:29.850 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:29.850 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:29.850 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:29.850 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:29.850 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:29.850 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:29.850 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:29.850 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:29.850 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:29.850 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:29.850 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:29.851 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:29.851 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:29.851 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:29.851 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:29.851 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:29.851 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:29.851 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:29.851 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:29.851 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:29 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:30.874 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:30.875 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:30.875 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:30.875 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:30.875 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:30.875 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:30.875 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:30.875 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:30.875 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:30.875 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:30.875 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:30.875 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:30.875 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:30.875 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:30.876 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:30.876 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:30.876 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:30.876 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:30.876 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:30.876 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:30.876 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:30.876 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:30.876 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[113333]: pgmap v135: 161 pgs: 37 active+undersized, 21 active+undersized+degraded, 103 active+clean; 585 KiB data, 116 MiB used, 715 GiB / 715 GiB avail; 127 B/s rd, 0 op/s; 76/726 objects degraded (10.468%) 2024-06-18T02:12:30.876 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[113333]: osdmap e120: 8 total, 8 up, 8 in 2024-06-18T02:12:30.876 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:30.876 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:30.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:30.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:30.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:30.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:30.877 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:30.877 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:30.877 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:30.877 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:30.877 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:30.878 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:30.878 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:30.878 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:30.878 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:30.878 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:30.878 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:30.878 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:30.878 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:30.878 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:30.878 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:30.878 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:30.878 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:30.878 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:30.879 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:30.879 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:30.879 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:30.879 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:30.879 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[99735]: pgmap v135: 161 pgs: 37 active+undersized, 21 active+undersized+degraded, 103 active+clean; 585 KiB data, 116 MiB used, 715 GiB / 715 GiB avail; 127 B/s rd, 0 op/s; 76/726 objects degraded (10.468%) 2024-06-18T02:12:30.879 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[99735]: osdmap e120: 8 total, 8 up, 8 in 2024-06-18T02:12:30.879 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:30.879 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:30.879 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:30.879 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:30.879 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:30.879 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:30.880 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:30.880 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:30.880 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:30.880 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:30.880 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:30.880 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:30.880 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:30.880 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:30.880 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:30.880 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:30.880 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:30.880 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:30.880 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:30.881 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:30.881 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:30.881 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:30.881 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:30.881 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:30.881 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:30.881 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:30.881 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:30.881 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:30.881 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:30.881 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:30.882 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:30.882 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:30.882 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:30.882 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:30.882 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:30.882 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:30.882 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:30.882 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:30.882 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:30.882 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:30.882 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:30.882 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:30.882 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:30.882 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:30.883 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:30.883 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:30 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:31.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:30 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:31.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:30 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:31.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:30 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:31.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:30 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:31.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:31.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:31.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:31.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:31.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:30 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:31.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:30 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:31.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:31.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:31.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:31.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:31.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:30 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:31.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:30 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:31.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:31.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:31.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:31.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:31.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:30 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:31.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:30 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:31.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:30 smithi130 ceph-mon[84407]: pgmap v135: 161 pgs: 37 active+undersized, 21 active+undersized+degraded, 103 active+clean; 585 KiB data, 116 MiB used, 715 GiB / 715 GiB avail; 127 B/s rd, 0 op/s; 76/726 objects degraded (10.468%) 2024-06-18T02:12:31.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:30 smithi130 ceph-mon[84407]: osdmap e120: 8 total, 8 up, 8 in 2024-06-18T02:12:31.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:31.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:31.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:31.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:31.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:30 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:31.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:30 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:31.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:31.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:31.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:31.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:31.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:30 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:31.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:31.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:31.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:31.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:31.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:30 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:31.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:31.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:31.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:31.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:31.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:30 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:31.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:31.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:31.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:31.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:31.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:30 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:31.577 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:31.577 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:31.578 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:31.578 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:31.578 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:31.578 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:31.578 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:31.578 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:31.578 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:31.578 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:31.578 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:31.579 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:31.579 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:31.579 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:31.579 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:31.579 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:31.579 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:31.579 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:31.580 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:31.580 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:31.580 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:31.580 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:31.580 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:31.580 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:31.580 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:31.580 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:31.580 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:31.580 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:31.580 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:31.581 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:31.581 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:31.581 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:31.581 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:31.581 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:31.581 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:31.581 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:31.581 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:31.581 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:31.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:31 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:31.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:31 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:31.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:31 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:31.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:31 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:31.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:31.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:31.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:31.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:31.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:31 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:31.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:31 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:31.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:31.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:31.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:31.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:31.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:31 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:31.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:31 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:31.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:31.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:31.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:31.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:31.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:31 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:31.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:31 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:31.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:31.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:31.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:31.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:31.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:31 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:31.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:31 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:31.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:31.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:31.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:31.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:31.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:31 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:31.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:31.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:31.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:31.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:31.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:31 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:31.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:31.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:31.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:31.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:31.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:31 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:31.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:31 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:31.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:31 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:31.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:31 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:31.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:31.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:31.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:31.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:31.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-06-18T02:12:31.898 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:31.898 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:31.898 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:31.898 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:31.898 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:31.899 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:31.899 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:31.899 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:31.899 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:31.899 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:31.899 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:31.899 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:31.899 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:31.899 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:31.899 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:31.899 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:31.899 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:31.899 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:31.899 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:31.900 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:31.900 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:31.900 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:31.900 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:31.900 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:31.900 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:31.900 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:31.900 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:31.900 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:31.900 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:31.900 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:31.900 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-06-18T02:12:31.901 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:31.901 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:31.901 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:31.901 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:31.901 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:31.901 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:31.901 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:31.901 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:31.901 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:31.901 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:31.901 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:31.901 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:31.902 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:31.902 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:31.902 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:31.902 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:31.902 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:31.902 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:31.902 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:31.902 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:31.902 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:31.902 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:31.902 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:31.902 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:31.902 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:31.902 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:31.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:31.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:31.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:31.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:31.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:31.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:31.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-06-18T02:12:32.885 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:32 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:32.885 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:32 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:32.885 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:32 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:32.885 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:32 smithi007 ceph-mon[113333]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-06-18T02:12:32.885 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:32 smithi007 ceph-mon[113333]: Upgrade: osd.0 is safe to restart 2024-06-18T02:12:32.885 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:32 smithi007 ceph-mon[113333]: pgmap v137: 161 pgs: 37 active+undersized, 21 active+undersized+degraded, 103 active+clean; 585 KiB data, 116 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 76/726 objects degraded (10.468%) 2024-06-18T02:12:32.885 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:32 smithi007 ceph-mon[113333]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:12:32.885 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:32 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:32.885 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:32 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:32.885 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:32 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:32.886 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:32 smithi007 ceph-mon[99735]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-06-18T02:12:32.886 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:32 smithi007 ceph-mon[99735]: Upgrade: osd.0 is safe to restart 2024-06-18T02:12:32.886 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:32 smithi007 ceph-mon[99735]: pgmap v137: 161 pgs: 37 active+undersized, 21 active+undersized+degraded, 103 active+clean; 585 KiB data, 116 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 76/726 objects degraded (10.468%) 2024-06-18T02:12:32.886 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:32 smithi007 ceph-mon[99735]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:12:33.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:32 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:33.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:32 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:33.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:32 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:33.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:32 smithi130 ceph-mon[84407]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-06-18T02:12:33.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:32 smithi130 ceph-mon[84407]: Upgrade: osd.0 is safe to restart 2024-06-18T02:12:33.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:32 smithi130 ceph-mon[84407]: pgmap v137: 161 pgs: 37 active+undersized, 21 active+undersized+degraded, 103 active+clean; 585 KiB data, 116 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 76/726 objects degraded (10.468%) 2024-06-18T02:12:33.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:32 smithi130 ceph-mon[84407]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:12:34.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:34 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:34.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:34 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:34.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:34 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:34.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:34 smithi007 ceph-mon[99735]: pgmap v138: 161 pgs: 161 active+clean; 585 KiB data, 121 MiB used, 715 GiB / 715 GiB avail; 817 B/s rd, 0 op/s 2024-06-18T02:12:34.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:34 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:34.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:34 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:34.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:34 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:34.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:34 smithi007 ceph-mon[113333]: pgmap v138: 161 pgs: 161 active+clean; 585 KiB data, 121 MiB used, 715 GiB / 715 GiB avail; 817 B/s rd, 0 op/s 2024-06-18T02:12:35.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:34 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:35.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:34 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:35.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:34 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:35.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:34 smithi130 ceph-mon[84407]: pgmap v138: 161 pgs: 161 active+clean; 585 KiB data, 121 MiB used, 715 GiB / 715 GiB avail; 817 B/s rd, 0 op/s 2024-06-18T02:12:36.105 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:35 smithi007 ceph-mon[113333]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 76/726 objects degraded (10.468%), 21 pgs degraded) 2024-06-18T02:12:36.105 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:35 smithi007 ceph-mon[113333]: Cluster is now healthy 2024-06-18T02:12:36.105 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-06-18T02:12:36.105 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:36.106 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:35 smithi007 ceph-mon[99735]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 76/726 objects degraded (10.468%), 21 pgs degraded) 2024-06-18T02:12:36.106 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:35 smithi007 ceph-mon[99735]: Cluster is now healthy 2024-06-18T02:12:36.106 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-06-18T02:12:36.106 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:36.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:35 smithi130 ceph-mon[84407]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 76/726 objects degraded (10.468%), 21 pgs degraded) 2024-06-18T02:12:36.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:35 smithi130 ceph-mon[84407]: Cluster is now healthy 2024-06-18T02:12:36.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-06-18T02:12:36.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:36.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:36 smithi007 ceph-mon[113333]: Upgrade: Updating osd.0 2024-06-18T02:12:37.110 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:36 smithi007 ceph-mon[113333]: Deploying daemon osd.0 on smithi007 2024-06-18T02:12:37.111 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:36 smithi007 ceph-mon[113333]: pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 121 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-06-18T02:12:37.111 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:36 smithi007 ceph-mon[99735]: Upgrade: Updating osd.0 2024-06-18T02:12:37.111 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:36 smithi007 ceph-mon[99735]: Deploying daemon osd.0 on smithi007 2024-06-18T02:12:37.111 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:36 smithi007 ceph-mon[99735]: pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 121 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-06-18T02:12:37.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:36 smithi130 ceph-mon[84407]: Upgrade: Updating osd.0 2024-06-18T02:12:37.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:36 smithi130 ceph-mon[84407]: Deploying daemon osd.0 on smithi007 2024-06-18T02:12:37.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:36 smithi130 ceph-mon[84407]: pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 121 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-06-18T02:12:38.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:12:37 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:12:37] "GET /metrics HTTP/1.1" 200 38393 "" "Prometheus/2.33.4" 2024-06-18T02:12:38.669 INFO:teuthology.orchestra.run.smithi007.stdout:true 2024-06-18T02:12:39.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:38 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:39.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:38 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:39.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:38 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:39.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:38 smithi007 ceph-mon[113333]: pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 121 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-06-18T02:12:39.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:38 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:39.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:38 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:39.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:38 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:39.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:38 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:39.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:38 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:39.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:38 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:39.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:38 smithi007 ceph-mon[99735]: pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 121 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-06-18T02:12:39.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:38 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:39.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:38 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:39.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:38 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:39.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:38 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:39.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:38 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:39.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:38 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:39.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:38 smithi130 ceph-mon[84407]: pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 121 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-06-18T02:12:39.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:38 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:39.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:38 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:39.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:38 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:39.381 INFO:teuthology.orchestra.run.smithi007.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-18T02:12:39.381 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi007 smithi007 running 0s ago 15m - - 2024-06-18T02:12:39.381 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi130 smithi130 running 5s ago 15m - - 2024-06-18T02:12:39.381 INFO:teuthology.orchestra.run.smithi007.stdout:alertmanager.a smithi007 *:9093,9094 running (5m) 0s ago 10m 22.7M - 0.23.0 ba2b418f427c 5994e8525c64 2024-06-18T02:12:39.381 INFO:teuthology.orchestra.run.smithi007.stdout:grafana.a smithi130 *:3000 running (5m) 5s ago 10m 49.7M - 8.3.5 dad864ee21e9 70ba81d97c8e 2024-06-18T02:12:39.381 INFO:teuthology.orchestra.run.smithi007.stdout:iscsi.foo.smithi007.xvdrwd smithi007 running (3m) 0s ago 9m 52.4M - 3.5 e1d6a67b021e 94121ad2702c 2024-06-18T02:12:39.381 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.x smithi130 *:8443,9283,8765 running (4m) 5s ago 15m 519M - 19.0.0-3124-g3781e3a5 af93c036e016 01017e37bdbe 2024-06-18T02:12:39.381 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.y smithi007 *:8443,9283,8765 running (2m) 0s ago 16m 442M - 19.0.0-3124-g3781e3a5 af93c036e016 2141e131e896 2024-06-18T02:12:39.381 INFO:teuthology.orchestra.run.smithi007.stdout:mon.a smithi007 running (45s) 0s ago 16m 39.6M 2048M 19.0.0-3124-g3781e3a5 af93c036e016 7bbe646cd5b7 2024-06-18T02:12:39.382 INFO:teuthology.orchestra.run.smithi007.stdout:mon.b smithi130 running (110s) 5s ago 15m 45.0M 2048M 19.0.0-3124-g3781e3a5 af93c036e016 baacf2add994 2024-06-18T02:12:39.382 INFO:teuthology.orchestra.run.smithi007.stdout:mon.c smithi007 running (2m) 0s ago 15m 44.5M 2048M 19.0.0-3124-g3781e3a5 af93c036e016 39418356156e 2024-06-18T02:12:39.382 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.a smithi007 *:9100 running (5m) 0s ago 11m 17.3M - 1.3.1 1dbe0e931976 8128e558f099 2024-06-18T02:12:39.382 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.b smithi130 *:9100 running (5m) 5s ago 10m 17.1M - 1.3.1 1dbe0e931976 bab93b43cf16 2024-06-18T02:12:39.382 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0 smithi007 running (16s) 0s ago 14m 51.0M 4096M 19.0.0-3124-g3781e3a5 af93c036e016 a5158dba820c 2024-06-18T02:12:39.382 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1 smithi007 running (14m) 0s ago 14m 58.0M 4096M 17.2.0 e1d6a67b021e a967706523cb 2024-06-18T02:12:39.382 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2 smithi007 running (13m) 0s ago 13m 52.9M 4096M 17.2.0 e1d6a67b021e 2c1b76bd0876 2024-06-18T02:12:39.382 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3 smithi007 running (13m) 0s ago 13m 56.0M 4096M 17.2.0 e1d6a67b021e 8b91b2a07564 2024-06-18T02:12:39.382 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4 smithi130 running (13m) 5s ago 13m 57.8M 4096M 17.2.0 e1d6a67b021e c428dccffdf0 2024-06-18T02:12:39.382 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5 smithi130 running (12m) 5s ago 12m 56.2M 4096M 17.2.0 e1d6a67b021e f645d7f12378 2024-06-18T02:12:39.382 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6 smithi130 running (12m) 5s ago 12m 51.9M 4096M 17.2.0 e1d6a67b021e c7af86c14959 2024-06-18T02:12:39.382 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7 smithi130 running (11m) 5s ago 11m 55.7M 4096M 17.2.0 e1d6a67b021e 3688af8b2c46 2024-06-18T02:12:39.383 INFO:teuthology.orchestra.run.smithi007.stdout:prometheus.a smithi130 *:9095 running (4m) 5s ago 11m 75.7M - 2.33.4 514e6a882f6e e905fb2eb4a6 2024-06-18T02:12:39.383 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi007.dvbvbk smithi007 *:8000 running (9m) 0s ago 9m 77.0M - 17.2.0 e1d6a67b021e 1344b55b763c 2024-06-18T02:12:39.383 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi130.aakmof smithi130 *:8000 running (9m) 5s ago 9m 74.5M - 17.2.0 e1d6a67b021e e257e3230c6c 2024-06-18T02:12:39.383 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi007.hgrnmk smithi007 *:80 running (9m) 0s ago 9m 75.2M - 17.2.0 e1d6a67b021e 2173947bc4d6 2024-06-18T02:12:39.383 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi130.wwebfk smithi130 *:80 running (9m) 5s ago 9m 76.5M - 17.2.0 e1d6a67b021e 8662706b2231 2024-06-18T02:12:39.808 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:12:39.808 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": { 2024-06-18T02:12:39.808 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 3 2024-06-18T02:12:39.808 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:12:39.808 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": { 2024-06-18T02:12:39.808 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 2 2024-06-18T02:12:39.808 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:12:39.808 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": { 2024-06-18T02:12:39.808 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 7, 2024-06-18T02:12:39.808 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 1 2024-06-18T02:12:39.808 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:12:39.808 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw": { 2024-06-18T02:12:39.809 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-06-18T02:12:39.809 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:12:39.809 INFO:teuthology.orchestra.run.smithi007.stdout: "overall": { 2024-06-18T02:12:39.809 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 11, 2024-06-18T02:12:39.809 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 6 2024-06-18T02:12:39.809 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-06-18T02:12:39.809 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:12:39.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:39 smithi007 ceph-mon[113333]: from='client.94143 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:12:39.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:39 smithi007 ceph-mon[113333]: from='client.94149 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:12:39.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:39 smithi007 ceph-mon[113333]: from='client.? 172.21.15.7:0/1722136136' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:39.907 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:39 smithi007 ceph-mon[99735]: from='client.94143 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:12:39.908 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:39 smithi007 ceph-mon[99735]: from='client.94149 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:12:39.908 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:39 smithi007 ceph-mon[99735]: from='client.? 172.21.15.7:0/1722136136' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:40.169 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:12:40.169 INFO:teuthology.orchestra.run.smithi007.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00", 2024-06-18T02:12:40.169 INFO:teuthology.orchestra.run.smithi007.stdout: "in_progress": true, 2024-06-18T02:12:40.170 INFO:teuthology.orchestra.run.smithi007.stdout: "which": "Upgrading all daemon types on all hosts", 2024-06-18T02:12:40.170 INFO:teuthology.orchestra.run.smithi007.stdout: "services_complete": [ 2024-06-18T02:12:40.170 INFO:teuthology.orchestra.run.smithi007.stdout: "mon", 2024-06-18T02:12:40.170 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr" 2024-06-18T02:12:40.170 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-06-18T02:12:40.170 INFO:teuthology.orchestra.run.smithi007.stdout: "progress": "6/23 daemons upgraded", 2024-06-18T02:12:40.170 INFO:teuthology.orchestra.run.smithi007.stdout: "message": "Currently upgrading osd daemons", 2024-06-18T02:12:40.170 INFO:teuthology.orchestra.run.smithi007.stdout: "is_paused": false 2024-06-18T02:12:40.170 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:12:40.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:39 smithi130 ceph-mon[84407]: from='client.94143 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:12:40.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:39 smithi130 ceph-mon[84407]: from='client.94149 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:12:40.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:39 smithi130 ceph-mon[84407]: from='client.? 172.21.15.7:0/1722136136' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:40.431 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:40 smithi007 systemd[1]: Stopping Ceph osd.0 for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:12:40.611 INFO:teuthology.orchestra.run.smithi007.stdout:HEALTH_OK 2024-06-18T02:12:40.876 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:40 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0[119464]: 2024-06-18T02:12:40.520+0000 7f88f6c7a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-18T02:12:40.876 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:40 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0[119464]: 2024-06-18T02:12:40.520+0000 7f88f6c7a640 -1 osd.0 120 *** Got signal Terminated *** 2024-06-18T02:12:40.876 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:40 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0[119464]: 2024-06-18T02:12:40.520+0000 7f88f6c7a640 -1 osd.0 120 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-18T02:12:41.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:40 smithi130 ceph-mon[84407]: from='client.54199 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:12:41.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:40 smithi130 ceph-mon[84407]: pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 121 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-06-18T02:12:41.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:40 smithi130 ceph-mon[84407]: osd.0 marked itself down and dead 2024-06-18T02:12:41.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:40 smithi130 ceph-mon[84407]: from='client.? 172.21.15.7:0/583112190' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:12:41.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:40 smithi007 ceph-mon[113333]: from='client.54199 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:12:41.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:40 smithi007 ceph-mon[113333]: pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 121 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-06-18T02:12:41.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:40 smithi007 ceph-mon[113333]: osd.0 marked itself down and dead 2024-06-18T02:12:41.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:40 smithi007 ceph-mon[113333]: from='client.? 172.21.15.7:0/583112190' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:12:41.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:40 smithi007 ceph-mon[99735]: from='client.54199 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:12:41.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:40 smithi007 ceph-mon[99735]: pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 121 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-06-18T02:12:41.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:40 smithi007 ceph-mon[99735]: osd.0 marked itself down and dead 2024-06-18T02:12:41.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:40 smithi007 ceph-mon[99735]: from='client.? 172.21.15.7:0/583112190' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:12:41.512 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:41 smithi007 podman[123681]: 2024-06-18 02:12:41.245846965 +0000 UTC m=+0.810929537 container died a5158dba820c01f2fe2b6fa3bc1916cb39c8577831d26c16ff6943005c15cb24 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_BRANCH=HEAD, org.label-schema.build-date=20240612, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3781e3a, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=) 2024-06-18T02:12:41.877 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:41 smithi007 podman[123681]: 2024-06-18 02:12:41.688009879 +0000 UTC m=+1.253092488 container cleanup a5158dba820c01f2fe2b6fa3bc1916cb39c8577831d26c16ff6943005c15cb24 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3781e3a, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.build-date=20240612, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-06-18T02:12:41.877 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:41 smithi007 bash[123681]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0 2024-06-18T02:12:42.181 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:41 smithi007 podman[123701]: 2024-06-18 02:12:41.956285434 +0000 UTC m=+0.700682796 container remove a5158dba820c01f2fe2b6fa3bc1916cb39c8577831d26c16ff6943005c15cb24 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240612, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-3781e3a) 2024-06-18T02:12:42.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:41 smithi007 ceph-mon[113333]: from='client.54211 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:12:42.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:41 smithi007 ceph-mon[113333]: Health check failed: 1 osds down (OSD_DOWN) 2024-06-18T02:12:42.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:41 smithi007 ceph-mon[113333]: osdmap e121: 8 total, 7 up, 8 in 2024-06-18T02:12:42.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2024-06-18T02:12:42.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 1]}]: dispatch 2024-06-18T02:12:42.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:41 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2024-06-18T02:12:42.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 0]}]: dispatch 2024-06-18T02:12:42.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1", "id": [4, 0]}]: dispatch 2024-06-18T02:12:42.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:41 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 1]}]: dispatch 2024-06-18T02:12:42.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.4", "id": [7, 0]}]: dispatch 2024-06-18T02:12:42.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.6", "id": [5, 0]}]: dispatch 2024-06-18T02:12:42.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:41 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 0]}]: dispatch 2024-06-18T02:12:42.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.16", "id": [5, 0]}]: dispatch 2024-06-18T02:12:42.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.17", "id": [1, 0]}]: dispatch 2024-06-18T02:12:42.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:41 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1", "id": [4, 0]}]: dispatch 2024-06-18T02:12:42.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1c", "id": [4, 0]}]: dispatch 2024-06-18T02:12:42.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1f", "id": [4, 0]}]: dispatch 2024-06-18T02:12:42.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:41 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.4", "id": [7, 0]}]: dispatch 2024-06-18T02:12:42.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:41 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.6", "id": [5, 0]}]: dispatch 2024-06-18T02:12:42.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:41 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.16", "id": [5, 0]}]: dispatch 2024-06-18T02:12:42.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:41 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.17", "id": [1, 0]}]: dispatch 2024-06-18T02:12:42.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:41 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1c", "id": [4, 0]}]: dispatch 2024-06-18T02:12:42.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:41 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1f", "id": [4, 0]}]: dispatch 2024-06-18T02:12:42.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:41 smithi007 ceph-mon[99735]: from='client.54211 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:12:42.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:41 smithi007 ceph-mon[99735]: Health check failed: 1 osds down (OSD_DOWN) 2024-06-18T02:12:42.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:41 smithi007 ceph-mon[99735]: osdmap e121: 8 total, 7 up, 8 in 2024-06-18T02:12:42.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2024-06-18T02:12:42.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 1]}]: dispatch 2024-06-18T02:12:42.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:41 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2024-06-18T02:12:42.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 0]}]: dispatch 2024-06-18T02:12:42.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1", "id": [4, 0]}]: dispatch 2024-06-18T02:12:42.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:41 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 1]}]: dispatch 2024-06-18T02:12:42.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.4", "id": [7, 0]}]: dispatch 2024-06-18T02:12:42.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.6", "id": [5, 0]}]: dispatch 2024-06-18T02:12:42.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:41 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 0]}]: dispatch 2024-06-18T02:12:42.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.16", "id": [5, 0]}]: dispatch 2024-06-18T02:12:42.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.17", "id": [1, 0]}]: dispatch 2024-06-18T02:12:42.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:41 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1", "id": [4, 0]}]: dispatch 2024-06-18T02:12:42.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1c", "id": [4, 0]}]: dispatch 2024-06-18T02:12:42.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1f", "id": [4, 0]}]: dispatch 2024-06-18T02:12:42.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:41 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.4", "id": [7, 0]}]: dispatch 2024-06-18T02:12:42.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:41 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.6", "id": [5, 0]}]: dispatch 2024-06-18T02:12:42.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:41 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.16", "id": [5, 0]}]: dispatch 2024-06-18T02:12:42.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:41 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.17", "id": [1, 0]}]: dispatch 2024-06-18T02:12:42.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:41 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1c", "id": [4, 0]}]: dispatch 2024-06-18T02:12:42.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:41 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1f", "id": [4, 0]}]: dispatch 2024-06-18T02:12:42.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:41 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:42.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:12:42.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:41 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:42.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:41 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:42.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:12:42.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:41 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:42.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:41 smithi130 ceph-mon[84407]: from='client.54211 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:12:42.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:41 smithi130 ceph-mon[84407]: Health check failed: 1 osds down (OSD_DOWN) 2024-06-18T02:12:42.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:41 smithi130 ceph-mon[84407]: osdmap e121: 8 total, 7 up, 8 in 2024-06-18T02:12:42.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2024-06-18T02:12:42.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 1]}]: dispatch 2024-06-18T02:12:42.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:41 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2024-06-18T02:12:42.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 0]}]: dispatch 2024-06-18T02:12:42.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1", "id": [4, 0]}]: dispatch 2024-06-18T02:12:42.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:41 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 1]}]: dispatch 2024-06-18T02:12:42.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.4", "id": [7, 0]}]: dispatch 2024-06-18T02:12:42.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.6", "id": [5, 0]}]: dispatch 2024-06-18T02:12:42.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:41 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 0]}]: dispatch 2024-06-18T02:12:42.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.16", "id": [5, 0]}]: dispatch 2024-06-18T02:12:42.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.17", "id": [1, 0]}]: dispatch 2024-06-18T02:12:42.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:41 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1", "id": [4, 0]}]: dispatch 2024-06-18T02:12:42.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1c", "id": [4, 0]}]: dispatch 2024-06-18T02:12:42.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1f", "id": [4, 0]}]: dispatch 2024-06-18T02:12:42.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:41 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.4", "id": [7, 0]}]: dispatch 2024-06-18T02:12:42.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:41 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.6", "id": [5, 0]}]: dispatch 2024-06-18T02:12:42.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:41 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.16", "id": [5, 0]}]: dispatch 2024-06-18T02:12:42.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:41 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.17", "id": [1, 0]}]: dispatch 2024-06-18T02:12:42.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:41 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1c", "id": [4, 0]}]: dispatch 2024-06-18T02:12:42.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:41 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1f", "id": [4, 0]}]: dispatch 2024-06-18T02:12:42.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:41 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:42.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:12:42.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:41 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:42.667 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:42 smithi007 podman[123791]: 2024-06-18 02:12:42.365549152 +0000 UTC m=+0.109768152 container create b4eef3359382d8d39b7a72cb1112af8a02bda1d3020ae8ed5d49e76566dafc82 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, RELEASE=squid-3781e3a, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240612, GIT_CLEAN=True, io.buildah.version=1.36.0) 2024-06-18T02:12:42.667 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:42 smithi007 podman[123791]: 2024-06-18 02:12:42.273712245 +0000 UTC m=+0.017931247 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:12:42.667 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:42 smithi007 podman[123791]: 2024-06-18 02:12:42.576907333 +0000 UTC m=+0.321126348 container init b4eef3359382d8d39b7a72cb1112af8a02bda1d3020ae8ed5d49e76566dafc82 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, RELEASE=squid-3781e3a, org.label-schema.build-date=20240612, GIT_BRANCH=HEAD) 2024-06-18T02:12:42.667 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:42 smithi007 podman[123791]: 2024-06-18 02:12:42.580503103 +0000 UTC m=+0.324722112 container start b4eef3359382d8d39b7a72cb1112af8a02bda1d3020ae8ed5d49e76566dafc82 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240612, maintainer=Guillaume Abrioux , RELEASE=squid-3781e3a, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS) 2024-06-18T02:12:42.667 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:42 smithi007 podman[123791]: 2024-06-18 02:12:42.667866604 +0000 UTC m=+0.412085631 container attach b4eef3359382d8d39b7a72cb1112af8a02bda1d3020ae8ed5d49e76566dafc82 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-3781e3a, GIT_BRANCH=HEAD, org.label-schema.build-date=20240612, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-06-18T02:12:42.931 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:42 smithi007 podman[123791]: 2024-06-18 02:12:42.847172756 +0000 UTC m=+0.591391766 container died b4eef3359382d8d39b7a72cb1112af8a02bda1d3020ae8ed5d49e76566dafc82 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , RELEASE=squid-3781e3a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240612, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-06-18T02:12:42.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:42 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]': finished 2024-06-18T02:12:42.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:42 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 1]}]': finished 2024-06-18T02:12:42.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:42 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 0]}]': finished 2024-06-18T02:12:42.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:42 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1", "id": [4, 0]}]': finished 2024-06-18T02:12:42.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:42 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.4", "id": [7, 0]}]': finished 2024-06-18T02:12:42.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:42 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.6", "id": [5, 0]}]': finished 2024-06-18T02:12:42.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:42 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.16", "id": [5, 0]}]': finished 2024-06-18T02:12:42.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:42 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.17", "id": [1, 0]}]': finished 2024-06-18T02:12:42.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:42 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1c", "id": [4, 0]}]': finished 2024-06-18T02:12:42.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:42 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1f", "id": [4, 0]}]': finished 2024-06-18T02:12:42.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:42 smithi007 ceph-mon[113333]: osdmap e122: 8 total, 7 up, 8 in 2024-06-18T02:12:42.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:42 smithi007 ceph-mon[113333]: pgmap v144: 161 pgs: 21 stale+active+clean, 140 active+clean; 585 KiB data, 121 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-06-18T02:12:42.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:42 smithi007 ceph-mon[113333]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:12:42.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]': finished 2024-06-18T02:12:42.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 1]}]': finished 2024-06-18T02:12:42.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 0]}]': finished 2024-06-18T02:12:42.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1", "id": [4, 0]}]': finished 2024-06-18T02:12:42.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.4", "id": [7, 0]}]': finished 2024-06-18T02:12:42.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.6", "id": [5, 0]}]': finished 2024-06-18T02:12:42.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.16", "id": [5, 0]}]': finished 2024-06-18T02:12:42.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.17", "id": [1, 0]}]': finished 2024-06-18T02:12:42.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1c", "id": [4, 0]}]': finished 2024-06-18T02:12:42.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1f", "id": [4, 0]}]': finished 2024-06-18T02:12:42.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:42 smithi007 ceph-mon[99735]: osdmap e122: 8 total, 7 up, 8 in 2024-06-18T02:12:42.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:42 smithi007 ceph-mon[99735]: pgmap v144: 161 pgs: 21 stale+active+clean, 140 active+clean; 585 KiB data, 121 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-06-18T02:12:42.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:42 smithi007 ceph-mon[99735]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:12:43.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:42 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]': finished 2024-06-18T02:12:43.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:42 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 1]}]': finished 2024-06-18T02:12:43.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:42 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 0]}]': finished 2024-06-18T02:12:43.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:42 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1", "id": [4, 0]}]': finished 2024-06-18T02:12:43.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:42 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.4", "id": [7, 0]}]': finished 2024-06-18T02:12:43.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:42 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.6", "id": [5, 0]}]': finished 2024-06-18T02:12:43.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:42 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.16", "id": [5, 0]}]': finished 2024-06-18T02:12:43.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:42 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.17", "id": [1, 0]}]': finished 2024-06-18T02:12:43.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:42 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1c", "id": [4, 0]}]': finished 2024-06-18T02:12:43.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:42 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1f", "id": [4, 0]}]': finished 2024-06-18T02:12:43.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:42 smithi130 ceph-mon[84407]: osdmap e122: 8 total, 7 up, 8 in 2024-06-18T02:12:43.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:42 smithi130 ceph-mon[84407]: pgmap v144: 161 pgs: 21 stale+active+clean, 140 active+clean; 585 KiB data, 121 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-06-18T02:12:43.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:42 smithi130 ceph-mon[84407]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:12:43.682 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:43 smithi007 podman[123814]: 2024-06-18 02:12:43.464015205 +0000 UTC m=+0.611138135 container remove b4eef3359382d8d39b7a72cb1112af8a02bda1d3020ae8ed5d49e76566dafc82 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240612, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-3781e3a) 2024-06-18T02:12:43.682 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:43 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.0.service: Deactivated successfully. 2024-06-18T02:12:43.682 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:43 smithi007 systemd[1]: Stopped Ceph osd.0 for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:12:43.682 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:43 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.0.service: Consumed 2.163s CPU time. 2024-06-18T02:12:44.029 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:43 smithi007 ceph-mon[113333]: osdmap e123: 8 total, 7 up, 8 in 2024-06-18T02:12:44.029 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:43 smithi007 ceph-mon[99735]: osdmap e123: 8 total, 7 up, 8 in 2024-06-18T02:12:44.030 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:43 smithi007 systemd[1]: Starting Ceph osd.0 for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:12:44.030 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:43 smithi007 podman[123914]: 2024-06-18 02:12:43.91487798 +0000 UTC m=+0.100256758 container create daf92d957622797d7f46359e8ad3d231cb35776b9f71d4b1fc9b325e07741632 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0-activate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240612, io.buildah.version=1.36.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-3781e3a) 2024-06-18T02:12:44.030 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:43 smithi007 podman[123914]: 2024-06-18 02:12:43.832672248 +0000 UTC m=+0.018051045 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:12:44.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:43 smithi130 ceph-mon[84407]: osdmap e123: 8 total, 7 up, 8 in 2024-06-18T02:12:44.431 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:44 smithi007 podman[123914]: 2024-06-18 02:12:44.142929301 +0000 UTC m=+0.328308082 container init daf92d957622797d7f46359e8ad3d231cb35776b9f71d4b1fc9b325e07741632 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0-activate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3781e3a, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240612, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0) 2024-06-18T02:12:44.432 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:44 smithi007 podman[123914]: 2024-06-18 02:12:44.146544663 +0000 UTC m=+0.331923430 container start daf92d957622797d7f46359e8ad3d231cb35776b9f71d4b1fc9b325e07741632 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0-activate, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, RELEASE=squid-3781e3a, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240612, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-06-18T02:12:44.432 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:44 smithi007 podman[123914]: 2024-06-18 02:12:44.234538825 +0000 UTC m=+0.419917606 container attach daf92d957622797d7f46359e8ad3d231cb35776b9f71d4b1fc9b325e07741632 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0-activate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.build-date=20240612, io.buildah.version=1.36.0, ceph=True, GIT_CLEAN=True, RELEASE=squid-3781e3a, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-06-18T02:12:44.901 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:44 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0-activate[123929]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-06-18T02:12:44.901 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:44 smithi007 bash[123914]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-06-18T02:12:44.901 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:44 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0-activate[123929]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-06-18T02:12:44.901 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:44 smithi007 bash[123914]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-06-18T02:12:44.901 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:44 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0-activate[123929]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-06-18T02:12:44.901 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:44 smithi007 bash[123914]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-06-18T02:12:44.901 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:44 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0-activate[123929]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-06-18T02:12:44.902 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:44 smithi007 bash[123914]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-06-18T02:12:44.902 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:44 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0-activate[123929]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-06-18T02:12:44.902 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:44 smithi007 bash[123914]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-06-18T02:12:44.902 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:44 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0-activate[123929]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-06-18T02:12:44.902 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:44 smithi007 bash[123914]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-06-18T02:12:44.902 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:44 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0-activate[123929]: --> ceph-volume raw activate successful for osd ID: 0 2024-06-18T02:12:44.902 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:44 smithi007 bash[123914]: --> ceph-volume raw activate successful for osd ID: 0 2024-06-18T02:12:44.902 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:44 smithi007 podman[123914]: 2024-06-18 02:12:44.581541131 +0000 UTC m=+0.766919912 container died daf92d957622797d7f46359e8ad3d231cb35776b9f71d4b1fc9b325e07741632 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-3781e3a, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240612, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47) 2024-06-18T02:12:45.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:44 smithi007 ceph-mon[113333]: osdmap e124: 8 total, 7 up, 8 in 2024-06-18T02:12:45.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:44 smithi007 ceph-mon[113333]: pgmap v147: 161 pgs: 10 peering, 36 active+undersized, 20 active+undersized+degraded, 95 active+clean; 585 KiB data, 122 MiB used, 715 GiB / 715 GiB avail; 74/726 objects degraded (10.193%) 2024-06-18T02:12:45.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:44 smithi007 ceph-mon[99735]: osdmap e124: 8 total, 7 up, 8 in 2024-06-18T02:12:45.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:44 smithi007 ceph-mon[99735]: pgmap v147: 161 pgs: 10 peering, 36 active+undersized, 20 active+undersized+degraded, 95 active+clean; 585 KiB data, 122 MiB used, 715 GiB / 715 GiB avail; 74/726 objects degraded (10.193%) 2024-06-18T02:12:45.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:44 smithi130 ceph-mon[84407]: osdmap e124: 8 total, 7 up, 8 in 2024-06-18T02:12:45.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:44 smithi130 ceph-mon[84407]: pgmap v147: 161 pgs: 10 peering, 36 active+undersized, 20 active+undersized+degraded, 95 active+clean; 585 KiB data, 122 MiB used, 715 GiB / 715 GiB avail; 74/726 objects degraded (10.193%) 2024-06-18T02:12:45.570 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:45 smithi007 podman[124056]: 2024-06-18 02:12:45.263815844 +0000 UTC m=+0.676524967 container remove daf92d957622797d7f46359e8ad3d231cb35776b9f71d4b1fc9b325e07741632 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-3781e3a, org.label-schema.build-date=20240612, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-06-18T02:12:45.571 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:45 smithi007 podman[124115]: 2024-06-18 02:12:45.473079875 +0000 UTC m=+0.099650302 container create 07c7f4afd49aa44e8d75511e8e277438e8637858ff92c22e746f1138f0e910d8 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240612, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-3781e3a, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS) 2024-06-18T02:12:45.571 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:45 smithi007 podman[124115]: 2024-06-18 02:12:45.391874112 +0000 UTC m=+0.018444536 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:12:45.995 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:45 smithi007 ceph-mon[113333]: Health check failed: Reduced data availability: 3 pgs inactive, 4 pgs peering (PG_AVAILABILITY) 2024-06-18T02:12:45.995 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:45 smithi007 ceph-mon[113333]: Health check failed: Degraded data redundancy: 74/726 objects degraded (10.193%), 20 pgs degraded (PG_DEGRADED) 2024-06-18T02:12:45.996 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:45 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:45.996 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:45 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:45.996 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:45 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:45.996 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:45 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:45.996 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:45 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:45.996 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:45 smithi007 ceph-mon[99735]: Health check failed: Reduced data availability: 3 pgs inactive, 4 pgs peering (PG_AVAILABILITY) 2024-06-18T02:12:45.996 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:45 smithi007 ceph-mon[99735]: Health check failed: Degraded data redundancy: 74/726 objects degraded (10.193%), 20 pgs degraded (PG_DEGRADED) 2024-06-18T02:12:45.996 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:45 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:45.996 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:45 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:45.996 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:45.997 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:45.997 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:45 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:45.997 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:45 smithi007 podman[124115]: 2024-06-18 02:12:45.683689014 +0000 UTC m=+0.310259438 container init 07c7f4afd49aa44e8d75511e8e277438e8637858ff92c22e746f1138f0e910d8 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0, org.label-schema.schema-version=1.0, RELEASE=squid-3781e3a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.build-date=20240612, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-06-18T02:12:45.997 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:45 smithi007 podman[124115]: 2024-06-18 02:12:45.687159158 +0000 UTC m=+0.313729582 container start 07c7f4afd49aa44e8d75511e8e277438e8637858ff92c22e746f1138f0e910d8 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240612, ceph=True, RELEASE=squid-3781e3a, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-06-18T02:12:45.997 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:45 smithi007 ceph-osd[124134]: -- 172.21.15.7:0/2569957884 <== mon.1 v2:172.21.15.7:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55818fd1da40 con 0x558190adc000 2024-06-18T02:12:45.997 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:45 smithi007 bash[124115]: 07c7f4afd49aa44e8d75511e8e277438e8637858ff92c22e746f1138f0e910d8 2024-06-18T02:12:45.997 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:45 smithi007 systemd[1]: Started Ceph osd.0 for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:12:46.286 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0[124130]: 2024-06-18T02:12:46.227+0000 7f109193e640 -1 Falling back to public interface 2024-06-18T02:12:46.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:45 smithi130 ceph-mon[84407]: Health check failed: Reduced data availability: 3 pgs inactive, 4 pgs peering (PG_AVAILABILITY) 2024-06-18T02:12:46.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:45 smithi130 ceph-mon[84407]: Health check failed: Degraded data redundancy: 74/726 objects degraded (10.193%), 20 pgs degraded (PG_DEGRADED) 2024-06-18T02:12:46.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:45 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:46.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:45 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:46.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:46.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:46.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:45 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:47.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:47.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[113333]: pgmap v148: 161 pgs: 10 peering, 36 active+undersized, 20 active+undersized+degraded, 95 active+clean; 585 KiB data, 122 MiB used, 715 GiB / 715 GiB avail; 74/726 objects degraded (10.193%) 2024-06-18T02:12:47.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:47.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:47.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:47.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:47.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:47.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:47.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:47.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:47.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:47.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:47.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:47.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:47.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:47.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:47.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:47.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:47.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:47.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:47.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:47.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:47.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:47.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:47.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:47.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:47.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:47.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:47.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:47.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[99735]: pgmap v148: 161 pgs: 10 peering, 36 active+undersized, 20 active+undersized+degraded, 95 active+clean; 585 KiB data, 122 MiB used, 715 GiB / 715 GiB avail; 74/726 objects degraded (10.193%) 2024-06-18T02:12:47.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:47.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:47.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:47.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:47.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:47.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:47.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:47.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:47.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:47.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:47.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:47.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:47.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:47.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:47.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:47.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:47.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:47.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:47.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:47.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:47.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:47.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:47.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:47.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:47.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:47.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:47.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:47.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:47.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:47.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:47.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:47.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:47.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:47.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:47.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:47.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:47.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:47.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:47.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:47.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:47.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:47.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:47.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:47.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:47.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:47.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:47.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:47.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:47.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:47.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:47.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:47.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:47.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:47.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:47.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:47.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:47.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:47.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:47.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:47.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:47.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:47.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:47.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:47.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:47.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:47.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:47.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:47.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:46 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:47.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:46 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:47.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:46 smithi130 ceph-mon[84407]: pgmap v148: 161 pgs: 10 peering, 36 active+undersized, 20 active+undersized+degraded, 95 active+clean; 585 KiB data, 122 MiB used, 715 GiB / 715 GiB avail; 74/726 objects degraded (10.193%) 2024-06-18T02:12:47.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:47.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:47.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:47.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:47.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:46 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:47.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:46 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:47.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:47.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:47.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:47.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:47.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:46 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:47.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:46 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:47.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:47.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:47.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:47.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:47.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:46 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:47.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:47.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:47.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:47.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:47.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:46 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:47.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:47.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:47.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:47.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:47.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:46 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:47.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:47.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:47.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:47.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:47.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:46 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:47.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:47.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:47.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:47.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:47.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:46 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:47.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:47.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:47.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:47.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:47.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:46 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:47.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:47.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:47.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:47.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:47.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:46 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:48.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:48.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:48.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:48.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:48.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:48.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:48.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:48.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:48.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:48.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:48.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:48.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:48.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:48.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:48.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:48.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:48.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:48.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:48.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:48.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:48.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:48.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:48.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:48.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:48.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:48.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:48.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:48.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:48.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:48.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:48.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:48.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:48.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:48.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:48.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:48.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:48.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:48.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:48.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:48.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:48.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:48.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:48.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:48.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:48.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:48.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:48.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:48.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:48.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:48.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:48.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:48.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:48.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:48.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:48.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:48.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:48.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:48.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:48.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:48.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:48.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:48.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:48.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:48.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:48.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:48.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:48.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:48.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:48.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:48.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:48.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:48.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:48.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:48.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:48.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:48.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:48.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:48.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:48.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:48.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:48.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:48.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:48.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:48.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:48.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:48.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:48.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:48.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:48.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:48.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:48.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:48.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:48.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:48.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:48.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:48.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:47 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:48.194 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:12:47 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:12:47] "GET /metrics HTTP/1.1" 200 38334 "" "Prometheus/2.33.4" 2024-06-18T02:12:48.195 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:47 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:48.195 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:47 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:48.195 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:47 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:48.195 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:47 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:48.195 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:47 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:48.195 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:47 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:48.196 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:47 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:48.196 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:48.196 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:48.196 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:48.196 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:48.196 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:47 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:48.196 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:47 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:48.196 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:48.196 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:48.196 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:48.196 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:48.196 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:47 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:48.196 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:48.196 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:48.196 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:48.197 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:48.197 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:47 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:48.197 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:48.197 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:48.197 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:48.197 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:48.197 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:47 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:48.197 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:48.197 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:48.197 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:48.197 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:48.197 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:47 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:48.197 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:48.197 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:48.197 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:48.197 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:48.198 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:47 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:48.198 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:48.198 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:48.198 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:48.198 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:48.198 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:47 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:48.198 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:48.198 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:48.198 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:48.198 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:48.198 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:47 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:49.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:48 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:49.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:48 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:49.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:48 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:49.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:48 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:49.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:48 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:49.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:48 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:49.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:48 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:49.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:48 smithi130 ceph-mon[84407]: pgmap v149: 161 pgs: 10 active+clean+remapped, 36 active+undersized, 20 active+undersized+degraded, 95 active+clean; 585 KiB data, 131 MiB used, 715 GiB / 715 GiB avail; 74/726 objects degraded (10.193%); 5/726 objects misplaced (0.689%); 15 B/s, 0 objects/s recovering 2024-06-18T02:12:49.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:49.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:49.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:49.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:49.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:48 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:49.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:48 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:49.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:49.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:49.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:49.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:49.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:48 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:49.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:48 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:49.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:49.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:49.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:49.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:49.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:48 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:49.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:49.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:49.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:49.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:49.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:48 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:49.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:49.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:49.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:49.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:49.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:48 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:49.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:49.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:49.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:49.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:49.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:48 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:49.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:49.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:49.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:49.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:49.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:48 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:49.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:49.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:49.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:49.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:49.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:48 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:49.109 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0[124130]: 2024-06-18T02:12:48.984+0000 7f109193e640 -1 osd.0 120 log_to_monitors true 2024-06-18T02:12:49.109 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:49.110 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:49.110 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:49.110 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:49.110 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:49.110 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:49.111 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:49.111 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[99735]: pgmap v149: 161 pgs: 10 active+clean+remapped, 36 active+undersized, 20 active+undersized+degraded, 95 active+clean; 585 KiB data, 131 MiB used, 715 GiB / 715 GiB avail; 74/726 objects degraded (10.193%); 5/726 objects misplaced (0.689%); 15 B/s, 0 objects/s recovering 2024-06-18T02:12:49.111 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:49.111 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:49.111 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:49.112 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:49.112 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:49.112 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:49.112 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:49.112 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:49.112 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:49.113 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:49.113 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:49.113 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:49.113 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:49.113 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:49.113 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:49.114 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:49.114 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:49.114 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:49.114 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:49.114 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:49.114 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:49.115 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:49.115 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:49.115 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:49.115 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:49.115 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:49.115 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:49.115 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:49.115 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[113333]: pgmap v149: 161 pgs: 10 active+clean+remapped, 36 active+undersized, 20 active+undersized+degraded, 95 active+clean; 585 KiB data, 131 MiB used, 715 GiB / 715 GiB avail; 74/726 objects degraded (10.193%); 5/726 objects misplaced (0.689%); 15 B/s, 0 objects/s recovering 2024-06-18T02:12:49.115 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:49.116 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:49.116 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:49.116 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:49.116 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:49.116 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:49.116 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:49.116 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:49.116 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:49.116 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:49.116 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:49.116 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:49.116 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:49.116 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:49.116 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:49.117 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:49.117 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:49.117 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:49.117 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:49.117 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:49.117 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:49.117 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:49.117 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:49.117 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:49.117 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:49.118 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:49.118 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:49.118 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:49.118 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:49.118 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:49.118 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:49.118 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:49.118 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:49.118 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:49.118 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:49.118 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:49.118 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:49.118 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:49.119 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:49.119 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:49.119 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:49.119 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:49.119 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:49.119 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:49.119 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:49.119 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:49.119 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:49.119 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:49.119 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:49.119 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:49.119 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:49.120 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:49.120 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:49.120 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:49.120 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:49.120 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:49.120 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:49.120 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:49.120 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:49.120 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:49.120 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:49.120 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:49.120 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:48 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:50.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:49 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:50.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:49 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:50.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:49 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:50.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:49 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:50.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:49 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:50.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:49 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:50.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:49 smithi130 ceph-mon[84407]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs inactive, 4 pgs peering) 2024-06-18T02:12:50.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:50.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:50.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:50.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:50.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:49 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:50.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:49 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:50.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:49 smithi130 ceph-mon[84407]: from='osd.0 [v2:172.21.15.7:6800/124350391,v1:172.21.15.7:6801/124350391]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-18T02:12:50.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:49 smithi130 ceph-mon[84407]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-18T02:12:50.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:50.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:50.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:50.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:50.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:49 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:50.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:49 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:50.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:50.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:50.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:50.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:50.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:49 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:50.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:50.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:50.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:50.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:50.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:49 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:50.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:50.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:50.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:50.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:50.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:49 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:50.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:50.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:50.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:50.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:50.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:49 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:50.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:50.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:50.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:50.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:50.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:49 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:50.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:50.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:50.049 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:50.049 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:50.049 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:49 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:50.049 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:50.049 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:50.049 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:50.049 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:50.049 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:49 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:50.075 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0[124130]: 2024-06-18T02:12:49.942+0000 7f10856e1640 -1 osd.0 120 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-18T02:12:50.076 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:50.076 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:50.076 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:50.076 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:50.077 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:50.077 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:50.077 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[113333]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs inactive, 4 pgs peering) 2024-06-18T02:12:50.077 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:50.077 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:50.077 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:50.077 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:50.077 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:50.077 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:50.077 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[113333]: from='osd.0 [v2:172.21.15.7:6800/124350391,v1:172.21.15.7:6801/124350391]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-18T02:12:50.077 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[113333]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-18T02:12:50.077 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:50.077 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:50.077 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:50.078 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:50.078 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:50.078 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:50.078 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:50.078 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:50.078 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:50.078 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:50.078 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:50.079 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:50.079 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:50.079 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:50.079 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:50.079 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:50.079 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:50.079 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:50.079 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:50.080 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:50.080 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[99735]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs inactive, 4 pgs peering) 2024-06-18T02:12:50.080 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:50.080 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:50.080 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:50.080 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:50.080 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:50.080 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:50.080 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[99735]: from='osd.0 [v2:172.21.15.7:6800/124350391,v1:172.21.15.7:6801/124350391]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-18T02:12:50.080 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[99735]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-18T02:12:50.080 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:50.080 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:50.080 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:50.080 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:50.081 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:50.081 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:50.081 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:50.081 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:50.081 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:50.081 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:50.081 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:50.081 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:50.081 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:50.081 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:50.081 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:50.081 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:50.081 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:50.081 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:50.081 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:50.082 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:50.082 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:50.082 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:50.082 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:50.082 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:50.082 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:50.082 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:50.082 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:50.082 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:50.082 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:50.083 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:50.083 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:50.083 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:50.083 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:50.083 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:50.083 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:50.083 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:50.083 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:50.083 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:50.083 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:50.083 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:50.083 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:50.083 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:50.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:50.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:50.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:50.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:50.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:50.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:50.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:50.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:50.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:50.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:50.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:50.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:50.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:50.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:50.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:50.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:50.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:50.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:50.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:50.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:50.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:50.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:50.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:50.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:50.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:50.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:49 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:51.209 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:51.209 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:51.209 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:51.209 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:51.209 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:51.209 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:51.209 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:51.209 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[113333]: pgmap v150: 161 pgs: 10 active+clean+remapped, 36 active+undersized, 20 active+undersized+degraded, 95 active+clean; 585 KiB data, 131 MiB used, 715 GiB / 715 GiB avail; 74/726 objects degraded (10.193%); 5/726 objects misplaced (0.689%); 11 B/s, 0 objects/s recovering 2024-06-18T02:12:51.209 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[113333]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-06-18T02:12:51.209 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[113333]: osdmap e125: 8 total, 7 up, 8 in 2024-06-18T02:12:51.210 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[113333]: from='osd.0 [v2:172.21.15.7:6800/124350391,v1:172.21.15.7:6801/124350391]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-06-18T02:12:51.210 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[113333]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-06-18T02:12:51.210 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:51.210 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:51.210 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:51.210 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:51.210 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:51.210 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:51.210 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:51.210 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:51.210 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:51.210 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:51.210 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:51.211 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:51.211 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:51.211 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:51.211 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:51.211 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:51.211 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:51.211 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:51.211 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:51.211 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:51.211 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:51.212 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:51.212 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:51.212 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[99735]: pgmap v150: 161 pgs: 10 active+clean+remapped, 36 active+undersized, 20 active+undersized+degraded, 95 active+clean; 585 KiB data, 131 MiB used, 715 GiB / 715 GiB avail; 74/726 objects degraded (10.193%); 5/726 objects misplaced (0.689%); 11 B/s, 0 objects/s recovering 2024-06-18T02:12:51.212 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[99735]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-06-18T02:12:51.212 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[99735]: osdmap e125: 8 total, 7 up, 8 in 2024-06-18T02:12:51.212 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[99735]: from='osd.0 [v2:172.21.15.7:6800/124350391,v1:172.21.15.7:6801/124350391]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-06-18T02:12:51.212 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[99735]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-06-18T02:12:51.212 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:51.212 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:51.212 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:51.212 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:51.212 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:51.212 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:51.212 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:51.213 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:51.213 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:51.213 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:51.213 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:51.213 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:51.213 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:51.213 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:51.213 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:51.213 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:51.213 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:51.213 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:51.214 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:51.214 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:51.214 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:51.214 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:51.214 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:51.214 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:51.214 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:51.214 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:51.214 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:51.214 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:51.214 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:51.214 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:51.214 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:51.214 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:51.215 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:51.215 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:51.215 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:51.215 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:51.215 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:51.215 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:51.215 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:51.215 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:51.215 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:51.215 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:51.215 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:51.216 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:51.216 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:51.216 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:51.216 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:51.216 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:51.216 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:51.216 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:51.216 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:51.216 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:51.216 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:51.216 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:51.216 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:51.216 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:51.216 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:51.217 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:51.217 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:51.217 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:51.217 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:51.217 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:51.217 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:51.217 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:51.217 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:51.217 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:50 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:51.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:50 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:51.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:50 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:51.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:50 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:51.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:50 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:51.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:50 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:51.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:50 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:51.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:50 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:51.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:50 smithi130 ceph-mon[84407]: pgmap v150: 161 pgs: 10 active+clean+remapped, 36 active+undersized, 20 active+undersized+degraded, 95 active+clean; 585 KiB data, 131 MiB used, 715 GiB / 715 GiB avail; 74/726 objects degraded (10.193%); 5/726 objects misplaced (0.689%); 11 B/s, 0 objects/s recovering 2024-06-18T02:12:51.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:50 smithi130 ceph-mon[84407]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-06-18T02:12:51.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:50 smithi130 ceph-mon[84407]: osdmap e125: 8 total, 7 up, 8 in 2024-06-18T02:12:51.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:50 smithi130 ceph-mon[84407]: from='osd.0 [v2:172.21.15.7:6800/124350391,v1:172.21.15.7:6801/124350391]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-06-18T02:12:51.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:50 smithi130 ceph-mon[84407]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-06-18T02:12:51.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:51.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:51.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:51.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:51.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:50 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:51.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:50 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:51.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:51.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:51.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:51.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:51.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:50 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:51.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:51.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:51.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:51.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:51.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:50 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:51.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:51.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:51.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:51.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:51.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:50 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:51.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:51.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:51.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:51.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:51.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:50 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:51.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:51.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:51.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:51.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:51.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:50 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:51.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:51.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:51.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:51.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:51.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:50 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:51.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:51.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:51.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:51.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:51.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:50 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:52.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:51 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:52.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:51 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:52.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:51 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:52.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:51 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:52.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:51 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:52.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:51 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:52.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:51 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:52.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:51 smithi130 ceph-mon[84407]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-06-18T02:12:52.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:51 smithi130 ceph-mon[84407]: osd.0 [v2:172.21.15.7:6800/124350391,v1:172.21.15.7:6801/124350391] boot 2024-06-18T02:12:52.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:51 smithi130 ceph-mon[84407]: osdmap e126: 8 total, 8 up, 8 in 2024-06-18T02:12:52.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-18T02:12:52.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:52.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:52.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:52.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:52.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:51 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:52.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:51 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:52.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:52.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:52.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:52.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:52.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:51 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:52.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:52.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:52.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:52.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:52.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:51 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:52.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:52.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:52.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:52.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:52.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:51 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:52.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:52.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:52.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:52.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:52.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:51 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:52.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:52.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:52.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:52.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:52.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:51 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:52.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:52.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:52.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:52.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:52.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:51 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:52.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:52.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:52.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:52.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:52.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:51 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:52.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:52.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:52.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:52.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:52.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:51 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:52.383 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:52.384 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:52.384 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:52.384 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:52.384 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:52.384 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:52.384 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:52.384 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[113333]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-06-18T02:12:52.384 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[113333]: osd.0 [v2:172.21.15.7:6800/124350391,v1:172.21.15.7:6801/124350391] boot 2024-06-18T02:12:52.384 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[113333]: osdmap e126: 8 total, 8 up, 8 in 2024-06-18T02:12:52.384 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-18T02:12:52.384 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:52.384 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:52.385 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:52.385 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:52.385 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:52.385 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:52.385 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:52.385 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:52.385 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:52.385 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:52.385 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:52.385 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:52.385 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:52.385 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:52.385 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:52.385 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:52.386 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:52.386 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:52.386 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:52.386 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:52.386 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:52.386 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:52.386 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:52.386 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:52.386 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:52.386 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:52.387 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:52.387 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[99735]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-06-18T02:12:52.387 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[99735]: osd.0 [v2:172.21.15.7:6800/124350391,v1:172.21.15.7:6801/124350391] boot 2024-06-18T02:12:52.387 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[99735]: osdmap e126: 8 total, 8 up, 8 in 2024-06-18T02:12:52.387 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-18T02:12:52.387 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:52.387 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:52.387 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:52.387 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:52.387 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:52.387 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:52.387 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:52.387 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:52.388 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:52.388 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:52.388 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:52.388 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:52.388 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:52.388 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:52.388 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:52.388 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:52.388 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:52.389 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:52.389 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:52.389 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:52.389 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:52.389 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:52.389 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:52.389 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:52.389 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:52.390 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:52.390 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:52.390 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:52.390 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:52.390 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:52.391 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:52.391 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:52.391 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:52.391 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:52.391 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:52.391 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:52.391 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:52.391 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:52.391 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:52.391 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:52.391 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:52.391 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:52.391 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:52.391 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:52.392 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:52.392 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:52.392 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:52.392 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:52.392 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:52.392 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:52.392 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:52.392 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:52.392 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:52.392 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:52.392 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:52.392 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:52.392 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:52.393 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:52.393 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:52.393 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:52.393 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:52.393 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:52.393 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:52.393 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:52.393 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:52.393 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:52.393 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:52.393 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:52.393 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:52.393 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:52.394 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:52.394 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:51 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:53.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:52 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:53.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:52 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:53.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:52 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:53.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:52 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:53.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:52 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:53.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:52 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:53.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:52 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:53.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:52 smithi130 ceph-mon[84407]: pgmap v153: 161 pgs: 10 active+clean+remapped, 36 active+undersized, 20 active+undersized+degraded, 95 active+clean; 585 KiB data, 127 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 74/726 objects degraded (10.193%); 5/726 objects misplaced (0.689%); 11 B/s, 0 objects/s recovering 2024-06-18T02:12:53.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:52 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:53.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:52 smithi130 ceph-mon[84407]: osdmap e127: 8 total, 8 up, 8 in 2024-06-18T02:12:53.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:53.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:53.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:53.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:53.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:52 smithi130 ceph-mon[84407]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:12:53.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:52 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:53.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:52 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:53.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:53.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:53.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:53.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:53.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:52 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:53.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:53.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:53.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:53.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:53.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:52 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:53.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:53.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:53.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:53.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:53.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:52 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:53.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:53.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:53.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:53.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:53.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:52 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:53.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:53.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:53.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:53.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:53.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:52 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:53.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:53.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:53.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:53.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:53.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:52 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:53.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:53.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:53.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:53.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:53.300 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:52 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:53.300 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:52 smithi130 ceph-mon[84407]: osdmap e128: 8 total, 8 up, 8 in 2024-06-18T02:12:53.301 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:53.301 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:53.301 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:53.301 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:53.301 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:53.301 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:53.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:53.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[113333]: pgmap v153: 161 pgs: 10 active+clean+remapped, 36 active+undersized, 20 active+undersized+degraded, 95 active+clean; 585 KiB data, 127 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 74/726 objects degraded (10.193%); 5/726 objects misplaced (0.689%); 11 B/s, 0 objects/s recovering 2024-06-18T02:12:53.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:53.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[113333]: osdmap e127: 8 total, 8 up, 8 in 2024-06-18T02:12:53.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:53.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:53.303 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:53.303 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:53.303 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[113333]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:12:53.303 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:53.303 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:53.303 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:53.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:53.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:53.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:53.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:53.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:53.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:53.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:53.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:53.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:53.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:53.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:53.306 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:53.306 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:53.306 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:53.306 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:53.306 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:53.306 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:53.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:53.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[99735]: pgmap v153: 161 pgs: 10 active+clean+remapped, 36 active+undersized, 20 active+undersized+degraded, 95 active+clean; 585 KiB data, 127 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 74/726 objects degraded (10.193%); 5/726 objects misplaced (0.689%); 11 B/s, 0 objects/s recovering 2024-06-18T02:12:53.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:53.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[99735]: osdmap e127: 8 total, 8 up, 8 in 2024-06-18T02:12:53.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:53.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:53.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:53.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:53.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[99735]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:12:53.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:53.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:53.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:53.309 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:53.309 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:53.309 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:53.309 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:53.309 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:53.309 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:53.309 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:53.310 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:53.310 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:53.310 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:53.310 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:53.311 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:53.311 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:53.311 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:53.311 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:53.311 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:53.312 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:53.312 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:53.312 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:53.312 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:53.312 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:53.312 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:53.312 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:53.313 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:53.313 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:53.313 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:53.313 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:53.313 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:53.313 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:53.314 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:53.314 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:53.314 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:53.314 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:53.314 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:53.315 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[113333]: osdmap e128: 8 total, 8 up, 8 in 2024-06-18T02:12:53.315 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:53.315 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:53.315 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:53.315 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:53.316 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:53.316 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:53.316 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:53.316 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:53.316 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:53.316 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:53.317 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:53.317 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:53.317 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:53.317 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:53.317 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:53.317 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:53.318 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:53.318 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:53.318 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:53.318 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:53.318 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:53.318 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:53.319 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:53.319 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:52 smithi007 ceph-mon[99735]: osdmap e128: 8 total, 8 up, 8 in 2024-06-18T02:12:54.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:53 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:54.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:53 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:54.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:53 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:54.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:53 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:54.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:53 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:54.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:53 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:54.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:53 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:54.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:54.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:54.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:54.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:54.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:53 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:54.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:53 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:54.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:53 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:54.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:53 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:54.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:53 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:54.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:54.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:54.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:54.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:54.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:53 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:54.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:54.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:54.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:54.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:54.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:53 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:54.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:54.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:54.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:54.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:54.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:53 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:54.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:54.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:54.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:54.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:54.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:53 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:54.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:54.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:54.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:54.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:54.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:53 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:54.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:54.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:54.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:54.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:54.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:53 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:54.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:54.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:54.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:54.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:54.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:53 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:54.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:54.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:54.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:54.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:54.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:53 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:54.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:54.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:54.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:54.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:54.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:54.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:54.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:54.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:54.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:54.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:54.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:54.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:54.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:54.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:54.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:54.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:54.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:54.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:54.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:54.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:54.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:54.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:54.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:54.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:54.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:54.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:54.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:54.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:54.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:54.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:54.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:54.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:54.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:54.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:54.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:54.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:54.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:54.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:54.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:54.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:54.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:54.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:54.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:54.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:54.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:54.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:54.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:54.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:54.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:54.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:54.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:54.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:54.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:54.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:54.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:54.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:54.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:54.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:54.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:54.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:54.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:54.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:54.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:54.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:54.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:54.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:54.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:54.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:54.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:54.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:54.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:54.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:54.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:54.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:54.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:54.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:54.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:54.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:54.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:54.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:54.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:54.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:54.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:54.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:54.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:54.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:54.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:54.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:54.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:54.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:54.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:54.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:54.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:54.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:54.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:54.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:54.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:54.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:54.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:54.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:54.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:54.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:54.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:54.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:54.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:54.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:54.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:54.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:54.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:54.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:54.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:54.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:53 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:55.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:55.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:55.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:55.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:55.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:55.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:55.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:55.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[99735]: pgmap v156: 161 pgs: 6 peering, 4 active+clean+remapped, 13 active+undersized, 8 active+undersized+degraded, 130 active+clean; 585 KiB data, 127 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 33/726 objects degraded (4.545%); 1/726 objects misplaced (0.138%) 2024-06-18T02:12:55.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:55.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:55.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:55.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:55.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:55.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:55.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:55.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:55.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:55.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:55.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:55.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:55.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:55.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:55.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:55.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:55.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:55.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:55.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:55.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:55.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:55.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:55.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:55.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:55.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:55.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:55.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:55.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:55.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:55.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:55.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:55.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:55.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:55.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:55.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:55.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:55.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:55.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[99735]: Health check update: Degraded data redundancy: 33/726 objects degraded (4.545%), 8 pgs degraded (PG_DEGRADED) 2024-06-18T02:12:55.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:55.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:55.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:55.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:55.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:55.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:55.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:55.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:55.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:55.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:55.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:55.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:55.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[113333]: pgmap v156: 161 pgs: 6 peering, 4 active+clean+remapped, 13 active+undersized, 8 active+undersized+degraded, 130 active+clean; 585 KiB data, 127 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 33/726 objects degraded (4.545%); 1/726 objects misplaced (0.138%) 2024-06-18T02:12:55.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:55.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:55.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:55.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:55.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:55.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:55.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:55.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:55.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:55.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:55.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:55.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:55.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:55.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:55.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:55.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:55.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:55.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:55.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:55.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:55.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:55.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:55.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:55.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:55.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:55.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:55.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:55.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:55.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:55.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:55.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:55.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:55.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:55.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:55.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:55.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:55.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:55.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[113333]: Health check update: Degraded data redundancy: 33/726 objects degraded (4.545%), 8 pgs degraded (PG_DEGRADED) 2024-06-18T02:12:55.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:55.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:55.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:55.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:55.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:54 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:55.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:54 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:55.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:54 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:55.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:54 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:55.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:54 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:55.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:54 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:55.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:54 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:55.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:54 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:55.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:54 smithi130 ceph-mon[84407]: pgmap v156: 161 pgs: 6 peering, 4 active+clean+remapped, 13 active+undersized, 8 active+undersized+degraded, 130 active+clean; 585 KiB data, 127 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 33/726 objects degraded (4.545%); 1/726 objects misplaced (0.138%) 2024-06-18T02:12:55.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:54 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:55.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:55.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:55.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:55.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:55.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:54 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:55.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:54 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:55.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:55.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:55.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:55.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:55.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:54 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:55.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:55.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:55.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:55.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:55.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:54 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:55.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:55.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:55.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:55.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:55.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:54 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:55.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:55.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:55.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:55.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:55.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:54 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:55.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:55.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:55.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:55.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:55.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:54 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:55.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:55.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:55.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:55.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:55.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:54 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:55.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:54 smithi130 ceph-mon[84407]: Health check update: Degraded data redundancy: 33/726 objects degraded (4.545%), 8 pgs degraded (PG_DEGRADED) 2024-06-18T02:12:55.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:55.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:55.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:55.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:55.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:54 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:56.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:55 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:56.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:55 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:56.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:55 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:56.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:55 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:56.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:55 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:56.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:55 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:56.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:55 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:56.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:56.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:56.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:56.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:56.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:55 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:56.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:55 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:56.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:56.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:56.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:56.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:56.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:55 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:56.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:56.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:56.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:56.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:56.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:55 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:56.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:56.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:56.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:56.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:56.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:55 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:56.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:56.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:56.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:56.300 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:56.300 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:55 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:56.300 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:56.300 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:56.300 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:56.300 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:56.300 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:55 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:56.301 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:56.301 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:56.301 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:56.301 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:56.301 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:55 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:56.301 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:56.302 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:56.302 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:56.302 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:56.302 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:55 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:56.302 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:56.302 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:56.303 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:56.303 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:56.303 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:55 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:56.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:56.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:56.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:56.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:56.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:56.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:56.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:56.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:56.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:56.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:56.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:56.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:56.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:56.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:56.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:56.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:56.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:56.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:56.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:56.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:56.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:56.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:56.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:56.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:56.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:56.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:56.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:56.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:56.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:56.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:56.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:56.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:56.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:56.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:56.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:56.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:56.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:56.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:56.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:56.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:56.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:56.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:56.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:56.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:56.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:56.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:56.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:56.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:56.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:56.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:56.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:56.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:56.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:56.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:56.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:56.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:56.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:56.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:56.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:56.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:56.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:56.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:56.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:56.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:56.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:56.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:56.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:56.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:56.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:56.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:56.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:56.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:56.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:56.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:56.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:56.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:56.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:56.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:56.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:56.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:56.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:56.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:56.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:56.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:56.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:56.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:56.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:56.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:56.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:56.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:56.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:56.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:56.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:56.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:56.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:56.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:56.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:56.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:56.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:56.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:56.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:56.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:56.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:56.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:56.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:56.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:55 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:57.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:57.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:57.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:57.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:57.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:57.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:57.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:57.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:57.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: pgmap v157: 161 pgs: 6 peering, 155 active+clean; 585 KiB data, 128 MiB used, 715 GiB / 715 GiB avail; 854 B/s rd, 0 op/s; 61 B/s, 0 objects/s recovering 2024-06-18T02:12:57.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:57.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:57.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:57.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:57.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:57.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:57.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:57.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:57.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:57.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:57.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:57.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:57.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:12:57.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:57.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:57.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:57.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:57.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:57.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:57.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:57.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:57.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:57.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:57.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:57.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:57.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:57.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:57.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:57.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:57.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:57.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: pgmap v157: 161 pgs: 6 peering, 155 active+clean; 585 KiB data, 128 MiB used, 715 GiB / 715 GiB avail; 854 B/s rd, 0 op/s; 61 B/s, 0 objects/s recovering 2024-06-18T02:12:57.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:57.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:57.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:57.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:57.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:57.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:57.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:57.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:57.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:57.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:57.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:57.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:57.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:12:57.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:57.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:57.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:57.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:57.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:57.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:57.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:57.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:57.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:57.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:57.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:57.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:57.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:57.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:57.192 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:57.192 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:57.192 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:57.192 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:57.192 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:57.192 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:57.192 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:57.192 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:57.192 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:57.192 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:57.192 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:57.192 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:57.192 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:57.193 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:57.193 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:57.193 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:57.193 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:57.193 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 33/726 objects degraded (4.545%), 8 pgs degraded) 2024-06-18T02:12:57.193 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: Cluster is now healthy 2024-06-18T02:12:57.193 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:57.193 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:57.193 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:57.193 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:57.193 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:57.193 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:57.194 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:57.194 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:57.194 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:57.194 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:57.194 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:57.194 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:57.194 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:57.194 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:57.194 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:57.194 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:57.194 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:57.194 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:57.194 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:57.195 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:57.195 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:57.195 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:57.195 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:57.195 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:57.195 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:57.195 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:57.195 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:57.195 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 33/726 objects degraded (4.545%), 8 pgs degraded) 2024-06-18T02:12:57.195 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: Cluster is now healthy 2024-06-18T02:12:57.195 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:57.195 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:57.195 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:57.196 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:57.196 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:56 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:57.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:57.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:57.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:57.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:57.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:57.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:57.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:57.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:57.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: pgmap v157: 161 pgs: 6 peering, 155 active+clean; 585 KiB data, 128 MiB used, 715 GiB / 715 GiB avail; 854 B/s rd, 0 op/s; 61 B/s, 0 objects/s recovering 2024-06-18T02:12:57.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:57.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:57.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:57.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:57.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:57.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:57.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:57.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:57.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:57.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:57.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:57.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:57.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:12:57.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:57.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:57.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:57.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:57.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:57.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:57.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:57.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:57.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:57.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:57.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:57.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:57.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:57.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:57.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:57.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:57.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:57.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:57.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:57.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:57.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:57.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:57.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:57.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:57.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:57.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:57.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:57.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:57.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:57.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:57.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:57.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 33/726 objects degraded (4.545%), 8 pgs degraded) 2024-06-18T02:12:57.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: Cluster is now healthy 2024-06-18T02:12:57.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:57.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:57.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:57.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:57.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:56 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:58.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:12:57 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:12:57] "GET /metrics HTTP/1.1" 200 38405 "" "Prometheus/2.33.4" 2024-06-18T02:12:58.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:57 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:58.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:57 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:58.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:57 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:58.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:57 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:58.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:57 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:58.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:57 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:58.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:57 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:58.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:57 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:58.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:58.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:58.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:58.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:58.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:57 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:58.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:57 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:58.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:58.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:58.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:58.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:58.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:57 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:58.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:58.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:58.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:58.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:58.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:57 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:58.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:58.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:58.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:58.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:58.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:57 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:58.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:58.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:58.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:58.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:58.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:57 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:58.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:58.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:58.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:58.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:58.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:57 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:58.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:58.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:58.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:58.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:58.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:57 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:58.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:58.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:58.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:58.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:58.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:57 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:58.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:58.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:58.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:58.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:58.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:57 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:58.393 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:58.393 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:58.393 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:58.393 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:58.393 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:58.393 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:58.393 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:58.393 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:58.393 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:58.393 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:58.393 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:58.394 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:58.394 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:58.394 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:58.394 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:58.394 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:58.394 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:58.394 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:58.394 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:58.394 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:58.394 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:58.394 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:58.394 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:58.394 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:58.395 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:58.395 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:58.395 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:58.395 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:58.395 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:58.395 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:58.395 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:58.395 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:58.395 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:58.395 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:58.395 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:58.396 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:58.396 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:58.396 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:58.396 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:58.396 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:58.396 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:58.396 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:58.396 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:58.396 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:58.396 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:58.396 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:58.396 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:58.396 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:58.396 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:58.396 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:58.397 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:58.397 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:58.397 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:58.397 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:58.397 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:58.397 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:58.397 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:58.397 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:58.397 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:58.397 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:58.397 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:58.397 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:58.398 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:58.398 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:58.398 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:58.398 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:58.398 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:58.398 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:58.398 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:58.398 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:58.398 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:58.398 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:58.399 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:58.399 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:58.399 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:58.399 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:58.399 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:58.399 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:58.399 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:58.399 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:58.399 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:58.399 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:58.399 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:58.399 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:58.399 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:58.400 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:58.400 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:58.400 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:58.400 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:58.400 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:58.400 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:58.400 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:58.400 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:58.400 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:58.400 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:58.401 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:58.401 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:58.401 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:58.401 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:58.401 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:58.401 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:58.401 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:58.401 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:58.401 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:58.401 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:58.401 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:58.401 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:58.401 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:57 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:59.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:58 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:59.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:58 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:59.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:58 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:59.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:58 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:59.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:58 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:59.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:58 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:59.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:58 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:59.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:58 smithi130 ceph-mon[84407]: pgmap v158: 161 pgs: 161 active+clean; 585 KiB data, 128 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s; 86 B/s, 0 objects/s recovering 2024-06-18T02:12:59.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:58 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:59.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:59.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:59.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:59.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:59.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:58 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:59.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:58 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:59.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:59.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:59.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:59.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:59.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:58 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:59.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:59.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:59.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:59.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:59.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:58 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:59.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:59.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:59.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:59.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:59.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:58 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:59.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:59.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:59.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:59.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:59.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:58 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:59.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:59.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:59.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:59.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:59.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:58 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:59.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:58 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:59.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:58 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:59.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:58 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:59.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:59.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:59.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:59.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:59.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-06-18T02:12:59.301 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:59.301 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:59.301 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:59.301 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:59.301 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:59.301 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:59.301 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:59.301 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[113333]: pgmap v158: 161 pgs: 161 active+clean; 585 KiB data, 128 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s; 86 B/s, 0 objects/s recovering 2024-06-18T02:12:59.301 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:59.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:59.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:59.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:59.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:59.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:59.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:59.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:59.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:59.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:59.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:59.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:59.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:59.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:59.303 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:59.303 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:59.303 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:59.303 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:59.303 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:59.303 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:59.303 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:59.303 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:59.303 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:59.303 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:59.303 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:59.304 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:59.304 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:59.304 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:59.304 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:59.304 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[99735]: pgmap v158: 161 pgs: 161 active+clean; 585 KiB data, 128 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s; 86 B/s, 0 objects/s recovering 2024-06-18T02:12:59.304 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:59.304 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:59.304 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:59.304 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:59.304 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:59.304 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:59.304 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:12:59.304 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:59.304 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:59.305 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:59.305 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:59.305 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:59.305 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:59.305 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:59.305 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:59.305 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:59.305 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:59.305 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:59.305 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:59.305 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:59.305 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:59.305 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:59.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:59.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:59.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:59.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:59.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:59.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:59.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:59.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:59.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:59.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:59.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:59.307 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:59.307 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:59.307 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:59.307 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:59.307 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:59.307 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:59.307 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-06-18T02:12:59.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:59.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:59.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:59.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:59.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:59.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:59.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:59.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:12:59.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:12:59.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:59.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:59.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:59.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:12:59.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:12:59.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:59.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:59.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:12:59.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-06-18T02:13:00.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:59 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:00.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:59 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:00.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:59 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:00.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:59 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:00.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:59 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:00.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:59 smithi007 ceph-mon[113333]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-06-18T02:13:00.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:12:59 smithi007 ceph-mon[113333]: Upgrade: osd.1 is safe to restart 2024-06-18T02:13:00.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:59 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:00.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:59 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:00.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:59 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:00.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:59 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:00.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:59 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:00.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:59 smithi007 ceph-mon[99735]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-06-18T02:13:00.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:12:59 smithi007 ceph-mon[99735]: Upgrade: osd.1 is safe to restart 2024-06-18T02:13:00.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:59 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:00.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:59 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:00.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:59 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:00.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:59 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:00.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:59 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:00.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:59 smithi130 ceph-mon[84407]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-06-18T02:13:00.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:12:59 smithi130 ceph-mon[84407]: Upgrade: osd.1 is safe to restart 2024-06-18T02:13:01.226 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:00 smithi007 ceph-mon[113333]: pgmap v159: 161 pgs: 161 active+clean; 585 KiB data, 128 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 75 B/s, 0 objects/s recovering 2024-06-18T02:13:01.227 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:00 smithi007 ceph-mon[99735]: pgmap v159: 161 pgs: 161 active+clean; 585 KiB data, 128 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 75 B/s, 0 objects/s recovering 2024-06-18T02:13:01.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:00 smithi130 ceph-mon[84407]: pgmap v159: 161 pgs: 161 active+clean; 585 KiB data, 128 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 75 B/s, 0 objects/s recovering 2024-06-18T02:13:02.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:02 smithi007 ceph-mon[113333]: Upgrade: Updating osd.1 2024-06-18T02:13:02.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:02 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:02.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-06-18T02:13:02.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:02.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:02 smithi007 ceph-mon[113333]: Deploying daemon osd.1 on smithi007 2024-06-18T02:13:02.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:02 smithi007 ceph-mon[99735]: Upgrade: Updating osd.1 2024-06-18T02:13:02.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:02 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:02.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-06-18T02:13:02.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:02.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:02 smithi007 ceph-mon[99735]: Deploying daemon osd.1 on smithi007 2024-06-18T02:13:02.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:02 smithi130 ceph-mon[84407]: Upgrade: Updating osd.1 2024-06-18T02:13:02.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:02 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:02.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-06-18T02:13:02.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:02.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:02 smithi130 ceph-mon[84407]: Deploying daemon osd.1 on smithi007 2024-06-18T02:13:03.386 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:03 smithi007 ceph-mon[113333]: pgmap v160: 161 pgs: 161 active+clean; 585 KiB data, 128 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s; 60 B/s, 0 objects/s recovering 2024-06-18T02:13:03.386 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:03 smithi007 ceph-mon[113333]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:13:03.386 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:03 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:03.386 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:03 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:03.386 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:03 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:03.387 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:03 smithi007 ceph-mon[99735]: pgmap v160: 161 pgs: 161 active+clean; 585 KiB data, 128 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s; 60 B/s, 0 objects/s recovering 2024-06-18T02:13:03.387 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:03 smithi007 ceph-mon[99735]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:13:03.387 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:03 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:03.387 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:03 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:03.387 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:03 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:03.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:03 smithi130 ceph-mon[84407]: pgmap v160: 161 pgs: 161 active+clean; 585 KiB data, 128 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s; 60 B/s, 0 objects/s recovering 2024-06-18T02:13:03.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:03 smithi130 ceph-mon[84407]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:13:03.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:03 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:03.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:03 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:03.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:03 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:05.171 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:05 smithi007 ceph-mon[113333]: pgmap v161: 161 pgs: 161 active+clean; 585 KiB data, 128 MiB used, 715 GiB / 715 GiB avail; 839 B/s rd, 0 op/s; 54 B/s, 0 objects/s recovering 2024-06-18T02:13:05.172 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:05 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:05.172 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:05 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:05.172 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:05 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:05.172 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:05 smithi007 ceph-mon[99735]: pgmap v161: 161 pgs: 161 active+clean; 585 KiB data, 128 MiB used, 715 GiB / 715 GiB avail; 839 B/s rd, 0 op/s; 54 B/s, 0 objects/s recovering 2024-06-18T02:13:05.172 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:05 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:05.172 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:05 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:05.172 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:05 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:05.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:05 smithi130 ceph-mon[84407]: pgmap v161: 161 pgs: 161 active+clean; 585 KiB data, 128 MiB used, 715 GiB / 715 GiB avail; 839 B/s rd, 0 op/s; 54 B/s, 0 objects/s recovering 2024-06-18T02:13:05.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:05 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:05.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:05 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:05.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:05 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:06.359 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:06 smithi007 systemd[1]: Stopping Ceph osd.1 for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:13:06.682 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:06 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1[35976]: 2024-06-18T02:13:06.359+0000 7f1b7292f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-18T02:13:06.682 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:06 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1[35976]: 2024-06-18T02:13:06.359+0000 7f1b7292f700 -1 osd.1 128 *** Got signal Terminated *** 2024-06-18T02:13:06.682 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:06 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1[35976]: 2024-06-18T02:13:06.359+0000 7f1b7292f700 -1 osd.1 128 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-18T02:13:07.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:07 smithi130 ceph-mon[84407]: pgmap v162: 161 pgs: 161 active+clean; 585 KiB data, 128 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s; 50 B/s, 0 objects/s recovering 2024-06-18T02:13:07.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:07 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:07.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:07 smithi130 ceph-mon[84407]: osd.1 marked itself down and dead 2024-06-18T02:13:07.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:07 smithi007 ceph-mon[113333]: pgmap v162: 161 pgs: 161 active+clean; 585 KiB data, 128 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s; 50 B/s, 0 objects/s recovering 2024-06-18T02:13:07.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:07 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:07.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:07 smithi007 ceph-mon[113333]: osd.1 marked itself down and dead 2024-06-18T02:13:07.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:07 smithi007 ceph-mon[99735]: pgmap v162: 161 pgs: 161 active+clean; 585 KiB data, 128 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s; 50 B/s, 0 objects/s recovering 2024-06-18T02:13:07.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:07 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:07.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:07 smithi007 ceph-mon[99735]: osd.1 marked itself down and dead 2024-06-18T02:13:07.904 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:07 smithi007 podman[129793]: 2024-06-18 02:13:07.616796806 +0000 UTC m=+1.382661037 container died a967706523cbba7b1ff59c924ae97970e99babb8a2053fd9e018a082c58f481b (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1, io.k8s.display-name=CentOS Stream 8, ceph=True, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, maintainer=Guillaume Abrioux , name=centos-stream, io.openshift.tags=base centos centos-stream, version=8, GIT_REPO=https://github.com/ceph/ceph-container.git, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, vcs-type=git, io.openshift.expose-services=, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., RELEASE=HEAD, io.buildah.version=1.19.8, CEPH_POINT_RELEASE=-17.2.0, architecture=x86_64, com.redhat.component=centos-stream-container, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_BRANCH=HEAD, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, release=754, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, build-date=2022-05-03T08:36:31.336870, vendor=Red Hat, Inc., distribution-scope=public, GIT_CLEAN=True) 2024-06-18T02:13:08.164 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:08 smithi007 ceph-mon[113333]: Health check failed: 1 osds down (OSD_DOWN) 2024-06-18T02:13:08.164 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:08 smithi007 ceph-mon[113333]: osdmap e129: 8 total, 7 up, 8 in 2024-06-18T02:13:08.164 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:08 smithi007 ceph-mon[99735]: Health check failed: 1 osds down (OSD_DOWN) 2024-06-18T02:13:08.164 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:08 smithi007 ceph-mon[99735]: osdmap e129: 8 total, 7 up, 8 in 2024-06-18T02:13:08.165 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:07 smithi007 podman[129793]: 2024-06-18 02:13:07.905732656 +0000 UTC m=+1.671596886 container cleanup a967706523cbba7b1ff59c924ae97970e99babb8a2053fd9e018a082c58f481b (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1, version=8, io.k8s.display-name=CentOS Stream 8, maintainer=Guillaume Abrioux , com.redhat.license_terms=https://centos.org/legal/licensing-policy/, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, build-date=2022-05-03T08:36:31.336870, io.openshift.expose-services=, com.redhat.component=centos-stream-container, release=754, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, vendor=Red Hat, Inc., distribution-scope=public, GIT_REPO=https://github.com/ceph/ceph-container.git, vcs-type=git, architecture=x86_64, ceph=True, io.openshift.tags=base centos centos-stream, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_BRANCH=HEAD, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, RELEASE=HEAD, CEPH_POINT_RELEASE=-17.2.0, name=centos-stream, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.buildah.version=1.19.8, GIT_CLEAN=True, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream) 2024-06-18T02:13:08.165 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:07 smithi007 bash[129793]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1 2024-06-18T02:13:08.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:08 smithi130 ceph-mon[84407]: Health check failed: 1 osds down (OSD_DOWN) 2024-06-18T02:13:08.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:08 smithi130 ceph-mon[84407]: osdmap e129: 8 total, 7 up, 8 in 2024-06-18T02:13:08.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:13:07 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:13:07] "GET /metrics HTTP/1.1" 200 38405 "" "Prometheus/2.33.4" 2024-06-18T02:13:08.431 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:08 smithi007 podman[129811]: 2024-06-18 02:13:08.16546407 +0000 UTC m=+0.551155153 container remove a967706523cbba7b1ff59c924ae97970e99babb8a2053fd9e018a082c58f481b (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1, vcs-type=git, name=centos-stream, io.k8s.display-name=CentOS Stream 8, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.component=centos-stream-container, io.buildah.version=1.19.8, ceph=True, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, GIT_BRANCH=HEAD, build-date=2022-05-03T08:36:31.336870, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.openshift.tags=base centos centos-stream, vendor=Red Hat, Inc., CEPH_POINT_RELEASE=-17.2.0, maintainer=Guillaume Abrioux , RELEASE=HEAD, distribution-scope=public, version=8, release=754, GIT_REPO=https://github.com/ceph/ceph-container.git, architecture=x86_64, GIT_CLEAN=True, io.openshift.expose-services=, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb) 2024-06-18T02:13:08.826 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:08 smithi007 podman[129902]: 2024-06-18 02:13:08.418504261 +0000 UTC m=+0.017620413 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:13:08.827 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:08 smithi007 podman[129902]: 2024-06-18 02:13:08.524945914 +0000 UTC m=+0.124062107 container create d2880255334a47cd30afd5a32b507acd38cab0ac7893afa3df0fb5a14617f806 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240612, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3781e3a, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0) 2024-06-18T02:13:08.827 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:08 smithi007 podman[129902]: 2024-06-18 02:13:08.735833083 +0000 UTC m=+0.334949235 container init d2880255334a47cd30afd5a32b507acd38cab0ac7893afa3df0fb5a14617f806 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240612, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, io.buildah.version=1.36.0, RELEASE=squid-3781e3a, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-06-18T02:13:08.827 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:08 smithi007 podman[129902]: 2024-06-18 02:13:08.739824777 +0000 UTC m=+0.338940932 container start d2880255334a47cd30afd5a32b507acd38cab0ac7893afa3df0fb5a14617f806 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, RELEASE=squid-3781e3a, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240612, io.buildah.version=1.36.0) 2024-06-18T02:13:08.827 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:08 smithi007 podman[129902]: 2024-06-18 02:13:08.827551168 +0000 UTC m=+0.426667356 container attach d2880255334a47cd30afd5a32b507acd38cab0ac7893afa3df0fb5a14617f806 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240612, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-3781e3a, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.36.0) 2024-06-18T02:13:09.094 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:09 smithi007 ceph-mon[113333]: pgmap v164: 161 pgs: 19 stale+active+clean, 142 active+clean; 585 KiB data, 128 MiB used, 715 GiB / 715 GiB avail; 921 B/s rd, 0 op/s 2024-06-18T02:13:09.095 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:09 smithi007 ceph-mon[113333]: osdmap e130: 8 total, 7 up, 8 in 2024-06-18T02:13:09.095 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:09 smithi007 ceph-mon[99735]: pgmap v164: 161 pgs: 19 stale+active+clean, 142 active+clean; 585 KiB data, 128 MiB used, 715 GiB / 715 GiB avail; 921 B/s rd, 0 op/s 2024-06-18T02:13:09.095 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:09 smithi007 ceph-mon[99735]: osdmap e130: 8 total, 7 up, 8 in 2024-06-18T02:13:09.095 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:09 smithi007 podman[129902]: 2024-06-18 02:13:09.054267505 +0000 UTC m=+0.653383663 container died d2880255334a47cd30afd5a32b507acd38cab0ac7893afa3df0fb5a14617f806 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, RELEASE=squid-3781e3a, io.buildah.version=1.36.0, org.label-schema.build-date=20240612, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-06-18T02:13:09.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:09 smithi130 ceph-mon[84407]: pgmap v164: 161 pgs: 19 stale+active+clean, 142 active+clean; 585 KiB data, 128 MiB used, 715 GiB / 715 GiB avail; 921 B/s rd, 0 op/s 2024-06-18T02:13:09.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:09 smithi130 ceph-mon[84407]: osdmap e130: 8 total, 7 up, 8 in 2024-06-18T02:13:09.932 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:09 smithi007 podman[129928]: 2024-06-18 02:13:09.656556278 +0000 UTC m=+0.596252576 container remove d2880255334a47cd30afd5a32b507acd38cab0ac7893afa3df0fb5a14617f806 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-3781e3a, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240612, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-06-18T02:13:09.932 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:09 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.1.service: Deactivated successfully. 2024-06-18T02:13:09.932 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:09 smithi007 systemd[1]: Stopped Ceph osd.1 for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:13:09.932 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:09 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.1.service: Consumed 10.441s CPU time. 2024-06-18T02:13:09.932 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:09 smithi007 systemd[1]: Starting Ceph osd.1 for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:13:10.368 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:10 smithi007 podman[130038]: 2024-06-18 02:13:10.006009294 +0000 UTC m=+0.018007662 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:13:10.368 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:10 smithi007 podman[130038]: 2024-06-18 02:13:10.116212782 +0000 UTC m=+0.128211146 container create b898c0a8dfefea36397134e344dbeed8ee1435a942cf061eda0e3c6a866c9d62 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1-activate, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-3781e3a, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240612, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-18T02:13:10.681 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:10 smithi007 podman[130038]: 2024-06-18 02:13:10.369306548 +0000 UTC m=+0.381304922 container init b898c0a8dfefea36397134e344dbeed8ee1435a942cf061eda0e3c6a866c9d62 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1-activate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240612, RELEASE=squid-3781e3a, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47) 2024-06-18T02:13:10.682 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:10 smithi007 podman[130038]: 2024-06-18 02:13:10.373113755 +0000 UTC m=+0.385112128 container start b898c0a8dfefea36397134e344dbeed8ee1435a942cf061eda0e3c6a866c9d62 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1-activate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240612, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, RELEASE=squid-3781e3a, org.label-schema.vendor=CentOS) 2024-06-18T02:13:10.682 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:10 smithi007 podman[130038]: 2024-06-18 02:13:10.443762094 +0000 UTC m=+0.455760470 container attach b898c0a8dfefea36397134e344dbeed8ee1435a942cf061eda0e3c6a866c9d62 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1-activate, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-3781e3a, ceph=True, org.label-schema.build-date=20240612, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-06-18T02:13:10.989 INFO:teuthology.orchestra.run.smithi007.stdout:true 2024-06-18T02:13:11.031 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:10 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1-activate[130053]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-06-18T02:13:11.032 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:10 smithi007 bash[130038]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-06-18T02:13:11.032 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:10 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1-activate[130053]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-06-18T02:13:11.032 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:10 smithi007 bash[130038]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-06-18T02:13:11.032 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:10 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1-activate[130053]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-06-18T02:13:11.032 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:10 smithi007 bash[130038]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-06-18T02:13:11.032 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:10 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1-activate[130053]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-06-18T02:13:11.032 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:10 smithi007 bash[130038]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-06-18T02:13:11.032 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:10 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1-activate[130053]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-06-18T02:13:11.032 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:10 smithi007 bash[130038]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-06-18T02:13:11.032 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:10 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1-activate[130053]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-06-18T02:13:11.032 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:10 smithi007 bash[130038]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-06-18T02:13:11.032 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:10 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1-activate[130053]: --> ceph-volume raw activate successful for osd ID: 1 2024-06-18T02:13:11.032 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:10 smithi007 bash[130038]: --> ceph-volume raw activate successful for osd ID: 1 2024-06-18T02:13:11.033 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:10 smithi007 podman[130038]: 2024-06-18 02:13:10.810584139 +0000 UTC m=+0.822582512 container died b898c0a8dfefea36397134e344dbeed8ee1435a942cf061eda0e3c6a866c9d62 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1-activate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-3781e3a, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_CLEAN=True, org.label-schema.build-date=20240612, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-06-18T02:13:11.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:11 smithi130 ceph-mon[84407]: pgmap v166: 161 pgs: 19 stale+active+clean, 142 active+clean; 585 KiB data, 128 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-06-18T02:13:11.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:11 smithi007 ceph-mon[113333]: pgmap v166: 161 pgs: 19 stale+active+clean, 142 active+clean; 585 KiB data, 128 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-06-18T02:13:11.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:11 smithi007 ceph-mon[99735]: pgmap v166: 161 pgs: 19 stale+active+clean, 142 active+clean; 585 KiB data, 128 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-06-18T02:13:11.688 INFO:teuthology.orchestra.run.smithi007.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-18T02:13:11.688 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi007 smithi007 running 7s ago 16m - - 2024-06-18T02:13:11.688 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi130 smithi130 running 18s ago 16m - - 2024-06-18T02:13:11.688 INFO:teuthology.orchestra.run.smithi007.stdout:alertmanager.a smithi007 *:9093,9094 running (6m) 7s ago 11m 23.0M - 0.23.0 ba2b418f427c 5994e8525c64 2024-06-18T02:13:11.688 INFO:teuthology.orchestra.run.smithi007.stdout:grafana.a smithi130 *:3000 running (5m) 18s ago 10m 49.8M - 8.3.5 dad864ee21e9 70ba81d97c8e 2024-06-18T02:13:11.689 INFO:teuthology.orchestra.run.smithi007.stdout:iscsi.foo.smithi007.xvdrwd smithi007 running (4m) 7s ago 9m 54.6M - 3.5 e1d6a67b021e 94121ad2702c 2024-06-18T02:13:11.689 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.x smithi130 *:8443,9283,8765 running (5m) 18s ago 15m 521M - 19.0.0-3124-g3781e3a5 af93c036e016 01017e37bdbe 2024-06-18T02:13:11.689 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.y smithi007 *:8443,9283,8765 running (3m) 7s ago 17m 442M - 19.0.0-3124-g3781e3a5 af93c036e016 2141e131e896 2024-06-18T02:13:11.689 INFO:teuthology.orchestra.run.smithi007.stdout:mon.a smithi007 running (77s) 7s ago 17m 44.7M 2048M 19.0.0-3124-g3781e3a5 af93c036e016 7bbe646cd5b7 2024-06-18T02:13:11.689 INFO:teuthology.orchestra.run.smithi007.stdout:mon.b smithi130 running (2m) 18s ago 15m 44.0M 2048M 19.0.0-3124-g3781e3a5 af93c036e016 baacf2add994 2024-06-18T02:13:11.689 INFO:teuthology.orchestra.run.smithi007.stdout:mon.c smithi007 running (2m) 7s ago 16m 48.4M 2048M 19.0.0-3124-g3781e3a5 af93c036e016 39418356156e 2024-06-18T02:13:11.689 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.a smithi007 *:9100 running (6m) 7s ago 11m 17.4M - 1.3.1 1dbe0e931976 8128e558f099 2024-06-18T02:13:11.689 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.b smithi130 *:9100 running (5m) 18s ago 11m 16.4M - 1.3.1 1dbe0e931976 bab93b43cf16 2024-06-18T02:13:11.689 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0 smithi007 running (26s) 7s ago 15m 41.6M 4096M 19.0.0-3124-g3781e3a5 af93c036e016 07c7f4afd49a 2024-06-18T02:13:11.689 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1 smithi007 running (14m) 7s ago 14m 59.0M 4096M 17.2.0 e1d6a67b021e a967706523cb 2024-06-18T02:13:11.689 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2 smithi007 running (14m) 7s ago 14m 53.7M 4096M 17.2.0 e1d6a67b021e 2c1b76bd0876 2024-06-18T02:13:11.689 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3 smithi007 running (14m) 7s ago 14m 58.3M 4096M 17.2.0 e1d6a67b021e 8b91b2a07564 2024-06-18T02:13:11.689 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4 smithi130 running (13m) 18s ago 13m 58.9M 4096M 17.2.0 e1d6a67b021e c428dccffdf0 2024-06-18T02:13:11.690 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5 smithi130 running (13m) 18s ago 13m 57.8M 4096M 17.2.0 e1d6a67b021e f645d7f12378 2024-06-18T02:13:11.690 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6 smithi130 running (12m) 18s ago 12m 51.8M 4096M 17.2.0 e1d6a67b021e c7af86c14959 2024-06-18T02:13:11.690 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7 smithi130 running (12m) 18s ago 12m 56.5M 4096M 17.2.0 e1d6a67b021e 3688af8b2c46 2024-06-18T02:13:11.690 INFO:teuthology.orchestra.run.smithi007.stdout:prometheus.a smithi130 *:9095 running (4m) 18s ago 11m 75.8M - 2.33.4 514e6a882f6e e905fb2eb4a6 2024-06-18T02:13:11.690 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi007.dvbvbk smithi007 *:8000 running (10m) 7s ago 10m 77.1M - 17.2.0 e1d6a67b021e 1344b55b763c 2024-06-18T02:13:11.690 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi130.aakmof smithi130 *:8000 running (10m) 18s ago 10m 74.6M - 17.2.0 e1d6a67b021e e257e3230c6c 2024-06-18T02:13:11.690 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi007.hgrnmk smithi007 *:80 running (9m) 7s ago 9m 75.3M - 17.2.0 e1d6a67b021e 2173947bc4d6 2024-06-18T02:13:11.690 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi130.wwebfk smithi130 *:80 running (9m) 18s ago 9m 76.6M - 17.2.0 e1d6a67b021e 8662706b2231 2024-06-18T02:13:11.827 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:11 smithi007 podman[130198]: 2024-06-18 02:13:11.556852097 +0000 UTC m=+0.740475993 container remove b898c0a8dfefea36397134e344dbeed8ee1435a942cf061eda0e3c6a866c9d62 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1-activate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3781e3a, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240612) 2024-06-18T02:13:11.828 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:11 smithi007 podman[130305]: 2024-06-18 02:13:11.681316314 +0000 UTC m=+0.020210648 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:13:11.828 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:11 smithi007 podman[130305]: 2024-06-18 02:13:11.79128779 +0000 UTC m=+0.130182112 container create 856168a0b321688ef98e094c7fdd2f49efb4db811cc96d82753094e534e6ea13 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1, org.label-schema.build-date=20240612, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-3781e3a) 2024-06-18T02:13:12.129 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:12 smithi007 ceph-mon[113333]: from='client.54229 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:13:12.130 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:12 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:12.130 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:13:12.130 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:12 smithi007 ceph-mon[99735]: from='client.54229 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:13:12.130 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:12 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:12.130 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:13:12.130 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:12 smithi007 podman[130305]: 2024-06-18 02:13:12.035876581 +0000 UTC m=+0.374770918 container init 856168a0b321688ef98e094c7fdd2f49efb4db811cc96d82753094e534e6ea13 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1, org.label-schema.vendor=CentOS, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240612, RELEASE=squid-3781e3a) 2024-06-18T02:13:12.131 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:12 smithi007 podman[130305]: 2024-06-18 02:13:12.040807472 +0000 UTC m=+0.379701796 container start 856168a0b321688ef98e094c7fdd2f49efb4db811cc96d82753094e534e6ea13 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240612, RELEASE=squid-3781e3a, org.label-schema.schema-version=1.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.36.0, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-06-18T02:13:12.131 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:12 smithi007 ceph-osd[130347]: -- 172.21.15.7:0/1303354139 <== mon.0 v2:172.21.15.7:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f365883a40 con 0x55f366642000 2024-06-18T02:13:12.131 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:13:12.131 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": { 2024-06-18T02:13:12.131 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 3 2024-06-18T02:13:12.131 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:13:12.131 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": { 2024-06-18T02:13:12.131 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 2 2024-06-18T02:13:12.131 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:13:12.132 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": { 2024-06-18T02:13:12.132 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 6, 2024-06-18T02:13:12.132 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 1 2024-06-18T02:13:12.132 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:13:12.132 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw": { 2024-06-18T02:13:12.132 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-06-18T02:13:12.132 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:13:12.132 INFO:teuthology.orchestra.run.smithi007.stdout: "overall": { 2024-06-18T02:13:12.132 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 10, 2024-06-18T02:13:12.132 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 6 2024-06-18T02:13:12.132 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-06-18T02:13:12.132 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:13:12.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:12 smithi130 ceph-mon[84407]: from='client.54229 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:13:12.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:12 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:12.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:13:12.411 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:12 smithi007 bash[130305]: 856168a0b321688ef98e094c7fdd2f49efb4db811cc96d82753094e534e6ea13 2024-06-18T02:13:12.411 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:12 smithi007 systemd[1]: Started Ceph osd.1 for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:13:12.518 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:13:12.518 INFO:teuthology.orchestra.run.smithi007.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00", 2024-06-18T02:13:12.518 INFO:teuthology.orchestra.run.smithi007.stdout: "in_progress": true, 2024-06-18T02:13:12.518 INFO:teuthology.orchestra.run.smithi007.stdout: "which": "Upgrading all daemon types on all hosts", 2024-06-18T02:13:12.518 INFO:teuthology.orchestra.run.smithi007.stdout: "services_complete": [ 2024-06-18T02:13:12.518 INFO:teuthology.orchestra.run.smithi007.stdout: "mon", 2024-06-18T02:13:12.518 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr" 2024-06-18T02:13:12.518 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-06-18T02:13:12.518 INFO:teuthology.orchestra.run.smithi007.stdout: "progress": "6/23 daemons upgraded", 2024-06-18T02:13:12.518 INFO:teuthology.orchestra.run.smithi007.stdout: "message": "Currently upgrading osd daemons", 2024-06-18T02:13:12.519 INFO:teuthology.orchestra.run.smithi007.stdout: "is_paused": false 2024-06-18T02:13:12.519 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:13:12.678 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:12 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1[130343]: 2024-06-18T02:13:12.586+0000 7f7540580640 -1 Falling back to public interface 2024-06-18T02:13:12.949 INFO:teuthology.orchestra.run.smithi007.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 6/726 objects degraded (0.826%), 1 pg degraded 2024-06-18T02:13:12.949 INFO:teuthology.orchestra.run.smithi007.stdout:[WRN] OSD_DOWN: 1 osds down 2024-06-18T02:13:12.949 INFO:teuthology.orchestra.run.smithi007.stdout: osd.1 (root=default,host=smithi007) is down 2024-06-18T02:13:12.949 INFO:teuthology.orchestra.run.smithi007.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 6/726 objects degraded (0.826%), 1 pg degraded 2024-06-18T02:13:12.949 INFO:teuthology.orchestra.run.smithi007.stdout: pg 3.6 is active+undersized+degraded, acting [0,4] 2024-06-18T02:13:13.233 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[113333]: from='client.54235 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:13:13.233 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[113333]: from='client.54241 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:13:13.233 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[113333]: pgmap v167: 161 pgs: 6 active+undersized, 18 stale+active+clean, 1 active+undersized+degraded, 136 active+clean; 585 KiB data, 128 MiB used, 715 GiB / 715 GiB avail; 9.6 KiB/s rd, 0 B/s wr, 15 op/s; 6/726 objects degraded (0.826%) 2024-06-18T02:13:13.233 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[113333]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:13:13.233 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[113333]: from='client.? 172.21.15.7:0/2369875283' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:13.233 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:13.233 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:13.233 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[113333]: Health check failed: Degraded data redundancy: 6/726 objects degraded (0.826%), 1 pg degraded (PG_DEGRADED) 2024-06-18T02:13:13.233 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:13.233 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:13.233 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:13.233 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:13.234 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:13.234 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:13.234 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:13.234 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:13.234 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:13.234 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:13.234 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:13.234 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:13.234 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:13.234 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:13.234 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:13.234 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:13.234 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:13.234 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:13.235 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:13.235 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:13.235 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:13.235 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:13.235 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:13.235 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:13.235 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:13.235 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:13.235 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:13.235 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:13.235 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:13.235 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:13.235 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:13.235 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:13.236 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:13.236 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[113333]: from='client.? 172.21.15.7:0/2282246148' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:13:13.236 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[99735]: from='client.54235 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:13:13.236 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[99735]: from='client.54241 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:13:13.236 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[99735]: pgmap v167: 161 pgs: 6 active+undersized, 18 stale+active+clean, 1 active+undersized+degraded, 136 active+clean; 585 KiB data, 128 MiB used, 715 GiB / 715 GiB avail; 9.6 KiB/s rd, 0 B/s wr, 15 op/s; 6/726 objects degraded (0.826%) 2024-06-18T02:13:13.236 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[99735]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:13:13.236 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[99735]: from='client.? 172.21.15.7:0/2369875283' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:13.236 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:13.237 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:13.237 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[99735]: Health check failed: Degraded data redundancy: 6/726 objects degraded (0.826%), 1 pg degraded (PG_DEGRADED) 2024-06-18T02:13:13.237 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:13.237 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:13.237 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:13.237 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:13.237 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:13.237 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:13.237 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:13.237 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:13.237 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:13.237 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:13.237 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:13.237 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:13.238 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:13.238 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:13.238 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:13.238 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:13.238 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:13.238 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:13.238 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:13.238 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:13.238 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:13.238 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:13.238 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:13.238 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:13.238 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:13.239 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:13.239 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:13.239 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:13.239 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:13.239 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:13.239 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:13.239 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:13.239 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:13.239 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:13 smithi007 ceph-mon[99735]: from='client.? 172.21.15.7:0/2282246148' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:13:13.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:13 smithi130 ceph-mon[84407]: from='client.54235 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:13:13.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:13 smithi130 ceph-mon[84407]: from='client.54241 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:13:13.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:13 smithi130 ceph-mon[84407]: pgmap v167: 161 pgs: 6 active+undersized, 18 stale+active+clean, 1 active+undersized+degraded, 136 active+clean; 585 KiB data, 128 MiB used, 715 GiB / 715 GiB avail; 9.6 KiB/s rd, 0 B/s wr, 15 op/s; 6/726 objects degraded (0.826%) 2024-06-18T02:13:13.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:13 smithi130 ceph-mon[84407]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:13:13.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:13 smithi130 ceph-mon[84407]: from='client.? 172.21.15.7:0/2369875283' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:13.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:13 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:13.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:13 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:13.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:13 smithi130 ceph-mon[84407]: Health check failed: Degraded data redundancy: 6/726 objects degraded (0.826%), 1 pg degraded (PG_DEGRADED) 2024-06-18T02:13:13.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:13.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:13.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:13 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:13.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:13.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:13.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:13.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:13.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:13 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:13.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:13.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:13.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:13.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:13.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:13 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:13.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:13.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:13.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:13.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:13.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:13 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:13.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:13.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:13.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:13.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:13.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:13 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:13.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:13.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:13.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:13.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:13.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:13 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:13.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:13.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:13.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:13.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:13.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:13 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:13.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:13 smithi130 ceph-mon[84407]: from='client.? 172.21.15.7:0/2282246148' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:13:14.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:14 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:14.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:14 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:14.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:14 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:14.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:14 smithi130 ceph-mon[84407]: from='client.54256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:13:14.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:14 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:14.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:14 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:14.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:14 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:14.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:14 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:14.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:14.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:14.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:14.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:14.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:14 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:14.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:14 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:14.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:14 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:14.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:14 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:14.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:14 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:14.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:14.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:14.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:14.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:14.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:14 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:14.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:14.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:14.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:14.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:14.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:14 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:14.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:14.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:14.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:14.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:14.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:14 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:14.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:14.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:14.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:14.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:14.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:14 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:14.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:14.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:14.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:14.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:14.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:14 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:14.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:14.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:14.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:14.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:14.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:14 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:14.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:14.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:14.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:14.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:14.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:14 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:14.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:14.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:14.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:14.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:14.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:14 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:14.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:14.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:14.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:14.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[113333]: from='client.54256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:13:14.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:14.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:14.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:14.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:14.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:14.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:14.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:14.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:14.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:14.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:14.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:14.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:14.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:14.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:14.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:14.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:14.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:14.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:14.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:14.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:14.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:14.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:14.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:14.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:14.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:14.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:14.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:14.306 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:14.306 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:14.306 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:14.306 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[99735]: from='client.54256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:13:14.306 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:14.306 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:14.306 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:14.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:14.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:14.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:14.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:14.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:14.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:14.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:14.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:14.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:14.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:14.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:14.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:14.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:14.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:14.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:14.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:14.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:14.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:14.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:14.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:14.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:14.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:14.309 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:14.309 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:14.309 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:14.309 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:14.309 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:14.309 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:14.309 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:14.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:14.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:14.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:14.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:14.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:14.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:14.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:14.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:14.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:14.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:14.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:14.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:14.311 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:14.311 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:14.311 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:14.311 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:14.311 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:14.311 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:14.311 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:14.311 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:14.311 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:14.311 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:14.311 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:14.311 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:14.312 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:14.312 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:14.312 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:14.312 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:14.312 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:14.312 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:14.312 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:14.312 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:14.312 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:14.312 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:14.312 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:14.312 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:14.312 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:14.312 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:14.313 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:14.313 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:14.313 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:14.313 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:14.313 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:14.313 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:14.313 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:14.313 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:14.313 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:14 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:15.278 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:15.278 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:15.278 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:15.278 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:15.278 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:15.278 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:15.279 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:15.279 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[113333]: pgmap v168: 161 pgs: 41 active+undersized, 22 active+undersized+degraded, 98 active+clean; 585 KiB data, 134 MiB used, 715 GiB / 715 GiB avail; 77 KiB/s rd, 0 B/s wr, 132 op/s; 102/726 objects degraded (14.050%) 2024-06-18T02:13:15.279 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:15.279 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:15.279 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:15.279 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:15.279 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:15.279 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:15.279 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:15.279 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:15.279 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:15.279 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:15.279 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:15.280 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:15.280 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:15.280 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:15.280 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:15.280 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:15.280 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:15.280 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:15.280 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:15.280 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:15.280 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:15.280 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:15.281 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:15.281 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:15.281 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:15.281 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:15.281 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:15.281 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:15.281 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[99735]: pgmap v168: 161 pgs: 41 active+undersized, 22 active+undersized+degraded, 98 active+clean; 585 KiB data, 134 MiB used, 715 GiB / 715 GiB avail; 77 KiB/s rd, 0 B/s wr, 132 op/s; 102/726 objects degraded (14.050%) 2024-06-18T02:13:15.281 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:15.281 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:15.281 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:15.281 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:15.281 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:15.281 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:15.282 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:15.282 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:15.282 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:15.282 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:15.282 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:15.282 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:15.282 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:15.282 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:15.282 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:15.282 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:15.282 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:15.282 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:15.282 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:15.283 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:15.283 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:15.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:15.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:15.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:15.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:15.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:15.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:15.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:15.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:15.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:15.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:15.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:15.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:15.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:15.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:15.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:15.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:15.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:15.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:15.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:15.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:15.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:15.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:15.285 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:15.285 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:15.285 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:15.285 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:15.285 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:15.285 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:15.285 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:15.285 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:15.285 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:15.285 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:15.285 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:15.285 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:15.286 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:15.286 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:15.286 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:15.286 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:15.286 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:15.286 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:15.286 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:15.286 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:15.286 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:15.286 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:15.286 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:15.286 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:15.286 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:15.287 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:15.287 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:15.287 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:15.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:15 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:15.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:15 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:15.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:15 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:15.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:15 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:15.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:15 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:15.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:15 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:15.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:15 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:15.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:15 smithi130 ceph-mon[84407]: pgmap v168: 161 pgs: 41 active+undersized, 22 active+undersized+degraded, 98 active+clean; 585 KiB data, 134 MiB used, 715 GiB / 715 GiB avail; 77 KiB/s rd, 0 B/s wr, 132 op/s; 102/726 objects degraded (14.050%) 2024-06-18T02:13:15.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:15 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:15.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:15.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:15.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:15.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:15.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:15 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:15.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:15.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:15.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:15.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:15.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:15 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:15.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:15.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:15.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:15.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:15.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:15 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:15.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:15.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:15.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:15.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:15.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:15 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:15.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:15.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:15.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:15.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:15.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:15 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:15.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:15.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:15.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:15.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:15.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:15 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:15.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:15.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:15.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:15.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:15.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:15 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:15.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:15.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:15.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:15.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:15.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:15 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:15.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:15.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:15.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:15.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:15.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:15 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:15.682 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1[130343]: 2024-06-18T02:13:15.338+0000 7f7540580640 -1 osd.1 0 read_superblock omap replica is missing. 2024-06-18T02:13:15.682 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:15 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1[130343]: 2024-06-18T02:13:15.364+0000 7f7540580640 -1 osd.1 128 log_to_monitors true 2024-06-18T02:13:16.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:16 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:16.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:16 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:16.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:16 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:16.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:16 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:16.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:16 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:16.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:16 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:16.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:16 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:16.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:16 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:16.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:16 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:16.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:16 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:16.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:16 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:16.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:16 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:16.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:16 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:16.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:16 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:16.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:16 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:16.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:16 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:16.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:16 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:16.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:16 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:16.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:16 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:16.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:16 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:16.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:16 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:16.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:16 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:16.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:16 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:16.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:16 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:16.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:16 smithi130 ceph-mon[84407]: from='osd.1 [v2:172.21.15.7:6808/3960148552,v1:172.21.15.7:6809/3960148552]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-18T02:13:16.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:16 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:16.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:16 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:16.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:16 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:16.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:16 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:16.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:16 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:16.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:16 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:16.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:16 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:16.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:16 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:16.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:16 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:16.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:16 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:16.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:16 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:16.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:16 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:16.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:16 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:16.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:16 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:16.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:16 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:16.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:16 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:16.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:16 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:16.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:16 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:16.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:16 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:16.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:16 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:16.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:16 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:16.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:16 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:16.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:16 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:16.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:16 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:16.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:16 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:16.375 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:16.375 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:16.375 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:16.375 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:16.375 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:16.375 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:16.375 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:16.376 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:16.376 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:16.376 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:16.376 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:16.376 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:16.376 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:16.376 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:16.376 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:16.376 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:16.376 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:16.377 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:16.377 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:16.377 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:16.377 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:16.377 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:16.377 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:16.377 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:16.377 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[99735]: from='osd.1 [v2:172.21.15.7:6808/3960148552,v1:172.21.15.7:6809/3960148552]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-18T02:13:16.377 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:16.377 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:16.377 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:16.377 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:16.378 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:16.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:16.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:16.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:16.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:16.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:16.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:16.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:16.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:16.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:16.379 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:16.379 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:16.379 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:16.379 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:16.379 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:16.379 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:16.379 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:16.379 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:16.379 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:16.379 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:16.379 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:16.379 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:16.379 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:16.379 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:16.380 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:16.380 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[113333]: from='osd.1 [v2:172.21.15.7:6808/3960148552,v1:172.21.15.7:6809/3960148552]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-18T02:13:16.380 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:16.380 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:16.380 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:16.380 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:16.380 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:16.380 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:16.380 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:16.381 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:16.381 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:16.381 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:16.381 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:16.381 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:16.381 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:16.381 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:16.381 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:16.381 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:16.381 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:16.381 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:16.382 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:16.382 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:16.382 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:16.382 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:16.382 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:16.382 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:16.382 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:16.382 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:16.382 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:16.382 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:16.382 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:16.383 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:16.383 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:16.383 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:16.383 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:16.383 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:16.383 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:16.383 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:16.383 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:16.383 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:16.383 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:16.383 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:16.383 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:16.383 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:16.383 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:16.383 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:16.384 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:16.931 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:16 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1[130343]: 2024-06-18T02:13:16.660+0000 7f7534323640 -1 osd.1 128 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-18T02:13:17.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:17.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:17.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:17.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:17.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:17.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:17.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:17.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: pgmap v169: 161 pgs: 41 active+undersized, 22 active+undersized+degraded, 98 active+clean; 585 KiB data, 134 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 0 B/s wr, 135 op/s; 102/726 objects degraded (14.050%) 2024-06-18T02:13:17.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:17.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:17.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:17.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:17.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:17.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:17.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:17.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:17.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:17.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:17.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:17.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:17.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:17.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:17.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:17.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:17.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:17.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: from='osd.1 [v2:172.21.15.7:6808/3960148552,v1:172.21.15.7:6809/3960148552]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-06-18T02:13:17.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: osdmap e131: 8 total, 7 up, 8 in 2024-06-18T02:13:17.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: from='osd.1 [v2:172.21.15.7:6808/3960148552,v1:172.21.15.7:6809/3960148552]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-06-18T02:13:17.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:17.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:17.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:17.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:17.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:17.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:17.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:17.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:17.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:17.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:17.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: from='osd.1 [v2:172.21.15.7:6808/3960148552,v1:172.21.15.7:6809/3960148552]' entity='osd.1' 2024-06-18T02:13:17.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:17.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:17.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:17.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:17.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:17.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:17.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:17.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:17.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:17.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:17.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:17.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:17.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:17.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:17.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:17.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:17.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:17.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:17.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:17.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:17.430 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:17.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:17.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:17.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:17.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:17.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:17.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:17.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: pgmap v169: 161 pgs: 41 active+undersized, 22 active+undersized+degraded, 98 active+clean; 585 KiB data, 134 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 0 B/s wr, 135 op/s; 102/726 objects degraded (14.050%) 2024-06-18T02:13:17.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:17.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:17.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:17.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:17.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:17.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:17.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:17.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:17.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:17.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:17.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:17.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:17.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:17.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:17.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:17.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:17.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:17.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: from='osd.1 [v2:172.21.15.7:6808/3960148552,v1:172.21.15.7:6809/3960148552]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-06-18T02:13:17.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: osdmap e131: 8 total, 7 up, 8 in 2024-06-18T02:13:17.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: from='osd.1 [v2:172.21.15.7:6808/3960148552,v1:172.21.15.7:6809/3960148552]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-06-18T02:13:17.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:17.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:17.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:17.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:17.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:17.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:17.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:17.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:17.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: pgmap v169: 161 pgs: 41 active+undersized, 22 active+undersized+degraded, 98 active+clean; 585 KiB data, 134 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 0 B/s wr, 135 op/s; 102/726 objects degraded (14.050%) 2024-06-18T02:13:17.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:17.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:17.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:17.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:17.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:17.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:17.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:17.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:17.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:17.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:17.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:17.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:17.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:17.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:17.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:17.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:17.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:17.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: from='osd.1 [v2:172.21.15.7:6808/3960148552,v1:172.21.15.7:6809/3960148552]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-06-18T02:13:17.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: osdmap e131: 8 total, 7 up, 8 in 2024-06-18T02:13:17.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: from='osd.1 [v2:172.21.15.7:6808/3960148552,v1:172.21.15.7:6809/3960148552]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-06-18T02:13:17.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:17.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:17.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:17.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:17.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:17.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:17.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:17.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:17.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:17.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:17.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: from='osd.1 [v2:172.21.15.7:6808/3960148552,v1:172.21.15.7:6809/3960148552]' entity='osd.1' 2024-06-18T02:13:17.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:17.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:17.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:17.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:17.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:17.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:17.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:17.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:17.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:17.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:17.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:17.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:17.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:17.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:17.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:17.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:17.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:17.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:17.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:17.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:17.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:17.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:17.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:17.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:17.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:17.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:17.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:17.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:17.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:17.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: from='osd.1 [v2:172.21.15.7:6808/3960148552,v1:172.21.15.7:6809/3960148552]' entity='osd.1' 2024-06-18T02:13:17.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:17.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:17.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:17.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:17.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:17.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:17.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:17.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:17.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:17.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:17.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:17.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:17.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:17.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:17.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:17.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:17.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:17.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:17.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:17.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:17 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:18.194 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:13:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:13:17] "GET /metrics HTTP/1.1" 200 38400 "" "Prometheus/2.33.4" 2024-06-18T02:13:18.197 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:18 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:18.198 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:18 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:18.198 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:18 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:18.198 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:18 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:18.198 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:18 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:18.198 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:18 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:18.198 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:18 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:18.198 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:18 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:18.198 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:18 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:18.198 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:18 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:18.198 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:18 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:18.198 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:18 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:18.198 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:18 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:18.198 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:18 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:18.199 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:18 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:18.199 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:18 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:18.199 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:18 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:18.199 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:18 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:18.199 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:18 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:18.199 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:18 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:18.199 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:18 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:18.199 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:18 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:18.199 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:18 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:18.199 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:18 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:18.199 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:18 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:18.199 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:18 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:18.199 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:18 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:18.199 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:18 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:18.199 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:18 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:18.200 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:18 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:18.200 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:18 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:18.200 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:18 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:18.200 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:18 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:18.200 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:18 smithi130 ceph-mon[84407]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-06-18T02:13:18.200 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:18 smithi130 ceph-mon[84407]: osd.1 [v2:172.21.15.7:6808/3960148552,v1:172.21.15.7:6809/3960148552] boot 2024-06-18T02:13:18.200 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:18 smithi130 ceph-mon[84407]: osdmap e132: 8 total, 8 up, 8 in 2024-06-18T02:13:18.200 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:18 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-18T02:13:18.200 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:18 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:18.200 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:18 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:18.200 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:18 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:18.200 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:18 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:18.200 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:18 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:18.200 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:18 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:18.200 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:18 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:18.200 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:18 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:18.201 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:18 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:18.201 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:18 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:18.201 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:18 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:18.201 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:18 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:18.201 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:18 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:18.201 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:18 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:18.201 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:18 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:18.399 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:18.399 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:18.399 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:18.399 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:18.399 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:18.399 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:18.399 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:18.399 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:18.399 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:18.399 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:18.399 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:18.400 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:18.400 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:18.400 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:18.400 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:18.400 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:18.400 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:18.400 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:18.400 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:18.400 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:18.400 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:18.400 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:18.400 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:18.400 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:18.400 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:18.400 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:18.401 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:18.401 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:18.401 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:18.401 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:18.401 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:18.401 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:18.401 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:18.401 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:18.401 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:18.401 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:18.402 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:18.402 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:18.402 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:18.402 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:18.402 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:18.402 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:18.402 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:18.402 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:18.402 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:18.402 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:18.402 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:18.402 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:18.402 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:18.403 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:18.403 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:18.403 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:18.403 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:18.403 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:18.403 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:18.403 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:18.403 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:18.403 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:18.405 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:18.405 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:18.406 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:18.406 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:18.406 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:18.406 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[113333]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-06-18T02:13:18.406 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[113333]: osd.1 [v2:172.21.15.7:6808/3960148552,v1:172.21.15.7:6809/3960148552] boot 2024-06-18T02:13:18.406 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[113333]: osdmap e132: 8 total, 8 up, 8 in 2024-06-18T02:13:18.406 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-18T02:13:18.406 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:18.406 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:18.406 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:18.406 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:18.406 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:18.407 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:18.407 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:18.407 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:18.407 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:18.407 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:18.407 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:18.407 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:18.407 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:18.407 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:18.407 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:18.407 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:18.407 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:18.408 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:18.408 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[99735]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-06-18T02:13:18.408 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[99735]: osd.1 [v2:172.21.15.7:6808/3960148552,v1:172.21.15.7:6809/3960148552] boot 2024-06-18T02:13:18.408 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[99735]: osdmap e132: 8 total, 8 up, 8 in 2024-06-18T02:13:18.408 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-18T02:13:18.408 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:18.408 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:18.408 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:18.408 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:18.408 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:18.408 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:18.408 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:18.408 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:18.408 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:18.408 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:18.409 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:18.409 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:18.409 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:18.409 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:18.409 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:18 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:19.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:19 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:19.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:19 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:19.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:19 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:19.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:19 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:19.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:19 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:19.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:19 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:19.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:19 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:19.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:19 smithi130 ceph-mon[84407]: pgmap v172: 161 pgs: 41 active+undersized, 22 active+undersized+degraded, 98 active+clean; 585 KiB data, 149 MiB used, 715 GiB / 715 GiB avail; 100 KiB/s rd, 0 B/s wr, 171 op/s; 102/726 objects degraded (14.050%) 2024-06-18T02:13:19.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:19 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:19.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:19 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:19.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:19 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:19.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:19 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:19.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:19 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:19.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:19 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:19.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:19 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:19.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:19 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:19.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:19 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:19.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:19 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:19.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:19 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:19.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:19 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:19.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:19 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:19.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:19 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:19.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:19 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:19.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:19 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:19.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:19 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:19.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:19 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:19.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:19 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:19.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:19 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:19.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:19 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:19.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:19 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:19.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:19 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:19.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:19 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:19.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:19 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:19.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:19 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:19.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:19 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:19.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:19 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:19.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:19 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:19.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:19 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:19.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:19 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:19.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:19 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:19.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:19 smithi130 ceph-mon[84407]: osdmap e133: 8 total, 8 up, 8 in 2024-06-18T02:13:19.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:19 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:19.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:19 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:19.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:19 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:19.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:19 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:19.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:19 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:19.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:19 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:19.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:19 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:19.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:19 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:19.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:19 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:19.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:19 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:19.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:19 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:19.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:19 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:19.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:19 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:19.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:19 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:19.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:19 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:19.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:19.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:19.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:19.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:19.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:19.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:19.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:19.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[113333]: pgmap v172: 161 pgs: 41 active+undersized, 22 active+undersized+degraded, 98 active+clean; 585 KiB data, 149 MiB used, 715 GiB / 715 GiB avail; 100 KiB/s rd, 0 B/s wr, 171 op/s; 102/726 objects degraded (14.050%) 2024-06-18T02:13:19.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:19.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:19.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:19.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:19.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:19.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:19.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:19.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:19.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:19.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:19.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:19.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:19.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:19.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:19.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:19.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:19.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:19.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:19.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:19.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:19.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:19.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:19.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:19.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:19.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:19.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:19.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:19.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:19.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:19.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[99735]: pgmap v172: 161 pgs: 41 active+undersized, 22 active+undersized+degraded, 98 active+clean; 585 KiB data, 149 MiB used, 715 GiB / 715 GiB avail; 100 KiB/s rd, 0 B/s wr, 171 op/s; 102/726 objects degraded (14.050%) 2024-06-18T02:13:19.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:19.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:19.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:19.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:19.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:19.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:19.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:19.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:19.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:19.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:19.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:19.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:19.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:19.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:19.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:19.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:19.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:19.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:19.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:19.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:19.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:19.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:19.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:19.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:19.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:19.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:19.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:19.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:19.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:19.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:19.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:19.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:19.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[113333]: osdmap e133: 8 total, 8 up, 8 in 2024-06-18T02:13:19.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:19.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:19.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:19.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:19.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:19.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:19.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:19.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:19.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:19.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:19.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:19.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:19.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:19.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:19.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:19.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:19.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:19.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:19.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:19.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:19.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:19.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:19.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:19.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:19.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:19.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[99735]: osdmap e133: 8 total, 8 up, 8 in 2024-06-18T02:13:19.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:19.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:19.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:19.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:19.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:19.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:19.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:19.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:19.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:19.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:19.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:19.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:19.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:19.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:19.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:19 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:20.094 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:20.094 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:20.094 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:20.095 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:20.095 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:20.095 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:20.095 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:20.095 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:20.095 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:20.095 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:20.095 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:20.095 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:20.095 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:20.095 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:20.095 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:20.096 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:20.096 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:20.096 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:20.096 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:20.096 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:20.096 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:20.096 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:20.096 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:20.096 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:20.096 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:20.096 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:20.096 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:20.096 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:20.097 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[99735]: Health check update: Degraded data redundancy: 102/726 objects degraded (14.050%), 22 pgs degraded (PG_DEGRADED) 2024-06-18T02:13:20.097 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:20.097 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:20.097 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:20.097 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:20.097 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:20.097 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:20.097 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:20.097 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:20.098 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:20.098 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:20.098 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:20.098 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:20.098 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:20.098 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:20.098 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:20.098 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:20.098 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:20.098 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:20.098 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:20.098 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:20.098 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:20.098 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:20.099 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:20.099 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:20.099 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:20.099 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:20.099 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:20.099 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:20.099 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:20.099 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[113333]: Health check update: Degraded data redundancy: 102/726 objects degraded (14.050%), 22 pgs degraded (PG_DEGRADED) 2024-06-18T02:13:20.099 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:20.099 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:20.099 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:20.100 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:20.100 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:20.100 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:20.100 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:20.100 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:20.100 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:20.100 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:20.100 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:20.100 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:20.100 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:20.100 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:20.100 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:20.100 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:20.101 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:20.101 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:20.101 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:20.101 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:20.101 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:20.101 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:20.101 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:20.101 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:20.101 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:20.101 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:20.101 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:20.101 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:20.102 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:20.102 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:20.102 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:20.102 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:20.102 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:20.102 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:20.102 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:20.102 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:20.102 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:20.102 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:20.102 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:20 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:20.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:20 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:20.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:20 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:20.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:20 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:20.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:20 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:20.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:20 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:20.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:20 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:20.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:20 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:20.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:20 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:20.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:20 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:20.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:20 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:20.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:20 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:20.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:20 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:20.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:20 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:20.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:20 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:20.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:20 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:20.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:20 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:20.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:20 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:20.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:20 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:20.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:20 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:20.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:20 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:20.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:20 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:20.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:20 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:20.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:20 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:20.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:20 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:20.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:20 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:20.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:20 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:20.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:20 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:20.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:20 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:20.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:20 smithi130 ceph-mon[84407]: Health check update: Degraded data redundancy: 102/726 objects degraded (14.050%), 22 pgs degraded (PG_DEGRADED) 2024-06-18T02:13:20.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:20 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:20.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:20 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:20.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:20 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:20.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:20 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:20.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:20 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:20.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:20 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:20.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:20 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:20.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:20 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:20.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:20 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:20.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:20 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:20.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:20 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:20.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:20 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:20.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:20 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:20.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:20 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:20.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:20 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:20.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:20 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:20.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:20 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:20.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:20 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:20.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:20 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:20.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:20 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:21.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:21.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:21.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:21.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:21.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:21.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:21.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:21.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[113333]: pgmap v174: 161 pgs: 41 active+undersized, 22 active+undersized+degraded, 98 active+clean; 585 KiB data, 149 MiB used, 715 GiB / 715 GiB avail; 32 KiB/s rd, 0 B/s wr, 52 op/s; 102/726 objects degraded (14.050%) 2024-06-18T02:13:21.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:21.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:21.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:21.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:21.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:21.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:21.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:21.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:21.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:21.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:21.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:21.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:21.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:21.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:21.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:21.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:21.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:21.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:21.322 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:21.322 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:21.322 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:21.322 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:21.322 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:21.322 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:21.322 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:21.322 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:21.322 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:21.322 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:21.322 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:21.322 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:21.322 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:21.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:21.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:21.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:21.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:21.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:21.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:21.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:21.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:21.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:21.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:21.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:21.324 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:21.324 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:21.324 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:21.324 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:21.324 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:21.324 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:21.324 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:21.324 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:21.324 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:21.325 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:21.325 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:21.325 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:21.325 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[99735]: pgmap v174: 161 pgs: 41 active+undersized, 22 active+undersized+degraded, 98 active+clean; 585 KiB data, 149 MiB used, 715 GiB / 715 GiB avail; 32 KiB/s rd, 0 B/s wr, 52 op/s; 102/726 objects degraded (14.050%) 2024-06-18T02:13:21.325 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:21.325 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:21.325 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:21.325 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:21.325 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:21.325 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:21.325 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:21.325 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:21.325 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:21.325 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:21.326 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:21.326 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:21.326 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:21.326 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:21.326 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:21.326 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:21.326 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:21.326 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:21.326 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:21.326 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:21.326 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:21.326 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:21.326 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:21.327 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:21.327 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:21.327 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:21.327 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:21.327 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:21.327 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:21.327 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:21.327 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:21.327 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:21.327 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:21.327 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:21.327 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:21.327 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:21.327 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:21.328 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:21.328 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:21.328 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:21.328 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:21.328 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:21.328 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:21.328 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:21.328 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:21.328 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:21.328 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:21 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:21.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:21 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:21.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:21 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:21.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:21 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:21.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:21 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:21.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:21 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:21.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:21 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:21.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:21 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:21.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:21 smithi130 ceph-mon[84407]: pgmap v174: 161 pgs: 41 active+undersized, 22 active+undersized+degraded, 98 active+clean; 585 KiB data, 149 MiB used, 715 GiB / 715 GiB avail; 32 KiB/s rd, 0 B/s wr, 52 op/s; 102/726 objects degraded (14.050%) 2024-06-18T02:13:21.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:21 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:21.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:21 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:21.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:21 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:21.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:21 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:21.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:21 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:21.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:21 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:21.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:21 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:21.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:21 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:21.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:21 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:21.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:21 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:21.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:21 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:21.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:21 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:21.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:21 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:21.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:21 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:21.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:21 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:21.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:21 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:21.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:21 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:21.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:21 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:21.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:21 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:21.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:21 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:21.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:21 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:21.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:21 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:21.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:21 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:21.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:21 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:21.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:21 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:21.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:21 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:21.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:21 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:21.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:21 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:21.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:21 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:21.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:21 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:21.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:21 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:21.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:21 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:21.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:21 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:21.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:21 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:21.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:21 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:21.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:21 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:21.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:21 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:21.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:21 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:21.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:21 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:21.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:21 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:21.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:21 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:21.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:21 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:21.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:21 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:21.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:21 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:21.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:21 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:21.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:21 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:21.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:21 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:22.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:22.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:22.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:22.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:22.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:22.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:22.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:22.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:22.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:22.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:22.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:22.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:22.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:22.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:22.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:22.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:22.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:22.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:22.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:22.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:22.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:22.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:22.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:22.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:22.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:22.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:22.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:22.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:22.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:22.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:22.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:22.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:22.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:22.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:22.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:22.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:22.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:22.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:22.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:22.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:22.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:22.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:22.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:22.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:22.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:22.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:22.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:22.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:22.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:22.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:22.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:22.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:22.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:22.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:22.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:22.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:22.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:22.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:22.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:22.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:22.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:22.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:22.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:22.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:22.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:22.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:22.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:22.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:22.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:22.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:22.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:22.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:22.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:22.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:22.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:22.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:22.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:22.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:22.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:22.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:22.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:22.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:22.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:22.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:22.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:22.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:22.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:22.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:22.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:22.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:22.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:22.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:22.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:22.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:22.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:22.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:22.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:22.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:22.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:22.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:22.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:22.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:22.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:22.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:22.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:22.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:22 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:22.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:22 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:22.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:22 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:22.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:22 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:22.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:22 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:22.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:22 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:22.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:22 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:22.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:22 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:22.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:22 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:22.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:22 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:22.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:22 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:22.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:22 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:22.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:22 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:22.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:22 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:22.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:22 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:22.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:22 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:22.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:22 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:22.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:22 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:22.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:22 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:22.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:22 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:22.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:22 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:22.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:22 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:22.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:22 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:22.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:22 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:22.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:22 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:22.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:22 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:22.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:22 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:22.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:22 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:22.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:22 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:22.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:22 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:22.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:22 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:22.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:22 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:22.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:22 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:22.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:22 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:22.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:22 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:22.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:22 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:22.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:22 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:22.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:22 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:22.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:22 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:22.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:22 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:22.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:22 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:22.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:22 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:22.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:22 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:22.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:22 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:22.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:22 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:22.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:22 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:22.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:22 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:22.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:22 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:22.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:22 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:22.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:22 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:22.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:22 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:22.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:22 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:22.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:22 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:22.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:22 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:23.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:23.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:23.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:23.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:23.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:23.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:23.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:23.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:23.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[113333]: pgmap v175: 161 pgs: 24 active+undersized, 14 active+undersized+degraded, 123 active+clean; 585 KiB data, 153 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 32 op/s; 58/726 objects degraded (7.989%); 0 B/s, 3 objects/s recovering 2024-06-18T02:13:23.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:23.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[113333]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:13:23.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:23.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:23.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:23.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:23.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:23.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:23.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:23.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:23.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:23.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:23.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:23.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:23.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:23.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:23.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:23.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:23.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:23.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:23.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:23.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:23.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:23.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:23.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:23.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:23.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:23.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:23.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[99735]: pgmap v175: 161 pgs: 24 active+undersized, 14 active+undersized+degraded, 123 active+clean; 585 KiB data, 153 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 32 op/s; 58/726 objects degraded (7.989%); 0 B/s, 3 objects/s recovering 2024-06-18T02:13:23.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:23.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[99735]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:13:23.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:23.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:23.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:23.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:23.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:23.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:23.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:23.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:23.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:23.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:23.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:23.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:23.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:23.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:23.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:23.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:23.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:23.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:23.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:23.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:23.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:23.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:23.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:23.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:23.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:23.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:23.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:23.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:23.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:23.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:23.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:23.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:23.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:23.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:23.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:23.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:23.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:23.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:23.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:23.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:23.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:23.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:23.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:23.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:23.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:23.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:23.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:23.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:23.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:23.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:23.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:23.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:23.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:23.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:23.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:23.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:23.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:23.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:23.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:23.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:23.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:23.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:23 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:23.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:23 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:23.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:23 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:23.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:23 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:23.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:23 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:23.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:23 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:23.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:23 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:23.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:23 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:23.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:23 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:23.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:23 smithi130 ceph-mon[84407]: pgmap v175: 161 pgs: 24 active+undersized, 14 active+undersized+degraded, 123 active+clean; 585 KiB data, 153 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 32 op/s; 58/726 objects degraded (7.989%); 0 B/s, 3 objects/s recovering 2024-06-18T02:13:23.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:23 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:23.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:23 smithi130 ceph-mon[84407]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:13:23.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:23 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:23.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:23 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:23.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:23 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:23.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:23 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:23.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:23 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:23.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:23 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:23.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:23 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:23.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:23 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:23.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:23 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:23.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:23 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:23.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:23 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:23.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:23 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:23.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:23 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:23.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:23 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:23.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:23 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:23.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:23 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:23.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:23 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:23.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:23 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:23.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:23 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:23.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:23 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:23.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:23 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:23.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:23 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:23.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:23 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:23.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:23 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:23.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:23 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:23.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:23 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:23.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:23 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:23.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:23 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:23.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:23 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:23.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:23 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:23.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:23 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:23.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:23 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:23.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:23 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:23.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:23 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:23.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:23 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:23.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:23 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:23.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:23 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:23.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:23 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:23.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:23 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:23.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:23 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:24.157 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:24.157 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:24.158 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:24.158 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:24.158 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:24.158 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:24.158 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:24.158 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:24.158 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:24.158 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:24.158 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:24.158 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:24.158 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:24.158 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:24.158 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:24.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:24.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:24.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:24.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:24.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:24.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:24.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:24.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:24.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:24.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:24.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:24.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:24.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:24.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:24.160 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:24.160 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:24.160 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:24.160 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:24.160 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:24.160 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:24.160 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:24.160 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:24.160 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:24.160 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:24.161 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:24.161 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:24.161 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:24.161 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:24.161 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:24.161 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:24.161 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:24.161 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:24.161 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:24.161 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:24.161 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:24.161 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:24.161 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:24.161 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:24.161 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:24.162 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:24.162 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:24.162 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:24.162 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:24.162 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:24.162 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:24.162 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:24.162 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:24.162 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:24.162 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:24.163 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:24.163 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:24.163 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:24.163 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:24.163 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:24.163 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:24.163 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:24.163 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:24.163 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:24.163 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:24.163 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:24.163 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:24.163 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:24.163 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:24.164 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:24.164 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:24.164 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:24.164 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:24.164 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:24.164 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:24.164 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:24.164 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:24.164 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:24.164 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:24.164 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:24.164 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:24.164 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:24.165 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:24.165 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:24.165 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:24.165 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:24.165 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:24.165 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:24.165 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:24.165 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:24.165 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:24.165 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:24.165 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:24.165 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:24.165 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:24.165 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:24.166 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:24.166 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:24.166 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:24 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:24.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:24 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:24.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:24 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:24.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:24 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:24.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:24 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:24.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:24 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:24.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:24 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:24.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:24 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:24.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:24 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:24.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:24.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:24.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:24.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:24.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:24 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:24.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:24 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:24.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:24.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:24.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:24.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:24.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:24 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:24.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:24.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:24.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:24.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:24.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:24 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:24.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:24.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:24.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:24.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:24.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:24 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:24.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:24.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:24.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:24.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:24.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:24 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:24.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:24.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:24.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:24.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:24.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:24 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:24.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:24.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:24.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:24.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:24.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:24 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:24.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:24.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:24.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:24.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:24.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:24 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:24.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:24.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:24.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:24.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:24.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:24 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:25.349 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:25 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:25.349 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:25 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:25.349 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:25 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:25.350 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:25 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:25.350 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:25 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:25.350 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:25 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:25.350 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:25 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:25.350 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:25 smithi007 ceph-mon[113333]: pgmap v176: 161 pgs: 161 active+clean; 585 KiB data, 154 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 26 op/s; 0 B/s, 7 objects/s recovering 2024-06-18T02:13:25.350 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:25 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:25.350 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:25.350 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:25.350 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:25.350 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:25.350 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:25 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:25.350 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:25 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:25.350 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:25 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:25.351 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:25 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:25.351 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:25.351 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:25.351 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:25.351 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:25.351 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-06-18T02:13:25.351 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:25 smithi007 ceph-mon[113333]: Health check update: Degraded data redundancy: 58/726 objects degraded (7.989%), 14 pgs degraded (PG_DEGRADED) 2024-06-18T02:13:25.351 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:25 smithi007 ceph-mon[113333]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 58/726 objects degraded (7.989%), 14 pgs degraded) 2024-06-18T02:13:25.351 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:25 smithi007 ceph-mon[113333]: Cluster is now healthy 2024-06-18T02:13:25.351 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:25 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:25.351 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:25 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:25.351 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:25 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:25.352 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:25 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:25.352 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:25 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:25.352 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:25 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:25.352 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:25 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:25.352 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:25 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:25.352 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:25 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:25.352 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:25 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:25.352 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:25 smithi007 ceph-mon[99735]: pgmap v176: 161 pgs: 161 active+clean; 585 KiB data, 154 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 26 op/s; 0 B/s, 7 objects/s recovering 2024-06-18T02:13:25.352 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:25 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:25.352 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:25.352 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:25.352 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:25.352 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:25.353 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:25 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:25.353 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:25 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:25.353 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:25 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:25.353 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:25 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:25.353 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:25.353 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:25.353 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:25.353 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:25.353 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-06-18T02:13:25.353 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:25 smithi007 ceph-mon[99735]: Health check update: Degraded data redundancy: 58/726 objects degraded (7.989%), 14 pgs degraded (PG_DEGRADED) 2024-06-18T02:13:25.353 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:25 smithi007 ceph-mon[99735]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 58/726 objects degraded (7.989%), 14 pgs degraded) 2024-06-18T02:13:25.353 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:25 smithi007 ceph-mon[99735]: Cluster is now healthy 2024-06-18T02:13:25.353 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:25 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:25.353 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:25 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:25.354 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:25 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:25.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:25 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:25.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:25 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:25.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:25 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:25.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:25 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:25.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:25 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:25.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:25 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:25.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:25 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:25.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:25 smithi130 ceph-mon[84407]: pgmap v176: 161 pgs: 161 active+clean; 585 KiB data, 154 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 26 op/s; 0 B/s, 7 objects/s recovering 2024-06-18T02:13:25.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:25 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:25.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:25.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:25.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:25.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:25.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:25 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:25.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:25 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:25.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:25 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:25.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:25 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:25.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:25.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:25.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:25.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:25.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-06-18T02:13:25.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:25 smithi130 ceph-mon[84407]: Health check update: Degraded data redundancy: 58/726 objects degraded (7.989%), 14 pgs degraded (PG_DEGRADED) 2024-06-18T02:13:25.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:25 smithi130 ceph-mon[84407]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 58/726 objects degraded (7.989%), 14 pgs degraded) 2024-06-18T02:13:25.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:25 smithi130 ceph-mon[84407]: Cluster is now healthy 2024-06-18T02:13:25.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:25 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:25.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:25 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:25.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:25 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:26.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:26 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:26.266 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:26 smithi007 ceph-mon[113333]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-06-18T02:13:26.266 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:26 smithi007 ceph-mon[113333]: Upgrade: osd.1 is safe to restart 2024-06-18T02:13:26.266 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:26 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:26.267 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:26 smithi007 ceph-mon[99735]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-06-18T02:13:26.267 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:26 smithi007 ceph-mon[99735]: Upgrade: osd.1 is safe to restart 2024-06-18T02:13:26.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:26 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:26.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:26 smithi130 ceph-mon[84407]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-06-18T02:13:26.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:26 smithi130 ceph-mon[84407]: Upgrade: osd.1 is safe to restart 2024-06-18T02:13:27.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:27 smithi007 ceph-mon[113333]: pgmap v177: 161 pgs: 161 active+clean; 585 KiB data, 154 MiB used, 715 GiB / 715 GiB avail; 9.3 KiB/s rd, 0 B/s wr, 15 op/s; 0 B/s, 6 objects/s recovering 2024-06-18T02:13:27.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:27 smithi007 ceph-mon[113333]: Upgrade: Updating osd.1 2024-06-18T02:13:27.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-06-18T02:13:27.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:27.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:27 smithi007 ceph-mon[113333]: Deploying daemon osd.1 on smithi007 2024-06-18T02:13:27.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:27 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:27.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:13:27.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:27 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:27.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:27 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:27.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:27 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:27.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:27 smithi007 ceph-mon[99735]: pgmap v177: 161 pgs: 161 active+clean; 585 KiB data, 154 MiB used, 715 GiB / 715 GiB avail; 9.3 KiB/s rd, 0 B/s wr, 15 op/s; 0 B/s, 6 objects/s recovering 2024-06-18T02:13:27.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:27 smithi007 ceph-mon[99735]: Upgrade: Updating osd.1 2024-06-18T02:13:27.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-06-18T02:13:27.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:27.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:27 smithi007 ceph-mon[99735]: Deploying daemon osd.1 on smithi007 2024-06-18T02:13:27.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:27 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:27.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:13:27.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:27 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:27.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:27 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:27.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:27 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:27.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:27 smithi130 ceph-mon[84407]: pgmap v177: 161 pgs: 161 active+clean; 585 KiB data, 154 MiB used, 715 GiB / 715 GiB avail; 9.3 KiB/s rd, 0 B/s wr, 15 op/s; 0 B/s, 6 objects/s recovering 2024-06-18T02:13:27.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:27 smithi130 ceph-mon[84407]: Upgrade: Updating osd.1 2024-06-18T02:13:27.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-06-18T02:13:27.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:27.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:27 smithi130 ceph-mon[84407]: Deploying daemon osd.1 on smithi007 2024-06-18T02:13:27.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:27 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:27.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:13:27.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:27 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:27.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:27 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:27.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:27 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:28.278 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:13:27 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:13:27] "GET /metrics HTTP/1.1" 200 38409 "" "Prometheus/2.33.4" 2024-06-18T02:13:29.155 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:29 smithi007 ceph-mon[113333]: pgmap v178: 161 pgs: 161 active+clean; 585 KiB data, 155 MiB used, 715 GiB / 715 GiB avail; 75 KiB/s rd, 0 B/s wr, 124 op/s; 0 B/s, 5 objects/s recovering 2024-06-18T02:13:29.156 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:29 smithi007 ceph-mon[99735]: pgmap v178: 161 pgs: 161 active+clean; 585 KiB data, 155 MiB used, 715 GiB / 715 GiB avail; 75 KiB/s rd, 0 B/s wr, 124 op/s; 0 B/s, 5 objects/s recovering 2024-06-18T02:13:29.215 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:29 smithi130 ceph-mon[84407]: pgmap v178: 161 pgs: 161 active+clean; 585 KiB data, 155 MiB used, 715 GiB / 715 GiB avail; 75 KiB/s rd, 0 B/s wr, 124 op/s; 0 B/s, 5 objects/s recovering 2024-06-18T02:13:30.730 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:30 smithi007 systemd[1]: Stopping Ceph osd.1 for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:13:31.060 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:30 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1[130343]: 2024-06-18T02:13:30.730+0000 7f753d518640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-18T02:13:31.060 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:30 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1[130343]: 2024-06-18T02:13:30.730+0000 7f753d518640 -1 osd.1 133 *** Got signal Terminated *** 2024-06-18T02:13:31.060 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:30 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1[130343]: 2024-06-18T02:13:30.730+0000 7f753d518640 -1 osd.1 133 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-18T02:13:31.384 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:31 smithi007 ceph-mon[113333]: pgmap v179: 161 pgs: 161 active+clean; 585 KiB data, 155 MiB used, 715 GiB / 715 GiB avail; 67 KiB/s rd, 0 B/s wr, 110 op/s; 0 B/s, 5 objects/s recovering 2024-06-18T02:13:31.384 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:31 smithi007 ceph-mon[113333]: osd.1 marked itself down and dead 2024-06-18T02:13:31.384 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:31 smithi007 ceph-mon[99735]: pgmap v179: 161 pgs: 161 active+clean; 585 KiB data, 155 MiB used, 715 GiB / 715 GiB avail; 67 KiB/s rd, 0 B/s wr, 110 op/s; 0 B/s, 5 objects/s recovering 2024-06-18T02:13:31.384 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:31 smithi007 ceph-mon[99735]: osd.1 marked itself down and dead 2024-06-18T02:13:31.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:31 smithi130 ceph-mon[84407]: pgmap v179: 161 pgs: 161 active+clean; 585 KiB data, 155 MiB used, 715 GiB / 715 GiB avail; 67 KiB/s rd, 0 B/s wr, 110 op/s; 0 B/s, 5 objects/s recovering 2024-06-18T02:13:31.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:31 smithi130 ceph-mon[84407]: osd.1 marked itself down and dead 2024-06-18T02:13:31.665 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:31 smithi007 podman[135717]: 2024-06-18 02:13:31.38521282 +0000 UTC m=+0.767295058 container died 856168a0b321688ef98e094c7fdd2f49efb4db811cc96d82753094e534e6ea13 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.build-date=20240612, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-3781e3a, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-06-18T02:13:31.932 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:31 smithi007 podman[135717]: 2024-06-18 02:13:31.839383279 +0000 UTC m=+1.221465516 container cleanup 856168a0b321688ef98e094c7fdd2f49efb4db811cc96d82753094e534e6ea13 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1, ceph=True, org.label-schema.build-date=20240612, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-3781e3a, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-18T02:13:31.932 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:31 smithi007 bash[135717]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1 2024-06-18T02:13:32.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:32 smithi130 ceph-mon[84407]: Health check failed: 1 osds down (OSD_DOWN) 2024-06-18T02:13:32.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:32 smithi130 ceph-mon[84407]: osdmap e134: 8 total, 7 up, 8 in 2024-06-18T02:13:32.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:32 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:32.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:32 smithi007 ceph-mon[113333]: Health check failed: 1 osds down (OSD_DOWN) 2024-06-18T02:13:32.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:32 smithi007 ceph-mon[113333]: osdmap e134: 8 total, 7 up, 8 in 2024-06-18T02:13:32.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:32 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:32.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:32 smithi007 ceph-mon[99735]: Health check failed: 1 osds down (OSD_DOWN) 2024-06-18T02:13:32.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:32 smithi007 ceph-mon[99735]: osdmap e134: 8 total, 7 up, 8 in 2024-06-18T02:13:32.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:32 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:32.433 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:32 smithi007 podman[135733]: 2024-06-18 02:13:32.132814927 +0000 UTC m=+0.741683391 container remove 856168a0b321688ef98e094c7fdd2f49efb4db811cc96d82753094e534e6ea13 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1, org.label-schema.build-date=20240612, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-3781e3a, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-06-18T02:13:32.793 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:32 smithi007 podman[135824]: 2024-06-18 02:13:32.391908895 +0000 UTC m=+0.017768945 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:13:32.793 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:32 smithi007 podman[135824]: 2024-06-18 02:13:32.492223358 +0000 UTC m=+0.118083398 container create a0df906e0b81967b4c3f012863fc2f6482bca261df57fb52af9efe1044d8d726 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240612, io.buildah.version=1.36.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-3781e3a) 2024-06-18T02:13:32.793 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:32 smithi007 podman[135824]: 2024-06-18 02:13:32.719940976 +0000 UTC m=+0.345801029 container init a0df906e0b81967b4c3f012863fc2f6482bca261df57fb52af9efe1044d8d726 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-3781e3a, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.build-date=20240612, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.schema-version=1.0) 2024-06-18T02:13:32.793 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:32 smithi007 podman[135824]: 2024-06-18 02:13:32.723596222 +0000 UTC m=+0.349456265 container start a0df906e0b81967b4c3f012863fc2f6482bca261df57fb52af9efe1044d8d726 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1-deactivate, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-3781e3a, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240612, GIT_CLEAN=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-06-18T02:13:32.794 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:32 smithi007 podman[135824]: 2024-06-18 02:13:32.794584498 +0000 UTC m=+0.420444554 container attach a0df906e0b81967b4c3f012863fc2f6482bca261df57fb52af9efe1044d8d726 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240612, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-3781e3a, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-06-18T02:13:33.067 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:32 smithi007 podman[135824]: 2024-06-18 02:13:32.996222711 +0000 UTC m=+0.622082760 container died a0df906e0b81967b4c3f012863fc2f6482bca261df57fb52af9efe1044d8d726 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-3781e3a, io.buildah.version=1.36.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.build-date=20240612, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-06-18T02:13:33.431 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:33 smithi007 ceph-mon[99735]: pgmap v181: 161 pgs: 19 stale+active+clean, 142 active+clean; 585 KiB data, 155 MiB used, 715 GiB / 715 GiB avail; 83 KiB/s rd, 0 B/s wr, 136 op/s; 0 B/s, 3 objects/s recovering 2024-06-18T02:13:33.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:33 smithi007 ceph-mon[99735]: osdmap e135: 8 total, 7 up, 8 in 2024-06-18T02:13:33.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:33 smithi007 ceph-mon[113333]: pgmap v181: 161 pgs: 19 stale+active+clean, 142 active+clean; 585 KiB data, 155 MiB used, 715 GiB / 715 GiB avail; 83 KiB/s rd, 0 B/s wr, 136 op/s; 0 B/s, 3 objects/s recovering 2024-06-18T02:13:33.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:33 smithi007 ceph-mon[113333]: osdmap e135: 8 total, 7 up, 8 in 2024-06-18T02:13:33.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:33 smithi130 ceph-mon[84407]: pgmap v181: 161 pgs: 19 stale+active+clean, 142 active+clean; 585 KiB data, 155 MiB used, 715 GiB / 715 GiB avail; 83 KiB/s rd, 0 B/s wr, 136 op/s; 0 B/s, 3 objects/s recovering 2024-06-18T02:13:33.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:33 smithi130 ceph-mon[84407]: osdmap e135: 8 total, 7 up, 8 in 2024-06-18T02:13:34.069 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:33 smithi007 podman[135846]: 2024-06-18 02:13:33.72359129 +0000 UTC m=+0.721499739 container remove a0df906e0b81967b4c3f012863fc2f6482bca261df57fb52af9efe1044d8d726 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240612, org.label-schema.license=GPLv2, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3781e3a, GIT_CLEAN=True) 2024-06-18T02:13:34.069 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:33 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.1.service: Deactivated successfully. 2024-06-18T02:13:34.069 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:33 smithi007 systemd[1]: Stopped Ceph osd.1 for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:13:34.069 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:33 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.1.service: Consumed 2.429s CPU time. 2024-06-18T02:13:34.069 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:33 smithi007 systemd[1]: Starting Ceph osd.1 for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:13:34.394 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:34 smithi007 ceph-mon[113333]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:13:34.394 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:34 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:34.394 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:34 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:34.394 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:34 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:34.394 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:34 smithi007 ceph-mon[99735]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:13:34.394 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:34 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:34.394 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:34 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:34.395 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:34 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:34.395 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:34 smithi007 podman[135943]: 2024-06-18 02:13:34.174862802 +0000 UTC m=+0.104534241 container create 0e51868de420fcc4a0a0be3d5432b77f8109926bf9b14e716e07dd0c4f845a6a (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1-activate, org.label-schema.build-date=20240612, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-3781e3a, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47) 2024-06-18T02:13:34.395 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:34 smithi007 podman[135943]: 2024-06-18 02:13:34.088592807 +0000 UTC m=+0.018264194 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:13:34.395 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:34 smithi007 podman[135943]: 2024-06-18 02:13:34.394721621 +0000 UTC m=+0.324393009 container init 0e51868de420fcc4a0a0be3d5432b77f8109926bf9b14e716e07dd0c4f845a6a (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1-activate, RELEASE=squid-3781e3a, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240612, maintainer=Guillaume Abrioux ) 2024-06-18T02:13:34.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:34 smithi130 ceph-mon[84407]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:13:34.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:34 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:34.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:34 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:34.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:34 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:34.681 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:34 smithi007 podman[135943]: 2024-06-18 02:13:34.39857195 +0000 UTC m=+0.328243328 container start 0e51868de420fcc4a0a0be3d5432b77f8109926bf9b14e716e07dd0c4f845a6a (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1-activate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, RELEASE=squid-3781e3a, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240612, GIT_CLEAN=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-18T02:13:34.682 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:34 smithi007 podman[135943]: 2024-06-18 02:13:34.460473384 +0000 UTC m=+0.390144773 container attach 0e51868de420fcc4a0a0be3d5432b77f8109926bf9b14e716e07dd0c4f845a6a (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1-activate, org.label-schema.build-date=20240612, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3781e3a, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0) 2024-06-18T02:13:35.070 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:34 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1-activate[135957]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-06-18T02:13:35.071 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:34 smithi007 bash[135943]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-06-18T02:13:35.071 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:34 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1-activate[135957]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-06-18T02:13:35.071 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:34 smithi007 bash[135943]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-06-18T02:13:35.071 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:34 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1-activate[135957]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-06-18T02:13:35.071 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:34 smithi007 bash[135943]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-06-18T02:13:35.071 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:34 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1-activate[135957]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-06-18T02:13:35.071 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:34 smithi007 bash[135943]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-06-18T02:13:35.071 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:34 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1-activate[135957]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-06-18T02:13:35.071 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:34 smithi007 bash[135943]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-06-18T02:13:35.071 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:34 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1-activate[135957]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-06-18T02:13:35.071 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:34 smithi007 bash[135943]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-06-18T02:13:35.071 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:34 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1-activate[135957]: --> ceph-volume raw activate successful for osd ID: 1 2024-06-18T02:13:35.071 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:34 smithi007 bash[135943]: --> ceph-volume raw activate successful for osd ID: 1 2024-06-18T02:13:35.071 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:34 smithi007 podman[135943]: 2024-06-18 02:13:34.83195053 +0000 UTC m=+0.761621908 container died 0e51868de420fcc4a0a0be3d5432b77f8109926bf9b14e716e07dd0c4f845a6a (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1-activate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, RELEASE=squid-3781e3a, org.label-schema.build-date=20240612, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-06-18T02:13:35.362 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:35 smithi007 ceph-mon[113333]: pgmap v183: 161 pgs: 35 active+undersized, 1 stale+active+clean, 21 active+undersized+degraded, 104 active+clean; 585 KiB data, 163 MiB used, 715 GiB / 715 GiB avail; 99 KiB/s rd, 0 B/s wr, 164 op/s; 96/726 objects degraded (13.223%) 2024-06-18T02:13:35.363 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:35 smithi007 ceph-mon[113333]: Health check failed: Degraded data redundancy: 96/726 objects degraded (13.223%), 21 pgs degraded (PG_DEGRADED) 2024-06-18T02:13:35.363 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:35 smithi007 ceph-mon[99735]: pgmap v183: 161 pgs: 35 active+undersized, 1 stale+active+clean, 21 active+undersized+degraded, 104 active+clean; 585 KiB data, 163 MiB used, 715 GiB / 715 GiB avail; 99 KiB/s rd, 0 B/s wr, 164 op/s; 96/726 objects degraded (13.223%) 2024-06-18T02:13:35.363 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:35 smithi007 ceph-mon[99735]: Health check failed: Degraded data redundancy: 96/726 objects degraded (13.223%), 21 pgs degraded (PG_DEGRADED) 2024-06-18T02:13:35.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:35 smithi130 ceph-mon[84407]: pgmap v183: 161 pgs: 35 active+undersized, 1 stale+active+clean, 21 active+undersized+degraded, 104 active+clean; 585 KiB data, 163 MiB used, 715 GiB / 715 GiB avail; 99 KiB/s rd, 0 B/s wr, 164 op/s; 96/726 objects degraded (13.223%) 2024-06-18T02:13:35.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:35 smithi130 ceph-mon[84407]: Health check failed: Degraded data redundancy: 96/726 objects degraded (13.223%), 21 pgs degraded (PG_DEGRADED) 2024-06-18T02:13:35.681 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:35 smithi007 podman[136085]: 2024-06-18 02:13:35.364012937 +0000 UTC m=+0.526164701 container remove 0e51868de420fcc4a0a0be3d5432b77f8109926bf9b14e716e07dd0c4f845a6a (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1-activate, GIT_BRANCH=HEAD, RELEASE=squid-3781e3a, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240612, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0) 2024-06-18T02:13:35.681 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:35 smithi007 podman[136145]: 2024-06-18 02:13:35.480201488 +0000 UTC m=+0.017892842 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:13:35.682 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:35 smithi007 podman[136145]: 2024-06-18 02:13:35.58158453 +0000 UTC m=+0.119275887 container create e8d184614e94605360ee2acdcd3c304e962010c3e12689e8b625570af76c663a (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1, io.buildah.version=1.36.0, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240612, RELEASE=squid-3781e3a, org.label-schema.license=GPLv2, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-06-18T02:13:36.134 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:35 smithi007 podman[136145]: 2024-06-18 02:13:35.800894594 +0000 UTC m=+0.338585960 container init e8d184614e94605360ee2acdcd3c304e962010c3e12689e8b625570af76c663a (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1, GIT_CLEAN=True, io.buildah.version=1.36.0, RELEASE=squid-3781e3a, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240612, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-06-18T02:13:36.134 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:35 smithi007 podman[136145]: 2024-06-18 02:13:35.804249345 +0000 UTC m=+0.341940702 container start e8d184614e94605360ee2acdcd3c304e962010c3e12689e8b625570af76c663a (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1, org.label-schema.build-date=20240612, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, RELEASE=squid-3781e3a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-06-18T02:13:36.134 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:35 smithi007 ceph-osd[136163]: -- 172.21.15.7:0/2073964208 <== mon.1 v2:172.21.15.7:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557f5e50fa40 con 0x557f5f2ce000 2024-06-18T02:13:36.134 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:35 smithi007 bash[136145]: e8d184614e94605360ee2acdcd3c304e962010c3e12689e8b625570af76c663a 2024-06-18T02:13:36.134 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:35 smithi007 systemd[1]: Started Ceph osd.1 for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:13:36.387 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1[136159]: 2024-06-18T02:13:36.337+0000 7f6c01dbf640 -1 Falling back to public interface 2024-06-18T02:13:37.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[113333]: pgmap v184: 161 pgs: 41 active+undersized, 22 active+undersized+degraded, 98 active+clean; 585 KiB data, 163 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 0 B/s wr, 23 op/s; 102/726 objects degraded (14.050%) 2024-06-18T02:13:37.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:37.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:37.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:37.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:37.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:37.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:37.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:37.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:37.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:37.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:37.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:37.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:37.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:37.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:37.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:37.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:37.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:37.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:37.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:37.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:37.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:37.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:37.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:37.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:37.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:37.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:37.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:37.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:37.088 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:37.088 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:37.088 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:37.088 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:37.088 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:37.088 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:37.088 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:37.088 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:37.088 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:37.088 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:37.088 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:37.088 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:37.088 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:37.088 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:37.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:37.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:37.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:37.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:37.089 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[99735]: pgmap v184: 161 pgs: 41 active+undersized, 22 active+undersized+degraded, 98 active+clean; 585 KiB data, 163 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 0 B/s wr, 23 op/s; 102/726 objects degraded (14.050%) 2024-06-18T02:13:37.089 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:37.089 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:37.089 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:37.089 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:37.089 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:37.090 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:37.090 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:37.090 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:37.090 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:37.090 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:37.090 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:37.090 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:37.090 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:37.090 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:37.090 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:37.090 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:37.090 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:37.090 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:37.090 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:37.091 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:37.091 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:37.091 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:37.091 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:37.091 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:37.091 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:37.091 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:37.091 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:37.091 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:37.091 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:37.091 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:37.091 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:37.091 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:37.091 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:37.092 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:37.092 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:37.092 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:37.092 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:37.092 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:37.092 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:37.092 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:37.092 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:37.092 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:37.092 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:37.092 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:37.092 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:37.092 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:36 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:37.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:36 smithi130 ceph-mon[84407]: pgmap v184: 161 pgs: 41 active+undersized, 22 active+undersized+degraded, 98 active+clean; 585 KiB data, 163 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 0 B/s wr, 23 op/s; 102/726 objects degraded (14.050%) 2024-06-18T02:13:37.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:36 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:37.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:36 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:37.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:37.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:37.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:36 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:37.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:36 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:37.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:37.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:37.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:37.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:37.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:36 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:37.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:37.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:37.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:37.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:37.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:36 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:37.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:37.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:37.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:37.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:37.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:36 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:37.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:37.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:37.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:37.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:37.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:36 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:37.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:37.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:37.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:37.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:37.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:36 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:37.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:37.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:37.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:37.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:37.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:36 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:37.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:37.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:37.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:37.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:37.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:36 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:37.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:37.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:37.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:37.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:37.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:36 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:38.104 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:38.104 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:38.105 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:38.105 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:38.105 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:38.105 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:38.105 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:38.105 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:38.105 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:38.105 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:38.105 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:38.105 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:38.105 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:38.105 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:38.105 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:38.106 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:38.106 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:38.106 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:38.106 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:38.106 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:38.106 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:38.106 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:38.106 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:38.106 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:38.106 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:38.106 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:38.106 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:38.106 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:38.106 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:38.107 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:38.107 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:38.107 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:38.107 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:38.107 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:38.107 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:38.107 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:38.107 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:38.107 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:38.107 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:38.107 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:38.107 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:38.107 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:38.107 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:38.108 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:38.108 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:38.108 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:38.108 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:38.108 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:38.108 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:38.108 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:38.108 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:38.108 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:38.108 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:38.108 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:38.109 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:38.109 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:38.109 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:38.109 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:38.109 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:38.109 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:38.109 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:38.109 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:38.109 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:38.109 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:38.109 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:38.109 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:38.110 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:38.110 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:38.110 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:38.110 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:38.110 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:38.110 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:38.110 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:38.110 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:38.110 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:38.110 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:38.110 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:38.110 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:38.110 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:38.110 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:38.111 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:38.111 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:38.111 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:38.111 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:38.111 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:38.111 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:38.111 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:38.111 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:38.111 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:38.111 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:38.111 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:38.111 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:38.111 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:38.111 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:38.112 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:38.112 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:38.112 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:38.112 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:38.112 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:38.112 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:38.112 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:38.112 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:38.112 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:38.112 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:38.112 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:38.112 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:38.112 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:38.113 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:37 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:38.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:13:37 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:13:37] "GET /metrics HTTP/1.1" 200 38409 "" "Prometheus/2.33.4" 2024-06-18T02:13:38.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:37 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:38.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:37 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:38.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:37 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:38.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:37 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:38.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:37 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:38.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:37 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:38.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:37 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:38.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:37 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:38.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:38.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:38.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:38.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:38.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:37 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:38.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:37 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:38.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:38.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:38.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:38.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:38.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:37 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:38.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:38.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:38.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:38.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:38.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:37 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:38.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:38.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:38.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:38.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:38.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:37 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:38.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:38.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:38.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:38.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:38.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:37 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:38.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:38.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:38.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:38.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:38.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:37 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:38.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:38.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:38.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:38.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:38.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:37 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:38.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:38.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:38.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:38.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:38.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:37 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:38.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:38.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:38.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:38.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:38.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:37 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:39.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:38 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:39.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:38 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:39.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:38 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:39.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:38 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:39.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:38 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:39.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:38 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:39.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:38 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:39.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:38 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:39.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:38 smithi130 ceph-mon[84407]: pgmap v185: 161 pgs: 41 active+undersized, 22 active+undersized+degraded, 98 active+clean; 585 KiB data, 164 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 0 B/s wr, 24 op/s; 102/726 objects degraded (14.050%) 2024-06-18T02:13:39.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:39.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:39.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:39.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:39.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:38 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:39.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:38 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:39.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:39.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:39.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:39.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:39.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:38 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:39.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:39.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:39.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:39.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:39.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:38 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:39.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:39.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:39.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:39.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:39.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:38 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:39.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:39.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:39.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:39.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:39.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:38 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:39.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:39.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:39.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:39.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:39.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:38 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:39.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:39.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:39.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:39.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:39.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:38 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:39.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:39.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:39.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:39.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:39.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:38 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:39.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:39.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:39.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:39.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:39.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:38 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:39.431 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1[136159]: 2024-06-18T02:13:39.124+0000 7f6c01dbf640 -1 osd.1 133 log_to_monitors true 2024-06-18T02:13:39.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:39.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:39.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:39.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:39.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:39.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:39.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:39.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:39.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[113333]: pgmap v185: 161 pgs: 41 active+undersized, 22 active+undersized+degraded, 98 active+clean; 585 KiB data, 164 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 0 B/s wr, 24 op/s; 102/726 objects degraded (14.050%) 2024-06-18T02:13:39.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:39.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:39.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:39.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:39.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:39.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:39.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:39.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:39.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:39.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:39.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:39.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:39.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:39.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:39.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:39.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:39.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:39.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:39.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:39.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:39.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:39.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:39.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:39.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:39.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:39.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:39.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:39.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:39.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:39.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[99735]: pgmap v185: 161 pgs: 41 active+undersized, 22 active+undersized+degraded, 98 active+clean; 585 KiB data, 164 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 0 B/s wr, 24 op/s; 102/726 objects degraded (14.050%) 2024-06-18T02:13:39.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:39.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:39.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:39.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:39.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:39.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:39.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:39.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:39.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:39.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:39.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:39.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:39.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:39.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:39.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:39.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:39.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:39.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:39.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:39.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:39.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:39.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:39.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:39.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:39.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:39.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:39.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:39.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:39.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:39.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:39.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:39.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:39.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:39.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:39.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:39.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:39.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:39.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:39.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:39.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:39.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:39.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:39.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:39.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:39.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:39.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:39.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:39.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:39.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:39.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:39.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:39.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:39.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:39.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:39.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:39.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:39.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:39.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:39.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:39.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:39.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:39.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:39.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:39.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:39.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:39.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:39.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:39.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:39.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:39.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:39.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:38 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:40.181 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1[136159]: 2024-06-18T02:13:40.075+0000 7f6bf9b6a640 -1 osd.1 133 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-18T02:13:40.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:40.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:40.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:40.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:40.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:40.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:40.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:40.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:40.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:40.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:40.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:40.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:40.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:40.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:40.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[99735]: from='osd.1 [v2:172.21.15.7:6808/2304625712,v1:172.21.15.7:6809/2304625712]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-18T02:13:40.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:40.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:40.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:40.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:40.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:40.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:40.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:40.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:40.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:40.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:40.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:40.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:40.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:40.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:40.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:40.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:40.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:40.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:40.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:40.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:40.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:40.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:40.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:40.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:40.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:40.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:40.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:40.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:40.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:40.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[113333]: from='osd.1 [v2:172.21.15.7:6808/2304625712,v1:172.21.15.7:6809/2304625712]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-18T02:13:40.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:40.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:40.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:40.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:40.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:40.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:40.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:40.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:40.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:40.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:40.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:40.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:40.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:40.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:40.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:40.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:40.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:40.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:40.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:40.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:40.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[99735]: Health check update: Degraded data redundancy: 102/726 objects degraded (14.050%), 22 pgs degraded (PG_DEGRADED) 2024-06-18T02:13:40.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:40.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:40.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:40.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:40.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:40.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:40.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:40.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:40.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:40.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:40.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:40.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:40.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:40.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:40.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:40.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:40.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:40.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:40.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:40.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:40.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[113333]: Health check update: Degraded data redundancy: 102/726 objects degraded (14.050%), 22 pgs degraded (PG_DEGRADED) 2024-06-18T02:13:40.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:40.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:40.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:40.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:40.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:40.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:40.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:40.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:40.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:40.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:40.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:40.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:40.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:40.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:40.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:39 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:40.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:39 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:40.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:39 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:40.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:39 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:40.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:39 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:40.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:39 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:40.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:39 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:40.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:39 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:40.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:39 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:40.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:40.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:40.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:40.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:40.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:39 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:40.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:39 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:40.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:39 smithi130 ceph-mon[84407]: from='osd.1 [v2:172.21.15.7:6808/2304625712,v1:172.21.15.7:6809/2304625712]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-18T02:13:40.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:40.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:40.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:40.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:40.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:39 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:40.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:40.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:40.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:40.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:40.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:39 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:40.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:40.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:40.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:40.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:40.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:39 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:40.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:40.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:40.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:40.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:40.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:39 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:40.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:39 smithi130 ceph-mon[84407]: Health check update: Degraded data redundancy: 102/726 objects degraded (14.050%), 22 pgs degraded (PG_DEGRADED) 2024-06-18T02:13:40.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:40.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:40.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:40.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:40.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:39 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:40.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:40.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:40.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:40.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:40.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:39 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:40.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:40.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:40.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:40.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:40.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:39 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:41.148 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:41.148 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:41.149 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:41.149 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:41.149 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:41.149 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:41.149 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:41.149 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: pgmap v186: 161 pgs: 41 active+undersized, 22 active+undersized+degraded, 98 active+clean; 585 KiB data, 164 MiB used, 715 GiB / 715 GiB avail; 5.5 KiB/s rd, 0 B/s wr, 8 op/s; 102/726 objects degraded (14.050%) 2024-06-18T02:13:41.149 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:41.149 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:41.149 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:41.149 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:41.149 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:41.149 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:41.149 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: from='osd.1 [v2:172.21.15.7:6808/2304625712,v1:172.21.15.7:6809/2304625712]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-06-18T02:13:41.150 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: osdmap e136: 8 total, 7 up, 8 in 2024-06-18T02:13:41.150 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: from='osd.1 [v2:172.21.15.7:6808/2304625712,v1:172.21.15.7:6809/2304625712]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-06-18T02:13:41.150 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:41.150 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:41.150 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:41.150 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:41.150 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:41.150 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:41.150 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:41.150 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:41.150 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:41.150 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:41.150 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:41.151 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:41.151 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:41.151 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:41.151 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:41.151 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:41.151 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:41.151 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:41.151 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:41.151 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: pgmap v186: 161 pgs: 41 active+undersized, 22 active+undersized+degraded, 98 active+clean; 585 KiB data, 164 MiB used, 715 GiB / 715 GiB avail; 5.5 KiB/s rd, 0 B/s wr, 8 op/s; 102/726 objects degraded (14.050%) 2024-06-18T02:13:41.151 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:41.152 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:41.152 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:41.152 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:41.152 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:41.152 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:41.152 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: from='osd.1 [v2:172.21.15.7:6808/2304625712,v1:172.21.15.7:6809/2304625712]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-06-18T02:13:41.152 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: osdmap e136: 8 total, 7 up, 8 in 2024-06-18T02:13:41.152 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: from='osd.1 [v2:172.21.15.7:6808/2304625712,v1:172.21.15.7:6809/2304625712]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-06-18T02:13:41.152 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:41.152 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:41.152 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:41.152 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:41.152 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:41.153 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:41.153 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:41.153 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:41.153 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:41.153 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:41.153 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:41.153 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:41.153 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:41.153 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:41.153 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:41.153 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:41.154 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:41.154 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:41.154 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:41.154 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:41.154 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:41.154 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:41.154 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:41.154 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:41.154 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:41.154 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:41.154 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:41.154 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:41.154 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:41.155 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:41.155 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:41.155 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:41.155 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:41.155 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:41.155 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:41.155 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:41.155 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:41.155 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:41.155 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:41.155 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:41.155 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:41.155 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:41.156 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:41.156 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:41.156 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:41.156 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:41.156 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:41.156 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:41.156 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:41.156 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:41.156 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:41.156 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:41.156 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:41.156 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:41.156 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:41.157 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:41.157 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:41.157 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:41.157 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:41.157 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:41.157 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:41.157 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:41.157 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:41.157 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:41.157 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:41.157 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:41.157 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:41.157 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:41.158 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:41.158 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:40 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:41.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:41.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:41.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:41.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:41.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:41.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:41.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:41.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: pgmap v186: 161 pgs: 41 active+undersized, 22 active+undersized+degraded, 98 active+clean; 585 KiB data, 164 MiB used, 715 GiB / 715 GiB avail; 5.5 KiB/s rd, 0 B/s wr, 8 op/s; 102/726 objects degraded (14.050%) 2024-06-18T02:13:41.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:41.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:41.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:41.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:41.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:41.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:41.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: from='osd.1 [v2:172.21.15.7:6808/2304625712,v1:172.21.15.7:6809/2304625712]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-06-18T02:13:41.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: osdmap e136: 8 total, 7 up, 8 in 2024-06-18T02:13:41.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: from='osd.1 [v2:172.21.15.7:6808/2304625712,v1:172.21.15.7:6809/2304625712]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-06-18T02:13:41.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:41.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:41.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:41.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:41.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:41.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:41.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:41.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:41.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:41.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:41.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:41.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:41.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:41.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:41.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:41.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:41.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:41.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:41.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:41.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:41.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:41.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:41.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:41.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:41.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:41.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:41.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:41.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:41.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:41.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:41.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:41.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:41.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:41.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:41.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:41.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:41.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:41.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:41.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:41.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:41.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:40 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:42.287 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:42.287 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:42.287 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:42.287 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:42.287 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:42.287 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:42.287 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:42.287 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:42.287 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:42.287 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:42.288 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:42.288 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:42.288 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:42.288 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-06-18T02:13:42.288 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: osd.1 [v2:172.21.15.7:6808/2304625712,v1:172.21.15.7:6809/2304625712] boot 2024-06-18T02:13:42.288 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: osdmap e137: 8 total, 8 up, 8 in 2024-06-18T02:13:42.288 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-18T02:13:42.288 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:42.288 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:42.288 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:42.288 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:42.288 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:42.288 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:42.288 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:13:42.288 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:42.289 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:42.289 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:42.289 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:42.289 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:42.289 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:42.289 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:42.289 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:42.289 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:42.289 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:42.289 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:42.289 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:42.290 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:42.290 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:42.290 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:42.290 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:42.290 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:42.290 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:42.290 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:42.290 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:42.290 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-06-18T02:13:42.290 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: osd.1 [v2:172.21.15.7:6808/2304625712,v1:172.21.15.7:6809/2304625712] boot 2024-06-18T02:13:42.290 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: osdmap e137: 8 total, 8 up, 8 in 2024-06-18T02:13:42.290 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-18T02:13:42.290 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:42.290 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:42.291 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:42.291 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:42.291 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:42.291 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:42.291 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:13:42.291 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:42.291 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:42.291 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:42.291 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:42.291 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:42.291 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:42.291 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:42.292 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:42.292 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:42.292 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:42.292 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:42.292 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:42.292 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:42.292 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:42.292 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:42.292 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:42.292 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:42.292 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:42.292 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:42.292 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:42.292 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:42.292 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:42.293 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:42.293 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:42.293 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:42.293 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:42.293 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:42.293 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:42.293 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:42.293 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:42.293 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:42.293 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:42.293 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:42.293 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:42.294 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:42.294 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:42.294 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:42.294 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:42.294 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:42.294 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:42.294 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:42.294 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:42.294 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:42.294 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:42.294 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:42.294 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:42.295 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:42.295 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:42.295 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:42.295 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:42.295 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:42.295 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:42.295 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:42.295 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:42.295 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:42.295 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:42.295 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:42.295 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:42.295 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:42.295 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:42.296 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:42.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:42.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:42.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:42.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:42.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:42.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:42.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:42.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:42.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:42.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:42.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:42.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:42.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:42.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-06-18T02:13:42.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: osd.1 [v2:172.21.15.7:6808/2304625712,v1:172.21.15.7:6809/2304625712] boot 2024-06-18T02:13:42.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: osdmap e137: 8 total, 8 up, 8 in 2024-06-18T02:13:42.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-18T02:13:42.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:42.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:42.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:42.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:42.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:42.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:42.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:13:42.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:42.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:42.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:42.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:42.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:42.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:42.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:42.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:42.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:42.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:42.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:42.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:42.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:42.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:42.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:42.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:42.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:42.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:42.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:42.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:42.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:42.300 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:42.300 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:42.300 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:42.300 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:42.300 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:42.300 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:42.300 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:42.300 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:42.300 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:42.300 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:42.300 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:42.300 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:42.300 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:43.102 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:43.102 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:43.102 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:43.102 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:43.102 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:43.103 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:43.103 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:43.103 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[113333]: pgmap v189: 161 pgs: 41 active+undersized, 22 active+undersized+degraded, 98 active+clean; 585 KiB data, 160 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 102/726 objects degraded (14.050%) 2024-06-18T02:13:43.103 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:43.103 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:43.103 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[113333]: osdmap e138: 8 total, 8 up, 8 in 2024-06-18T02:13:43.103 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:43.103 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:43.103 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:43.103 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:43.103 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:43.103 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:43.103 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:43.104 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:43.104 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:43.104 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:43.104 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:43.104 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:43.104 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:43.104 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:43.104 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:43.104 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:43.104 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:43.104 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:43.104 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:43.105 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:43.105 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:43.105 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:43.105 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:43.105 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:43.105 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:43.105 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:43.105 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[99735]: pgmap v189: 161 pgs: 41 active+undersized, 22 active+undersized+degraded, 98 active+clean; 585 KiB data, 160 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 102/726 objects degraded (14.050%) 2024-06-18T02:13:43.105 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:43.105 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:43.106 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[99735]: osdmap e138: 8 total, 8 up, 8 in 2024-06-18T02:13:43.106 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:43.106 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:43.106 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:43.106 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:43.106 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:43.106 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:43.106 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:43.106 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:43.106 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:43.106 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:43.106 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:43.106 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:43.107 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:43.107 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:43.107 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:43.107 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:43.107 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:43.107 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:43.107 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:43.107 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:43.107 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:43.107 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:43.108 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:43.108 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:43.108 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:43.108 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:43.108 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:43.108 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:43.108 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:43.108 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:43.108 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:43.108 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:43.108 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:43.108 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:43.108 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:43.109 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:43.109 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:43.109 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:43.109 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:43.109 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:43.109 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:43.109 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:43.109 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:43.109 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:43.109 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:43.109 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:43.109 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:43.110 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:43.110 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:43.110 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:43.110 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:43.110 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:43.110 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:43.110 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:43.110 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:43.110 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:43.110 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:43.110 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:43.110 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:43.110 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:43.111 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:43.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:42 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:43.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:42 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:43.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:42 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:43.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:42 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:43.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:42 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:43.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:42 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:43.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:42 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:43.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:42 smithi130 ceph-mon[84407]: pgmap v189: 161 pgs: 41 active+undersized, 22 active+undersized+degraded, 98 active+clean; 585 KiB data, 160 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 102/726 objects degraded (14.050%) 2024-06-18T02:13:43.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:42 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:43.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:42 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:43.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:42 smithi130 ceph-mon[84407]: osdmap e138: 8 total, 8 up, 8 in 2024-06-18T02:13:43.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:43.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:43.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:43.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:43.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:42 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:43.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:43.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:43.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:43.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:43.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:42 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:43.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:43.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:43.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:43.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:43.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:42 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:43.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:43.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:43.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:43.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:43.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:42 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:43.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:43.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:43.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:43.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:43.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:42 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:43.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:43.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:43.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:43.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:43.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:42 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:43.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:43.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:43.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:43.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:43.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:42 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:43.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:43.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:43.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:43.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:43.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:42 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:43.366 INFO:teuthology.orchestra.run.smithi007.stdout:true 2024-06-18T02:13:44.071 INFO:teuthology.orchestra.run.smithi007.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-18T02:13:44.071 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi007 smithi007 running 17s ago 16m - - 2024-06-18T02:13:44.072 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi130 smithi130 running 10s ago 16m - - 2024-06-18T02:13:44.072 INFO:teuthology.orchestra.run.smithi007.stdout:alertmanager.a smithi007 *:9093,9094 running (6m) 17s ago 11m 23.2M - 0.23.0 ba2b418f427c 5994e8525c64 2024-06-18T02:13:44.072 INFO:teuthology.orchestra.run.smithi007.stdout:grafana.a smithi130 *:3000 running (6m) 10s ago 11m 49.6M - 8.3.5 dad864ee21e9 70ba81d97c8e 2024-06-18T02:13:44.072 INFO:teuthology.orchestra.run.smithi007.stdout:iscsi.foo.smithi007.xvdrwd smithi007 running (4m) 17s ago 10m 54.7M - 3.5 e1d6a67b021e 94121ad2702c 2024-06-18T02:13:44.072 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.x smithi130 *:8443,9283,8765 running (5m) 10s ago 16m 524M - 19.0.0-3124-g3781e3a5 af93c036e016 01017e37bdbe 2024-06-18T02:13:44.072 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.y smithi007 *:8443,9283,8765 running (3m) 17s ago 17m 442M - 19.0.0-3124-g3781e3a5 af93c036e016 2141e131e896 2024-06-18T02:13:44.072 INFO:teuthology.orchestra.run.smithi007.stdout:mon.a smithi007 running (109s) 17s ago 18m 46.5M 2048M 19.0.0-3124-g3781e3a5 af93c036e016 7bbe646cd5b7 2024-06-18T02:13:44.072 INFO:teuthology.orchestra.run.smithi007.stdout:mon.b smithi130 running (2m) 10s ago 16m 48.0M 2048M 19.0.0-3124-g3781e3a5 af93c036e016 baacf2add994 2024-06-18T02:13:44.072 INFO:teuthology.orchestra.run.smithi007.stdout:mon.c smithi007 running (3m) 17s ago 16m 49.0M 2048M 19.0.0-3124-g3781e3a5 af93c036e016 39418356156e 2024-06-18T02:13:44.072 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.a smithi007 *:9100 running (6m) 17s ago 12m 18.0M - 1.3.1 1dbe0e931976 8128e558f099 2024-06-18T02:13:44.072 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.b smithi130 *:9100 running (6m) 10s ago 12m 17.3M - 1.3.1 1dbe0e931976 bab93b43cf16 2024-06-18T02:13:44.072 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0 smithi007 running (58s) 17s ago 15m 44.6M 4096M 19.0.0-3124-g3781e3a5 af93c036e016 07c7f4afd49a 2024-06-18T02:13:44.072 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1 smithi007 starting - - - 4096M 2024-06-18T02:13:44.073 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2 smithi007 running (15m) 17s ago 15m 55.1M 4096M 17.2.0 e1d6a67b021e 2c1b76bd0876 2024-06-18T02:13:44.073 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3 smithi007 running (14m) 17s ago 14m 60.6M 4096M 17.2.0 e1d6a67b021e 8b91b2a07564 2024-06-18T02:13:44.073 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4 smithi130 running (14m) 10s ago 14m 62.7M 4096M 17.2.0 e1d6a67b021e c428dccffdf0 2024-06-18T02:13:44.073 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5 smithi130 running (13m) 10s ago 13m 61.4M 4096M 17.2.0 e1d6a67b021e f645d7f12378 2024-06-18T02:13:44.073 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6 smithi130 running (13m) 10s ago 13m 55.9M 4096M 17.2.0 e1d6a67b021e c7af86c14959 2024-06-18T02:13:44.073 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7 smithi130 running (12m) 10s ago 12m 59.8M 4096M 17.2.0 e1d6a67b021e 3688af8b2c46 2024-06-18T02:13:44.073 INFO:teuthology.orchestra.run.smithi007.stdout:prometheus.a smithi130 *:9095 running (5m) 10s ago 12m 75.8M - 2.33.4 514e6a882f6e e905fb2eb4a6 2024-06-18T02:13:44.073 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi007.dvbvbk smithi007 *:8000 running (10m) 17s ago 10m 77.3M - 17.2.0 e1d6a67b021e 1344b55b763c 2024-06-18T02:13:44.073 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi130.aakmof smithi130 *:8000 running (10m) 10s ago 10m 75.0M - 17.2.0 e1d6a67b021e e257e3230c6c 2024-06-18T02:13:44.073 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi007.hgrnmk smithi007 *:80 running (10m) 17s ago 10m 75.4M - 17.2.0 e1d6a67b021e 2173947bc4d6 2024-06-18T02:13:44.073 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi130.wwebfk smithi130 *:80 running (10m) 10s ago 10m 77.0M - 17.2.0 e1d6a67b021e 8662706b2231 2024-06-18T02:13:44.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:44.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[99735]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:13:44.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:44.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:44.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:44.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:44.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:44.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:44.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:44.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:44.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:44.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:44.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:44.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:44.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:44.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:44.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:44.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:44.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:44.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:44.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:44.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:44.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:44.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:44.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:44.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:44.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:44.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:44.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:44.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:44.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:44.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[113333]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:13:44.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:44.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:44.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:44.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:44.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:44.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:44.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:44.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:44.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:44.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:44.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:44.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:44.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:44.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:44.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:44.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:44.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:44.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:44.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:44.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:44.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:44.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:44.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:44.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:44.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:44.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:44.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:44.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:44.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:44.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:44.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:44.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:44.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:44.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:44.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:44.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:44.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:44.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:44.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:44.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:44.192 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:44.192 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:44.192 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:44.192 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:44.192 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:44.192 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:44.192 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:44.192 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:44.192 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:44.192 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:44.192 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:44.192 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:44.193 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:44.193 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:44.193 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:44.193 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:44.193 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:44.193 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:44.193 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:44.193 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:44.193 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:44.194 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:44.194 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:44.194 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:44.194 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:44.194 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:44.194 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:44.194 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:44.194 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:44.194 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:44.194 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:44.194 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:44.194 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:44.195 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:44.195 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:44.195 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:44.195 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:44.195 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:43 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:44.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:43 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:44.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:43 smithi130 ceph-mon[84407]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:13:44.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:43 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:44.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:43 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:44.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:43 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:44.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:43 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:44.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:43 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:44.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:43 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:44.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:43 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:44.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:44.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:44.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:44.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:44.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:43 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:44.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:43 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:44.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:44.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:44.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:44.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:44.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:43 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:44.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:44.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:44.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:44.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:44.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:43 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:44.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:44.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:44.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:44.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:44.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:43 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:44.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:44.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:44.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:44.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:44.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:43 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:44.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:44.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:44.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:44.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:44.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:43 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:44.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:44.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:44.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:44.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:44.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:43 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:44.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:44.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:44.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:44.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:44.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:43 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:44.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:44.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:44.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:44.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:44.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:43 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:44.520 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:13:44.520 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": { 2024-06-18T02:13:44.521 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 3 2024-06-18T02:13:44.521 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:13:44.521 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": { 2024-06-18T02:13:44.521 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 2 2024-06-18T02:13:44.521 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:13:44.521 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": { 2024-06-18T02:13:44.521 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 6, 2024-06-18T02:13:44.521 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 2 2024-06-18T02:13:44.521 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:13:44.521 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw": { 2024-06-18T02:13:44.521 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-06-18T02:13:44.521 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:13:44.521 INFO:teuthology.orchestra.run.smithi007.stdout: "overall": { 2024-06-18T02:13:44.522 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 10, 2024-06-18T02:13:44.522 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 7 2024-06-18T02:13:44.522 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-06-18T02:13:44.522 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:13:44.879 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:13:44.879 INFO:teuthology.orchestra.run.smithi007.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00", 2024-06-18T02:13:44.879 INFO:teuthology.orchestra.run.smithi007.stdout: "in_progress": true, 2024-06-18T02:13:44.879 INFO:teuthology.orchestra.run.smithi007.stdout: "which": "Upgrading all daemon types on all hosts", 2024-06-18T02:13:44.879 INFO:teuthology.orchestra.run.smithi007.stdout: "services_complete": [ 2024-06-18T02:13:44.879 INFO:teuthology.orchestra.run.smithi007.stdout: "mon", 2024-06-18T02:13:44.880 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr" 2024-06-18T02:13:44.880 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-06-18T02:13:44.880 INFO:teuthology.orchestra.run.smithi007.stdout: "progress": "6/23 daemons upgraded", 2024-06-18T02:13:44.880 INFO:teuthology.orchestra.run.smithi007.stdout: "message": "Currently upgrading osd daemons", 2024-06-18T02:13:44.880 INFO:teuthology.orchestra.run.smithi007.stdout: "is_paused": false 2024-06-18T02:13:44.880 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:13:45.150 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:45.151 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:45.151 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:45.151 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: from='client.94233 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:13:45.151 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:45.151 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:45.151 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:45.151 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: from='client.54283 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:13:45.151 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:45.151 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:45.151 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: pgmap v191: 161 pgs: 17 active+undersized, 8 active+undersized+degraded, 136 active+clean; 585 KiB data, 161 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 44/726 objects degraded (6.061%) 2024-06-18T02:13:45.151 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:45.151 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:45.151 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:45.152 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:45.152 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:45.152 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:45.152 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: from='client.94245 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:13:45.152 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:45.152 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:45.152 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:45.152 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:45.152 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:45.152 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:45.152 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:45.152 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:45.152 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:45.153 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:45.153 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:45.153 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:45.153 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:45.153 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:45.153 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: from='client.94233 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:13:45.153 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:45.153 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:45.153 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:45.153 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: from='client.54283 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:13:45.154 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:45.154 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:45.154 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: pgmap v191: 161 pgs: 17 active+undersized, 8 active+undersized+degraded, 136 active+clean; 585 KiB data, 161 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 44/726 objects degraded (6.061%) 2024-06-18T02:13:45.154 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:45.154 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:45.154 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:45.154 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:45.154 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:45.154 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:45.154 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: from='client.94245 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:13:45.154 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:45.154 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:45.154 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:45.155 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:45.155 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:45.155 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:45.155 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:45.155 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:45.155 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:45.155 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:45.155 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:45.155 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:45.155 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:45.156 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:45.156 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:45.156 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:45.156 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:45.156 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:45.156 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:45.156 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:45.156 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: from='client.? 172.21.15.7:0/488518880' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:45.156 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:45.156 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:45.156 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:45.156 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:45.156 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:45.156 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:45.157 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:45.157 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:45.157 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:45.157 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:45.157 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:45.157 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:45.157 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:45.157 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:45.157 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:45.157 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: Health check update: Degraded data redundancy: 44/726 objects degraded (6.061%), 8 pgs degraded (PG_DEGRADED) 2024-06-18T02:13:45.157 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:45.157 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:45.157 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:45.158 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:45.158 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:45.158 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:45.158 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:45.158 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:45.158 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:45.158 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:45.158 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:45.158 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:45.158 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: from='client.? 172.21.15.7:0/488518880' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:45.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:45.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:45.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:45.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:45.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:45.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:45.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:45.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:45.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:45.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:45.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:45.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:45.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:45.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:45.160 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:45.160 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: Health check update: Degraded data redundancy: 44/726 objects degraded (6.061%), 8 pgs degraded (PG_DEGRADED) 2024-06-18T02:13:45.160 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:45.160 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:45.160 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:45.160 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:45.160 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:45.160 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:45.160 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:44 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:45.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:45.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:45.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:45.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: from='client.94233 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:13:45.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:45.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:45.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:45.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: from='client.54283 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:13:45.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:45.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:45.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: pgmap v191: 161 pgs: 17 active+undersized, 8 active+undersized+degraded, 136 active+clean; 585 KiB data, 161 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 44/726 objects degraded (6.061%) 2024-06-18T02:13:45.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:45.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:45.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:45.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:45.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:45.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:45.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: from='client.94245 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:13:45.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:45.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:45.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:45.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:45.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:45.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:45.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:45.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:45.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:45.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:45.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:45.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:45.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:45.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:45.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:45.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:45.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:45.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:45.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:45.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:45.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: from='client.? 172.21.15.7:0/488518880' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:45.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:45.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:45.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:45.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:45.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:45.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:45.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:45.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:45.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:45.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:45.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:45.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:45.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:45.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:45.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:45.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: Health check update: Degraded data redundancy: 44/726 objects degraded (6.061%), 8 pgs degraded (PG_DEGRADED) 2024-06-18T02:13:45.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:45.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:45.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:45.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:45.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:44 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:45.318 INFO:teuthology.orchestra.run.smithi007.stdout:HEALTH_WARN Degraded data redundancy: 44/726 objects degraded (6.061%), 8 pgs degraded 2024-06-18T02:13:45.318 INFO:teuthology.orchestra.run.smithi007.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 44/726 objects degraded (6.061%), 8 pgs degraded 2024-06-18T02:13:45.318 INFO:teuthology.orchestra.run.smithi007.stdout: pg 2.9 is active+undersized+degraded, acting [7,3] 2024-06-18T02:13:45.318 INFO:teuthology.orchestra.run.smithi007.stdout: pg 2.a is active+undersized+degraded, acting [3,7] 2024-06-18T02:13:45.318 INFO:teuthology.orchestra.run.smithi007.stdout: pg 2.15 is active+undersized+degraded, acting [5,0] 2024-06-18T02:13:45.318 INFO:teuthology.orchestra.run.smithi007.stdout: pg 3.0 is active+undersized+degraded, acting [2,6] 2024-06-18T02:13:45.318 INFO:teuthology.orchestra.run.smithi007.stdout: pg 3.4 is active+undersized+degraded, acting [2,5] 2024-06-18T02:13:45.318 INFO:teuthology.orchestra.run.smithi007.stdout: pg 3.6 is active+undersized+degraded, acting [0,4] 2024-06-18T02:13:45.318 INFO:teuthology.orchestra.run.smithi007.stdout: pg 3.19 is active+undersized+degraded, acting [3,4] 2024-06-18T02:13:45.319 INFO:teuthology.orchestra.run.smithi007.stdout: pg 5.1d is active+undersized+degraded, acting [4,0] 2024-06-18T02:13:46.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:45 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:46.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:45 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:46.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:45 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:46.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:45 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:46.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:45 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:46.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:45 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:46.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:45 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:46.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:45 smithi130 ceph-mon[84407]: from='client.54301 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:13:46.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:45 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:46.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:46.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:46.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:46.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:46.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:45 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:46.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:45 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:46.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:46.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:46.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:46.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:46.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:45 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:46.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:46.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:46.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:46.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:46.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:45 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:46.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:45 smithi130 ceph-mon[84407]: from='client.? 172.21.15.7:0/3992683291' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:13:46.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:46.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:46.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:46.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:46.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:45 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:46.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:46.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:46.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:46.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:46.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:45 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:46.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:46.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:46.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:46.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:46.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:45 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:46.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:46.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:46.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:46.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:46.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:45 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:46.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:46.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:46.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:46.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:45 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:46.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:45 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:46.298 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:46.298 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:46.298 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:46.298 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:46.298 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:46.299 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:46.299 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:46.299 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[113333]: from='client.54301 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:13:46.299 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:46.299 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:46.299 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:46.299 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:46.299 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:46.299 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:46.299 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:46.299 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:46.299 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:46.299 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:46.300 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:46.300 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:46.300 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:46.300 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:46.300 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:46.300 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:46.300 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:46.300 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[113333]: from='client.? 172.21.15.7:0/3992683291' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:13:46.300 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:46.300 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:46.300 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:46.300 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:46.300 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:46.301 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:46.301 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:46.301 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:46.301 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:46.301 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:46.301 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:46.301 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:46.301 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:46.301 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:46.301 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:46.301 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:46.301 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:46.301 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:46.301 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:46.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:46.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:46.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:46.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:46.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:46.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:46.302 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:46.302 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:46.302 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:46.303 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:46.303 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:46.303 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:46.303 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:46.303 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[99735]: from='client.54301 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:13:46.303 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:46.303 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:46.303 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:46.303 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:46.303 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:46.303 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:46.303 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:46.303 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:46.304 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:46.304 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:46.304 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:46.304 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:46.304 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:46.304 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:46.304 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:46.304 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:46.304 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:46.304 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[99735]: from='client.? 172.21.15.7:0/3992683291' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:13:46.304 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:46.304 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:46.304 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:46.305 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:46.305 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:46.305 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:46.305 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:46.305 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:46.305 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:46.305 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:46.305 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:46.305 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:46.305 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:46.305 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:46.305 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:46.305 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:46.305 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:46.305 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:46.306 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:46.306 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:46.306 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:46.306 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:46.306 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:46.306 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:46.306 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:45 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:47.294 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:47.294 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:47.294 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:47.294 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:47.294 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:47.294 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:47.294 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:47.294 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: pgmap v192: 161 pgs: 161 active+clean; 585 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:13:47.294 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:47.294 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:47.295 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:47.295 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:47.295 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:47.295 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:47.295 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:47.295 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:47.295 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:47.295 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:47.295 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:47.295 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:47.295 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:47.295 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:47.295 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:47.295 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:47.296 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:47.296 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:47.296 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:47.296 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:47.296 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:47.296 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:47.296 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:47.296 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:47.296 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:47.296 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:47.296 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:47.297 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:47.297 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:47.297 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: pgmap v192: 161 pgs: 161 active+clean; 585 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:13:47.297 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:47.297 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:47.297 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:47.297 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:47.297 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:47.297 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:47.297 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:47.297 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:47.297 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:47.298 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:47.298 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:47.298 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:47.298 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:47.298 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:47.298 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:47.298 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:47.298 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:47.298 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:47.298 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:47.298 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:47.298 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:47.298 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:47.299 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:47.299 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:47.299 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:47.299 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:47.299 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:47.299 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:47.299 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:47.299 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:47.299 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:47.299 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:47.300 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:47.300 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:47.300 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:47.300 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:47.300 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:47.300 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:47.300 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:47.300 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:47.300 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:47.301 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 44/726 objects degraded (6.061%), 8 pgs degraded) 2024-06-18T02:13:47.301 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: Cluster is now healthy 2024-06-18T02:13:47.301 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:47.301 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:47.301 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:47.301 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:47.301 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:47.301 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:47.301 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:47.301 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:47.301 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:47.301 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:47.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:47.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:47.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:47.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:47.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:47.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:47.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:47.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:47.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:47.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:47.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:47.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:47.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:47.303 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:47.303 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:47.303 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:47.303 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:47.303 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 44/726 objects degraded (6.061%), 8 pgs degraded) 2024-06-18T02:13:47.303 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: Cluster is now healthy 2024-06-18T02:13:47.303 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:47.303 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:47.303 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:47.303 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:47.303 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:47.303 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:47.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:47.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:46 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:47.304 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:47.304 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:47.305 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:47.305 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:47.305 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:47.305 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:47.305 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:47.305 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: pgmap v192: 161 pgs: 161 active+clean; 585 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:13:47.305 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:47.305 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:47.305 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:47.306 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:47.306 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:47.306 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:47.306 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:47.306 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:47.306 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:47.306 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:47.306 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:47.306 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:47.306 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:47.306 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:47.306 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:47.306 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:47.307 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:47.307 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:47.307 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:47.307 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:47.307 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:47.307 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:47.307 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:47.307 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:47.307 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:47.307 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:47.307 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:47.307 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:47.307 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:47.307 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:47.307 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:47.308 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:47.308 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:47.308 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:47.308 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:47.308 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:47.308 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:47.308 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:47.308 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:47.308 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:47.308 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:47.308 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 44/726 objects degraded (6.061%), 8 pgs degraded) 2024-06-18T02:13:47.308 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: Cluster is now healthy 2024-06-18T02:13:47.308 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:47.308 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:47.308 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:47.309 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:47.309 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:47.309 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:47.309 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:47.309 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:46 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:48.118 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:47 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:48.118 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:47 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:48.118 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:47 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:48.119 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:47 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:48.119 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:47 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:48.119 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:47 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:48.119 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:47 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:48.119 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:47 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:48.119 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:48.119 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:48.119 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:48.119 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:48.119 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-06-18T02:13:48.119 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:47 smithi007 ceph-mon[99735]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-06-18T02:13:48.119 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:47 smithi007 ceph-mon[99735]: Upgrade: osd.2 is safe to restart 2024-06-18T02:13:48.120 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:47 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:48.120 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:47 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:48.120 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:47 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:48.120 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:47 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:48.120 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:47 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:48.120 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:47 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:48.120 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:47 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:48.120 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:47 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:48.120 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:48.120 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:48.120 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:48.120 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:48.120 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-06-18T02:13:48.120 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:47 smithi007 ceph-mon[113333]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-06-18T02:13:48.121 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:47 smithi007 ceph-mon[113333]: Upgrade: osd.2 is safe to restart 2024-06-18T02:13:48.195 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:13:47 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:13:47] "GET /metrics HTTP/1.1" 200 38264 "" "Prometheus/2.33.4" 2024-06-18T02:13:48.195 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:47 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:48.195 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:47 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:48.195 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:47 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:48.195 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:47 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:48.195 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:47 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:48.195 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:47 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:48.195 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:47 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:48.196 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:47 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:13:48.196 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:48.196 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:48.196 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:48.196 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:13:48.196 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-06-18T02:13:48.196 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:47 smithi130 ceph-mon[84407]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-06-18T02:13:48.196 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:47 smithi130 ceph-mon[84407]: Upgrade: osd.2 is safe to restart 2024-06-18T02:13:49.055 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:48 smithi007 ceph-mon[113333]: pgmap v193: 161 pgs: 161 active+clean; 585 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-06-18T02:13:49.055 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:48 smithi007 ceph-mon[99735]: pgmap v193: 161 pgs: 161 active+clean; 585 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-06-18T02:13:49.224 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:48 smithi130 ceph-mon[84407]: pgmap v193: 161 pgs: 161 active+clean; 585 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-06-18T02:13:50.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:50 smithi130 ceph-mon[84407]: Upgrade: Updating osd.2 2024-06-18T02:13:50.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:50 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:50.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-06-18T02:13:50.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:50.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:50 smithi130 ceph-mon[84407]: Deploying daemon osd.2 on smithi007 2024-06-18T02:13:50.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:50 smithi130 ceph-mon[84407]: pgmap v194: 161 pgs: 161 active+clean; 585 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-06-18T02:13:50.654 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:50 smithi007 ceph-mon[113333]: Upgrade: Updating osd.2 2024-06-18T02:13:50.654 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:50 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:50.654 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-06-18T02:13:50.654 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:50.654 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:50 smithi007 ceph-mon[113333]: Deploying daemon osd.2 on smithi007 2024-06-18T02:13:50.654 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:50 smithi007 ceph-mon[113333]: pgmap v194: 161 pgs: 161 active+clean; 585 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-06-18T02:13:50.654 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:50 smithi007 ceph-mon[99735]: Upgrade: Updating osd.2 2024-06-18T02:13:50.655 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:50 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:50.655 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-06-18T02:13:50.655 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:50.655 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:50 smithi007 ceph-mon[99735]: Deploying daemon osd.2 on smithi007 2024-06-18T02:13:50.655 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:50 smithi007 ceph-mon[99735]: pgmap v194: 161 pgs: 161 active+clean; 585 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-06-18T02:13:52.521 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:52 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:52.521 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:52 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:52.521 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:52 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:52.522 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:52 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:52.522 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:52 smithi007 ceph-mon[113333]: pgmap v195: 161 pgs: 161 active+clean; 585 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-06-18T02:13:52.522 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:52 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:52.522 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:52 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:52.522 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:52 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:52.522 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:52 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:52.522 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:52 smithi007 ceph-mon[99735]: pgmap v195: 161 pgs: 161 active+clean; 585 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-06-18T02:13:52.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:52 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:52.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:52 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:52.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:52 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:52.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:52 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:52.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:52 smithi130 ceph-mon[84407]: pgmap v195: 161 pgs: 161 active+clean; 585 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-06-18T02:13:53.914 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:53 smithi007 ceph-mon[113333]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:13:53.914 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:53 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:53.914 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:53 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:53.914 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:53 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:53.914 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:53 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:53.914 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:53 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:53.914 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:53 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:53.915 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:53 smithi007 ceph-mon[99735]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:13:53.915 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:53 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:53.915 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:53 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:53.915 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:53 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:53.915 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:53 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:53.915 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:53 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:53.915 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:53 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:54.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:53 smithi130 ceph-mon[84407]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:13:54.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:53 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:54.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:53 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:54.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:53 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:54.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:53 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:54.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:53 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:54.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:53 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:54.181 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:13:54 smithi007 systemd[1]: Stopping Ceph osd.2 for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:13:54.675 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:13:54 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2[38899]: 2024-06-18T02:13:54.290+0000 7fa8c3cf7700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-18T02:13:54.676 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:13:54 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2[38899]: 2024-06-18T02:13:54.290+0000 7fa8c3cf7700 -1 osd.2 138 *** Got signal Terminated *** 2024-06-18T02:13:54.676 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:13:54 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2[38899]: 2024-06-18T02:13:54.290+0000 7fa8c3cf7700 -1 osd.2 138 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-18T02:13:54.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:54 smithi007 ceph-mon[113333]: pgmap v196: 161 pgs: 161 active+clean; 585 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-06-18T02:13:54.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:54 smithi007 ceph-mon[113333]: osd.2 marked itself down and dead 2024-06-18T02:13:54.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:54 smithi007 ceph-mon[99735]: pgmap v196: 161 pgs: 161 active+clean; 585 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-06-18T02:13:54.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:54 smithi007 ceph-mon[99735]: osd.2 marked itself down and dead 2024-06-18T02:13:55.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:54 smithi130 ceph-mon[84407]: pgmap v196: 161 pgs: 161 active+clean; 585 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-06-18T02:13:55.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:54 smithi130 ceph-mon[84407]: osd.2 marked itself down and dead 2024-06-18T02:13:55.341 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:13:55 smithi007 podman[141405]: 2024-06-18 02:13:55.071659205 +0000 UTC m=+0.896807482 container died 2c1b76bd0876d946180232e93547f7ad9dc41827acd6158dc094683fc486be94 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2, io.openshift.tags=base centos centos-stream, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, GIT_REPO=https://github.com/ceph/ceph-container.git, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, release=754, io.buildah.version=1.19.8, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vcs-type=git, ceph=True, io.k8s.display-name=CentOS Stream 8, com.redhat.component=centos-stream-container, version=8, CEPH_POINT_RELEASE=-17.2.0, vendor=Red Hat, Inc., name=centos-stream, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, distribution-scope=public, RELEASE=HEAD, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, architecture=x86_64, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, GIT_BRANCH=HEAD, io.openshift.expose-services=, build-date=2022-05-03T08:36:31.336870, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-06-18T02:13:55.678 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:13:55 smithi007 podman[141405]: 2024-06-18 02:13:55.415775351 +0000 UTC m=+1.240923626 container cleanup 2c1b76bd0876d946180232e93547f7ad9dc41827acd6158dc094683fc486be94 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, GIT_CLEAN=True, build-date=2022-05-03T08:36:31.336870, io.openshift.expose-services=, release=754, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, CEPH_POINT_RELEASE=-17.2.0, RELEASE=HEAD, vendor=Red Hat, Inc., com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, architecture=x86_64, distribution-scope=public, io.openshift.tags=base centos centos-stream, version=8, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., ceph=True, maintainer=Guillaume Abrioux , name=centos-stream, com.redhat.component=centos-stream-container, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_BRANCH=HEAD, vcs-type=git, io.buildah.version=1.19.8, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.k8s.display-name=CentOS Stream 8, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb) 2024-06-18T02:13:55.678 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:13:55 smithi007 bash[141405]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2 2024-06-18T02:13:55.678 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:13:55 smithi007 podman[141422]: 2024-06-18 02:13:55.584039749 +0000 UTC m=+0.513105727 container remove 2c1b76bd0876d946180232e93547f7ad9dc41827acd6158dc094683fc486be94 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2, GIT_BRANCH=HEAD, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, vcs-type=git, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, release=754, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., GIT_REPO=https://github.com/ceph/ceph-container.git, io.k8s.display-name=CentOS Stream 8, vendor=Red Hat, Inc., RELEASE=HEAD, ceph=True, io.openshift.tags=base centos centos-stream, distribution-scope=public, build-date=2022-05-03T08:36:31.336870, com.redhat.component=centos-stream-container, GIT_CLEAN=True, io.openshift.expose-services=, name=centos-stream, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, CEPH_POINT_RELEASE=-17.2.0, maintainer=Guillaume Abrioux , architecture=x86_64, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.buildah.version=1.19.8, version=8) 2024-06-18T02:13:55.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:55 smithi007 ceph-mon[113333]: Health check failed: 1 osds down (OSD_DOWN) 2024-06-18T02:13:55.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:55 smithi007 ceph-mon[113333]: osdmap e139: 8 total, 7 up, 8 in 2024-06-18T02:13:55.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:55 smithi007 ceph-mon[99735]: Health check failed: 1 osds down (OSD_DOWN) 2024-06-18T02:13:55.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:55 smithi007 ceph-mon[99735]: osdmap e139: 8 total, 7 up, 8 in 2024-06-18T02:13:56.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:55 smithi130 ceph-mon[84407]: Health check failed: 1 osds down (OSD_DOWN) 2024-06-18T02:13:56.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:55 smithi130 ceph-mon[84407]: osdmap e139: 8 total, 7 up, 8 in 2024-06-18T02:13:56.278 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:13:56 smithi007 podman[141508]: 2024-06-18 02:13:55.91871703 +0000 UTC m=+0.017899497 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:13:56.278 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:13:56 smithi007 podman[141508]: 2024-06-18 02:13:56.035209613 +0000 UTC m=+0.134392115 container create a3cb5ec77d7c55a10241e6398b86d424ec89031b964ed934e7b3a3f0e8264bbd (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240612, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-3781e3a) 2024-06-18T02:13:56.552 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:13:56 smithi007 podman[141508]: 2024-06-18 02:13:56.279305656 +0000 UTC m=+0.378488122 container init a3cb5ec77d7c55a10241e6398b86d424ec89031b964ed934e7b3a3f0e8264bbd (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240612, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3781e3a, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, ceph=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-06-18T02:13:56.552 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:13:56 smithi007 podman[141508]: 2024-06-18 02:13:56.28300542 +0000 UTC m=+0.382187886 container start a3cb5ec77d7c55a10241e6398b86d424ec89031b964ed934e7b3a3f0e8264bbd (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240612, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-3781e3a, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-06-18T02:13:56.552 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:13:56 smithi007 podman[141508]: 2024-06-18 02:13:56.354145447 +0000 UTC m=+0.453327905 container attach a3cb5ec77d7c55a10241e6398b86d424ec89031b964ed934e7b3a3f0e8264bbd (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-3781e3a, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240612, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_CLEAN=True) 2024-06-18T02:13:56.898 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:56 smithi007 ceph-mon[113333]: osdmap e140: 8 total, 7 up, 8 in 2024-06-18T02:13:56.898 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:56 smithi007 ceph-mon[113333]: pgmap v199: 161 pgs: 18 peering, 8 stale+active+clean, 135 active+clean; 585 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-06-18T02:13:56.898 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:56 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:56.898 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:13:56.899 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:56 smithi007 ceph-mon[99735]: osdmap e140: 8 total, 7 up, 8 in 2024-06-18T02:13:56.899 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:56 smithi007 ceph-mon[99735]: pgmap v199: 161 pgs: 18 peering, 8 stale+active+clean, 135 active+clean; 585 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-06-18T02:13:56.899 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:56 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:56.899 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:13:56.899 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:13:56 smithi007 podman[141508]: 2024-06-18 02:13:56.553048667 +0000 UTC m=+0.652231128 container died a3cb5ec77d7c55a10241e6398b86d424ec89031b964ed934e7b3a3f0e8264bbd (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-3781e3a, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240612, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-18T02:13:57.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:56 smithi130 ceph-mon[84407]: osdmap e140: 8 total, 7 up, 8 in 2024-06-18T02:13:57.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:56 smithi130 ceph-mon[84407]: pgmap v199: 161 pgs: 18 peering, 8 stale+active+clean, 135 active+clean; 585 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-06-18T02:13:57.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:56 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:57.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:13:57.525 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:13:57 smithi007 podman[141530]: 2024-06-18 02:13:57.27534777 +0000 UTC m=+0.715655201 container remove a3cb5ec77d7c55a10241e6398b86d424ec89031b964ed934e7b3a3f0e8264bbd (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240612, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-3781e3a, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-06-18T02:13:57.525 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:13:57 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.2.service: Deactivated successfully. 2024-06-18T02:13:57.525 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:13:57 smithi007 systemd[1]: Stopped Ceph osd.2 for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:13:57.525 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:13:57 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.2.service: Consumed 9.214s CPU time. 2024-06-18T02:13:57.525 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:13:57 smithi007 systemd[1]: Starting Ceph osd.2 for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:13:57.978 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:57 smithi007 ceph-mon[113333]: Health check failed: Reduced data availability: 2 pgs inactive, 2 pgs peering (PG_AVAILABILITY) 2024-06-18T02:13:57.978 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:57 smithi007 ceph-mon[99735]: Health check failed: Reduced data availability: 2 pgs inactive, 2 pgs peering (PG_AVAILABILITY) 2024-06-18T02:13:57.979 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:13:57 smithi007 podman[141630]: 2024-06-18 02:13:57.726572854 +0000 UTC m=+0.098382607 container create 841f8934f4b0b80cfaf03633594c41a5510ea9a440d274b215ed070378c28517 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2-activate, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240612, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-3781e3a, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-06-18T02:13:57.979 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:13:57 smithi007 podman[141630]: 2024-06-18 02:13:57.64605616 +0000 UTC m=+0.017865879 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:13:58.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:57 smithi130 ceph-mon[84407]: Health check failed: Reduced data availability: 2 pgs inactive, 2 pgs peering (PG_AVAILABILITY) 2024-06-18T02:13:58.044 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:13:57 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:13:57] "GET /metrics HTTP/1.1" 200 38405 "" "Prometheus/2.33.4" 2024-06-18T02:13:58.366 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:13:57 smithi007 podman[141630]: 2024-06-18 02:13:57.979389643 +0000 UTC m=+0.351199362 container init 841f8934f4b0b80cfaf03633594c41a5510ea9a440d274b215ed070378c28517 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2-activate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.build-date=20240612, RELEASE=squid-3781e3a, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47) 2024-06-18T02:13:58.366 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:13:57 smithi007 podman[141630]: 2024-06-18 02:13:57.983309572 +0000 UTC m=+0.355119280 container start 841f8934f4b0b80cfaf03633594c41a5510ea9a440d274b215ed070378c28517 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2-activate, org.label-schema.build-date=20240612, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-3781e3a, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-06-18T02:13:58.366 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:13:58 smithi007 podman[141630]: 2024-06-18 02:13:58.053978237 +0000 UTC m=+0.425787966 container attach 841f8934f4b0b80cfaf03633594c41a5510ea9a440d274b215ed070378c28517 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2-activate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-3781e3a, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.build-date=20240612, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-18T02:13:58.682 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:13:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2-activate[141645]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-06-18T02:13:58.682 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:13:58 smithi007 bash[141630]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-06-18T02:13:58.682 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:13:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2-activate[141645]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-06-18T02:13:58.682 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:13:58 smithi007 bash[141630]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-06-18T02:13:58.682 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:13:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2-activate[141645]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-06-18T02:13:58.682 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:13:58 smithi007 bash[141630]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-06-18T02:13:58.682 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:13:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2-activate[141645]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-06-18T02:13:58.682 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:13:58 smithi007 bash[141630]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-06-18T02:13:58.682 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:13:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2-activate[141645]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-06-18T02:13:58.683 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:13:58 smithi007 bash[141630]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-06-18T02:13:58.683 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:13:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2-activate[141645]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-06-18T02:13:58.683 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:13:58 smithi007 bash[141630]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-06-18T02:13:58.683 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:13:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2-activate[141645]: --> ceph-volume raw activate successful for osd ID: 2 2024-06-18T02:13:58.683 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:13:58 smithi007 bash[141630]: --> ceph-volume raw activate successful for osd ID: 2 2024-06-18T02:13:58.683 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:13:58 smithi007 podman[141630]: 2024-06-18 02:13:58.421988952 +0000 UTC m=+0.793798660 container died 841f8934f4b0b80cfaf03633594c41a5510ea9a440d274b215ed070378c28517 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2-activate, GIT_CLEAN=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-3781e3a, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240612, GIT_BRANCH=HEAD) 2024-06-18T02:13:59.006 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:58 smithi007 ceph-mon[113333]: pgmap v200: 161 pgs: 19 active+undersized, 18 peering, 10 active+undersized+degraded, 114 active+clean; 585 KiB data, 166 MiB used, 715 GiB / 715 GiB avail; 36/726 objects degraded (4.959%) 2024-06-18T02:13:59.007 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:58 smithi007 ceph-mon[99735]: pgmap v200: 161 pgs: 19 active+undersized, 18 peering, 10 active+undersized+degraded, 114 active+clean; 585 KiB data, 166 MiB used, 715 GiB / 715 GiB avail; 36/726 objects degraded (4.959%) 2024-06-18T02:13:59.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:58 smithi130 ceph-mon[84407]: pgmap v200: 161 pgs: 19 active+undersized, 18 peering, 10 active+undersized+degraded, 114 active+clean; 585 KiB data, 166 MiB used, 715 GiB / 715 GiB avail; 36/726 objects degraded (4.959%) 2024-06-18T02:13:59.333 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:13:59 smithi007 podman[141768]: 2024-06-18 02:13:59.007904257 +0000 UTC m=+0.579946034 container remove 841f8934f4b0b80cfaf03633594c41a5510ea9a440d274b215ed070378c28517 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2-activate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-3781e3a, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240612, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47) 2024-06-18T02:13:59.333 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:13:59 smithi007 podman[141827]: 2024-06-18 02:13:59.129706345 +0000 UTC m=+0.017669683 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:13:59.333 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:13:59 smithi007 podman[141827]: 2024-06-18 02:13:59.233845001 +0000 UTC m=+0.121808371 container create f3ae8409a895bda54a26c1fc467783d45577eeea6deb188b86b8899ed9dbb4f8 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240612, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-3781e3a) 2024-06-18T02:13:59.681 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:13:59 smithi007 podman[141827]: 2024-06-18 02:13:59.427620383 +0000 UTC m=+0.315583731 container init f3ae8409a895bda54a26c1fc467783d45577eeea6deb188b86b8899ed9dbb4f8 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2, ceph=True, RELEASE=squid-3781e3a, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240612, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-18T02:13:59.682 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:13:59 smithi007 podman[141827]: 2024-06-18 02:13:59.432102961 +0000 UTC m=+0.320066290 container start f3ae8409a895bda54a26c1fc467783d45577eeea6deb188b86b8899ed9dbb4f8 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240612, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-3781e3a, maintainer=Guillaume Abrioux ) 2024-06-18T02:13:59.682 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:13:59 smithi007 ceph-osd[141846]: -- 172.21.15.7:0/2817015308 <== mon.1 v2:172.21.15.7:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55685f489a40 con 0x556860248000 2024-06-18T02:13:59.682 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:13:59 smithi007 bash[141827]: f3ae8409a895bda54a26c1fc467783d45577eeea6deb188b86b8899ed9dbb4f8 2024-06-18T02:13:59.682 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:13:59 smithi007 systemd[1]: Started Ceph osd.2 for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:13:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:59 smithi007 ceph-mon[113333]: Health check failed: Degraded data redundancy: 36/726 objects degraded (4.959%), 10 pgs degraded (PG_DEGRADED) 2024-06-18T02:13:59.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:59 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:59.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:59 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:59.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:59.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:59.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:59 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:59.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:13:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:13:59.955 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:59 smithi007 ceph-mon[99735]: Health check failed: Degraded data redundancy: 36/726 objects degraded (4.959%), 10 pgs degraded (PG_DEGRADED) 2024-06-18T02:13:59.955 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:59 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:59.955 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:59 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:59.955 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:13:59.955 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:13:59.956 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:59 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:13:59.956 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:13:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:00.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:59 smithi130 ceph-mon[84407]: Health check failed: Degraded data redundancy: 36/726 objects degraded (4.959%), 10 pgs degraded (PG_DEGRADED) 2024-06-18T02:14:00.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:59 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:00.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:59 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:00.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:00.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:00.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:59 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:00.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:13:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:00.431 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:13:59 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2[141842]: 2024-06-18T02:13:59.989+0000 7fafcb261640 -1 Falling back to public interface 2024-06-18T02:14:00.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:00.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:00.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:00.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:00.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:00.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:00.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:00.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:00.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:00.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:00.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:00.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:00.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:00.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:00.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:00.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:00.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:00.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:00.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[113333]: pgmap v201: 161 pgs: 19 active+undersized, 18 peering, 10 active+undersized+degraded, 114 active+clean; 585 KiB data, 166 MiB used, 715 GiB / 715 GiB avail; 36/726 objects degraded (4.959%) 2024-06-18T02:14:00.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:00.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:00.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:00.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:00.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:00.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:00.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:00.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:00.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:00.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:00.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:00.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:00.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:00.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:00.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:00.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:00.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:00.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:00.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:00.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:00.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:00.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:00.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:00.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:00.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:00.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:00.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:00.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:00.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[99735]: pgmap v201: 161 pgs: 19 active+undersized, 18 peering, 10 active+undersized+degraded, 114 active+clean; 585 KiB data, 166 MiB used, 715 GiB / 715 GiB avail; 36/726 objects degraded (4.959%) 2024-06-18T02:14:00.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:00.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:00.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:00.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:00.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:00.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:00.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:00.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:00.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:00.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:00.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:00.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:00.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:00.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:00.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:00.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:00.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:00.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:00.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:00.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:00.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:00.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:00.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:00.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:00.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:00.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:00.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:00.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:00.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:00.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:00.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:00.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:00.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:00.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:00.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:00.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:00.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:00.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:00.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:00.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:00.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:00.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:00.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:00.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:00.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:00.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:00.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:00.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:00.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:00.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:00.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:00.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:00 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:01.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:00 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:01.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:01.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:01.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:01.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:00 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:01.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:00 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:01.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:01.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:01.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:01.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:01.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:00 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:01.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:00 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:01.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:01.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:01.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:01.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:01.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:00 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:01.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:00 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:01.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:00 smithi130 ceph-mon[84407]: pgmap v201: 161 pgs: 19 active+undersized, 18 peering, 10 active+undersized+degraded, 114 active+clean; 585 KiB data, 166 MiB used, 715 GiB / 715 GiB avail; 36/726 objects degraded (4.959%) 2024-06-18T02:14:01.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:01.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:01.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:01.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:01.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:00 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:01.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:00 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:01.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:01.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:01.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:01.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:01.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:00 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:01.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:01.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:01.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:01.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:01.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:00 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:01.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:01.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:01.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:01.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:01.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:00 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:01.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:01.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:01.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:01.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:01.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:00 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:01.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:01.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:01.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:01.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:01.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:00 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:01.698 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:01 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:01.699 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:01 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:01.699 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:01 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:01.699 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:01 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:01.699 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:01 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:01.699 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:01.699 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:01.699 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:01.699 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:01.699 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:01 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:01.699 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:01 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:01.699 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:01.699 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:01.699 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:01.700 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:01.700 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:01 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:01.700 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:01 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:01.700 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:01.700 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:01.700 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:01.700 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:01.700 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:01 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:01.700 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:01 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:01.700 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:01.700 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:01.700 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:01.700 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:01.700 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:01 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:01.700 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:01.701 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:01.701 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:01.701 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:01.701 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:01 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:01.701 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:01.701 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:01.701 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:01.701 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:01.701 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:01 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:01.701 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:01.701 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:01.701 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:01.765 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:01.765 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:01.765 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:01.765 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:01.765 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:01.765 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:01.766 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:01.766 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:01.766 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:01.766 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:01.766 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:01.766 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:01.766 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:01.766 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:01.766 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:01.766 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:01.766 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:01.766 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:01.766 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:01.767 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:01.767 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:01.767 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:01.767 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:01.767 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:01.767 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:01.767 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:01.767 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:01.767 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:01.767 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:01.767 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:01.768 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:01.768 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:01.768 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:01.768 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:01.768 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:01.768 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:01.768 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:01.768 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:01.768 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:01.768 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:01.769 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:01.769 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:01.769 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:01.769 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:01.769 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:01.769 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:01.769 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:01.769 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:01.769 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:01.769 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:01.769 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:01.769 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:01.769 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:01.769 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:01.770 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:01.770 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:01.770 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:01.770 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:01.770 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:01.770 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:01.770 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:01.770 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:01.770 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:01.770 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:01.770 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:01.770 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:01.770 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:01.771 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:01.771 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:01.771 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:01.771 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:01.771 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:01.771 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:01.771 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:01.771 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:01.771 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:01.771 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:01.771 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:01.771 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:01.771 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:01.771 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:01.772 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:01.772 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:01.772 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:01.772 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:01.772 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:01.772 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:01.772 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:01.772 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:01.772 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:01.772 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:01.772 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:01.772 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:01.772 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:01.773 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:01.773 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:01.773 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:01.773 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:01.773 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:01.773 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:01.773 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:01.773 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:01.773 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:01.773 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:01.773 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:01.773 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:01 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:02.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:02.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:01 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:02.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:02.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:02.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:02.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:02.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:01 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:02.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:02.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:02.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:02.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:02.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:01 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:02.932 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2[141842]: 2024-06-18T02:14:02.729+0000 7fafcb261640 -1 osd.2 0 read_superblock omap replica is missing. 2024-06-18T02:14:02.932 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2[141842]: 2024-06-18T02:14:02.752+0000 7fafcb261640 -1 osd.2 138 log_to_monitors true 2024-06-18T02:14:02.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:02.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:02.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:02.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:02.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:02.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:02.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:02.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:02.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:02.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:02.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:02.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:02.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:02.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:02.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:02.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:02.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:02.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:02.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[99735]: pgmap v202: 161 pgs: 33 active+undersized, 14 active+undersized+degraded, 114 active+clean; 585 KiB data, 166 MiB used, 715 GiB / 715 GiB avail; 65/726 objects degraded (8.953%) 2024-06-18T02:14:02.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:02.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:02.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:02.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:02.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:02.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:02.934 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:02.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:02.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:02.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:02.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:02.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:02.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:02.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:02.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:02.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:02.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:02.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:02.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:02.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:02.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:02.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:02.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:02.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:02.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:02.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:02.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:02.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:02.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:02.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[113333]: pgmap v202: 161 pgs: 33 active+undersized, 14 active+undersized+degraded, 114 active+clean; 585 KiB data, 166 MiB used, 715 GiB / 715 GiB avail; 65/726 objects degraded (8.953%) 2024-06-18T02:14:02.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:02.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:02.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:02.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:02.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:02.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:02.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:02.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:02.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:02.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:02.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:02.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:02.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:02.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:02.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:02.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:02.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:02.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:02.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:02.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:02.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:02.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:02.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:02.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:02.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:02.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:02.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:02.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:02.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:02.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:02.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:02.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:02.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:02.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:02.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:02.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:02.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:02.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:02.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:02.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:02.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:02.941 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:02.941 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:02.941 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:02.941 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:02.941 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:02.941 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:02.941 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:02.941 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:02.941 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:02.941 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:02.941 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:02.941 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:02.942 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:02.942 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:02.942 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:02.942 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:02.942 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:02.942 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:02.942 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:02.942 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:02 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:03.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:02 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:03.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:02 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:03.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:02 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:03.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:02 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:03.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:02 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:03.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:02 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:03.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:03.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:03.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:03.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:03.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:02 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:03.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:02 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:03.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:03.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:03.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:03.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:03.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:02 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:03.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:02 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:03.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:02 smithi130 ceph-mon[84407]: pgmap v202: 161 pgs: 33 active+undersized, 14 active+undersized+degraded, 114 active+clean; 585 KiB data, 166 MiB used, 715 GiB / 715 GiB avail; 65/726 objects degraded (8.953%) 2024-06-18T02:14:03.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:03.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:03.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:03.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:03.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:02 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:03.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:02 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:03.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:03.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:03.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:03.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:03.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:02 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:03.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:03.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:03.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:03.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:03.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:02 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:03.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:03.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:03.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:03.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:03.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:02 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:03.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:03.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:03.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:03.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:03.049 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:02 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:03.049 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:03.049 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:03.049 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:03.049 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:03.049 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:02 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:03.049 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:03.049 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:03.049 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:03.049 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:03.049 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:02 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:03.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:03.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[113333]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:14:03.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:03.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:03.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:03.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:03.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:03.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[113333]: from='osd.2 [v2:172.21.15.7:6816/730135012,v1:172.21.15.7:6817/730135012]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-18T02:14:03.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:03.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:03.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:03.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:03.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:03.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:03.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[113333]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs inactive, 2 pgs peering) 2024-06-18T02:14:03.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:03.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:03.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:03.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:03.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:03.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:03.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:03.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:03.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:03.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:03.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:03.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:03.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:03.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:03.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:03.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[99735]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:14:03.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:03.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:03.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:03.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:03.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:03.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[99735]: from='osd.2 [v2:172.21.15.7:6816/730135012,v1:172.21.15.7:6817/730135012]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-18T02:14:03.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:03.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:03.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:03.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:03.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:03.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:03.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[99735]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs inactive, 2 pgs peering) 2024-06-18T02:14:03.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:03.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:03.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:03.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:03.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:03.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:03.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:03.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:03.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:03.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:03.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:03.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:03.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:03.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:03.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:03.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:03.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:03.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:03.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:03.937 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:03.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:03.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:03.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:03.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:03.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:03.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:03.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:03.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:03.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:03.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:03.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:03.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:03.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:03.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:03.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:03.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:03.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:03.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:03.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:03.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:03.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:03.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:03.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:03.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:03.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:03.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:03.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:03.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:03.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:03.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:03.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:03.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:03.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:03.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:03.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:03.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:03.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:03.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:03.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:03.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:04.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:03 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:04.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:03 smithi130 ceph-mon[84407]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:14:04.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:03 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:04.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:03 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:04.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:03 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:04.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:03 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:04.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:03 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:04.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:03 smithi130 ceph-mon[84407]: from='osd.2 [v2:172.21.15.7:6816/730135012,v1:172.21.15.7:6817/730135012]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-18T02:14:04.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:04.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:04.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:04.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:04.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:03 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:04.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:03 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:04.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:03 smithi130 ceph-mon[84407]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs inactive, 2 pgs peering) 2024-06-18T02:14:04.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:04.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:04.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:04.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:04.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:03 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:04.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:03 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:04.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:04.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:04.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:04.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:04.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:03 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:04.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:03 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:04.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:04.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:04.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:04.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:04.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:03 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:04.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:04.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:04.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:04.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:04.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:03 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:04.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:04.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:04.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:04.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:04.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:03 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:04.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:04.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:04.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:04.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:04.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:03 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:04.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:04.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:04.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:04.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:04.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:03 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:04.431 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:14:03 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2[141842]: 2024-06-18T02:14:03.998+0000 7fafbf004640 -1 osd.2 138 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-18T02:14:04.850 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:04.850 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:04.850 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:04.851 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:04.851 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:04.851 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[113333]: from='osd.2 [v2:172.21.15.7:6816/730135012,v1:172.21.15.7:6817/730135012]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-06-18T02:14:04.851 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[113333]: osdmap e141: 8 total, 7 up, 8 in 2024-06-18T02:14:04.851 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[113333]: from='osd.2 [v2:172.21.15.7:6816/730135012,v1:172.21.15.7:6817/730135012]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-06-18T02:14:04.851 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:04.851 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:04.851 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:04.851 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:04.851 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:04.851 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:04.851 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:04.851 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:04.851 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:04.852 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:04.852 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:04.852 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:04.852 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[113333]: pgmap v204: 161 pgs: 33 active+undersized, 14 active+undersized+degraded, 114 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 65/726 objects degraded (8.953%) 2024-06-18T02:14:04.852 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[113333]: from='osd.2 [v2:172.21.15.7:6816/730135012,v1:172.21.15.7:6817/730135012]' entity='osd.2' 2024-06-18T02:14:04.852 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:04.852 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:04.852 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:04.852 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:04.852 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:04.852 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:04.852 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:04.853 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:04.853 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:04.853 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:04.853 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:04.853 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:04.853 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[99735]: from='osd.2 [v2:172.21.15.7:6816/730135012,v1:172.21.15.7:6817/730135012]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-06-18T02:14:04.853 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[99735]: osdmap e141: 8 total, 7 up, 8 in 2024-06-18T02:14:04.853 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[99735]: from='osd.2 [v2:172.21.15.7:6816/730135012,v1:172.21.15.7:6817/730135012]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-06-18T02:14:04.853 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:04.853 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:04.853 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:04.853 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:04.853 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:04.854 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:04.854 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:04.854 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:04.854 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:04.854 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:04.854 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:04.854 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:04.854 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[99735]: pgmap v204: 161 pgs: 33 active+undersized, 14 active+undersized+degraded, 114 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 65/726 objects degraded (8.953%) 2024-06-18T02:14:04.854 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[99735]: from='osd.2 [v2:172.21.15.7:6816/730135012,v1:172.21.15.7:6817/730135012]' entity='osd.2' 2024-06-18T02:14:04.854 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:04.854 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:04.854 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:04.854 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:04.855 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:04.855 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:04.855 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:04.855 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:04.855 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:04.855 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:04.855 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:04.855 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:04.855 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:04.855 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:04.855 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:04.856 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:04.856 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:04.856 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:04.856 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:04.856 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:04.856 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:04.856 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:04.856 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:04.856 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:04.856 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:04.856 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:04.856 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[113333]: Health check update: Degraded data redundancy: 65/726 objects degraded (8.953%), 14 pgs degraded (PG_DEGRADED) 2024-06-18T02:14:04.856 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:04.856 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:04.856 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:04.857 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:04.857 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:04.857 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:04.857 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:04.857 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:04.857 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:04.857 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:04.857 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:04.857 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:04.857 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:04.858 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:04.858 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:04.858 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:04.858 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:04.858 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:04.858 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:04.858 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:04.858 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:04.858 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:04.858 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:04.858 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:04.858 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[99735]: Health check update: Degraded data redundancy: 65/726 objects degraded (8.953%), 14 pgs degraded (PG_DEGRADED) 2024-06-18T02:14:04.858 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:04.859 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:04.859 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:04.859 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:04.859 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:04 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:05.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:04 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:05.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:04 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:05.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:04 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:05.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:04 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:05.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:04 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:05.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:04 smithi130 ceph-mon[84407]: from='osd.2 [v2:172.21.15.7:6816/730135012,v1:172.21.15.7:6817/730135012]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-06-18T02:14:05.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:04 smithi130 ceph-mon[84407]: osdmap e141: 8 total, 7 up, 8 in 2024-06-18T02:14:05.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:04 smithi130 ceph-mon[84407]: from='osd.2 [v2:172.21.15.7:6816/730135012,v1:172.21.15.7:6817/730135012]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-06-18T02:14:05.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:05.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:05.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:05.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:05.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:04 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:05.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:04 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:05.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:05.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:05.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:05.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:05.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:04 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:05.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:04 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:05.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:04 smithi130 ceph-mon[84407]: pgmap v204: 161 pgs: 33 active+undersized, 14 active+undersized+degraded, 114 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 65/726 objects degraded (8.953%) 2024-06-18T02:14:05.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:04 smithi130 ceph-mon[84407]: from='osd.2 [v2:172.21.15.7:6816/730135012,v1:172.21.15.7:6817/730135012]' entity='osd.2' 2024-06-18T02:14:05.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:05.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:05.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:05.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:05.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:04 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:05.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:04 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:05.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:05.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:05.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:05.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:05.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:04 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:05.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:05.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:05.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:05.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:05.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:04 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:05.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:05.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:05.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:05.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:05.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:04 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:05.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:05.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:05.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:05.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:05.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:04 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:05.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:04 smithi130 ceph-mon[84407]: Health check update: Degraded data redundancy: 65/726 objects degraded (8.953%), 14 pgs degraded (PG_DEGRADED) 2024-06-18T02:14:05.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:05.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:05.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:05.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:05.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:04 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:06.000 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:06.000 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:06.000 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:06.000 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:06.000 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:06.000 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:06.000 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:06.000 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:06.000 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:06.001 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:06.001 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:06.001 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:06.001 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:06.001 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:06.001 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:06.001 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:06.001 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:06.001 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:06.001 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:06.001 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:06.001 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:06.001 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:06.001 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:06.002 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-06-18T02:14:06.002 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: osd.2 [v2:172.21.15.7:6816/730135012,v1:172.21.15.7:6817/730135012] boot 2024-06-18T02:14:06.002 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: osdmap e142: 8 total, 8 up, 8 in 2024-06-18T02:14:06.002 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-18T02:14:06.002 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:06.002 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:06.002 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:06.002 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:06.003 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:06.003 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:06.003 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:06.003 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:06.003 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:06.003 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:06.003 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:06.003 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:06.003 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:06.003 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:06.004 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:06.004 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:06.004 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:06.004 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:06.004 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:06.004 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:06.004 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:06.004 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:06.004 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:06.004 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:06.004 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:06.004 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:06.004 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:06.004 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-06-18T02:14:06.004 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: osd.2 [v2:172.21.15.7:6816/730135012,v1:172.21.15.7:6817/730135012] boot 2024-06-18T02:14:06.004 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: osdmap e142: 8 total, 8 up, 8 in 2024-06-18T02:14:06.005 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-18T02:14:06.005 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:06.005 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:06.005 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:06.005 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:06.005 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:06.005 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:06.005 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:06.005 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:06.005 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:06.005 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:06.006 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:06.006 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:06.006 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:06.006 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:06.006 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:06.006 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:06.006 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:06.006 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:06.006 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:06.006 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:06.006 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:06.006 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:06.007 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:06.007 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:06.007 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:06.007 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:06.007 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:06.007 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:06.007 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:06.007 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:06.007 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:06.007 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:06.007 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:06.007 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:06.008 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:06.008 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:06.008 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:06.008 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:06.008 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:06.008 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:06.008 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:06.008 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:06.008 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:06.008 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:06.008 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:06.008 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:06.008 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:06.008 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:06.009 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:06.009 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:06.009 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:06.009 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:06.009 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:06.009 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:06.009 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:06.009 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:06.009 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:06.009 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:05 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:06.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:06.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:06.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:06.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:06.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:06.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:06.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:06.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:06.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:06.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:06.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:06.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:06.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:06.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:06.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:06.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:06.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:06.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:06.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:06.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:06.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:06.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:06.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:06.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-06-18T02:14:06.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: osd.2 [v2:172.21.15.7:6816/730135012,v1:172.21.15.7:6817/730135012] boot 2024-06-18T02:14:06.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: osdmap e142: 8 total, 8 up, 8 in 2024-06-18T02:14:06.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-18T02:14:06.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:06.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:06.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:06.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:06.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:06.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:06.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:06.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:06.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:06.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:06.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:06.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:06.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:06.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:06.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:06.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:06.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:06.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:06.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:06.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:06.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:06.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:06.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:06.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:06.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:06.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:06.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:06.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:06.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:06.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:06.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:05 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:06.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:06.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:06.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:06.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:06.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:06.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:06.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:06.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:06.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:06.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:06.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:06.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:06.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:06.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:06.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:06.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:06.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:06.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[113333]: pgmap v206: 161 pgs: 5 peering, 30 active+undersized, 12 active+undersized+degraded, 114 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 43/726 objects degraded (5.923%) 2024-06-18T02:14:06.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:06.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:06.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:06.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:06.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:06.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:06.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[113333]: osdmap e143: 8 total, 8 up, 8 in 2024-06-18T02:14:06.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:06.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:06.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:06.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:06.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:06.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:06.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:06.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:06.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:06.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:06.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:06.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:06.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:06.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:06.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:06.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:06.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:06.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:06.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:06.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:06.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:06.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:06.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[99735]: pgmap v206: 161 pgs: 5 peering, 30 active+undersized, 12 active+undersized+degraded, 114 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 43/726 objects degraded (5.923%) 2024-06-18T02:14:06.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:06.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:06.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:06.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:06.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:06.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:06.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[99735]: osdmap e143: 8 total, 8 up, 8 in 2024-06-18T02:14:06.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:06.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:06.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:06.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:06.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:06.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:06.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:06.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:06.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:06.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:06.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:06.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:06.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:06.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:06.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:06.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:06.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:06.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:06.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:06.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:06.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:06.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:06.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:06.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:06.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:06.939 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:06.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:06.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:06.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:06.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:06.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:06.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:06.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:06.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:06.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:06.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:06.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:06.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:06.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:06.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:06.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:06.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:06.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:06.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:06.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:06.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:06.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:06.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:06.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:06.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:06.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:06.941 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:06.942 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:06.942 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:06.942 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:06.942 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:06.942 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:06 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:07.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:06 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:07.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:06 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:07.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:06 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:07.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:06 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:07.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:06 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:07.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:07.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:07.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:07.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:07.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:06 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:07.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:06 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:07.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:07.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:07.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:07.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:07.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:06 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:07.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:06 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:07.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:06 smithi130 ceph-mon[84407]: pgmap v206: 161 pgs: 5 peering, 30 active+undersized, 12 active+undersized+degraded, 114 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 43/726 objects degraded (5.923%) 2024-06-18T02:14:07.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:07.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:07.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:07.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:07.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:06 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:07.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:06 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:07.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:06 smithi130 ceph-mon[84407]: osdmap e143: 8 total, 8 up, 8 in 2024-06-18T02:14:07.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:07.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:07.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:07.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:07.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:06 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:07.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:07.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:07.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:07.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:07.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:06 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:07.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:06 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:07.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:07.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:07.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:07.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:07.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:06 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:07.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:07.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:07.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:07.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:07.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:06 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:07.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:07.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:07.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:07.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:07.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:06 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:07.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:07.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:07.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:07.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:07.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:06 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:08.043 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:14:07 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:14:07] "GET /metrics HTTP/1.1" 200 38405 "" "Prometheus/2.33.4" 2024-06-18T02:14:08.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:07 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:08.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:07 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:08.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:07 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:08.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:07 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:08.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:07 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:08.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:07 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:08.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:08.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:08.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:08.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:08.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:07 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:08.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:07 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:08.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:08.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:08.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:08.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:08.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:07 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:08.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:07 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:08.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:08.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:08.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:08.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:08.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:07 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:08.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:07 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:08.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:08.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:08.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:08.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:08.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:07 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:08.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:08.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:08.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:08.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:08.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:07 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:08.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:08.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:08.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:08.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:08.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:07 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:08.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:08.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:08.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:08.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:08.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:07 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:08.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:08.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:08.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:08.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:08.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:07 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:08.157 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:08.157 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:08.158 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:08.158 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:08.158 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:08.158 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:08.158 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:08.158 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:08.158 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:08.158 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:08.158 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:08.158 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:08.158 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:08.158 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:08.158 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:08.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:08.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:08.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:08.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:08.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:08.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:08.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:08.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:08.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:08.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:08.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:08.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:08.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:08.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:08.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:08.159 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:08.160 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:08.160 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:08.160 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:08.160 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:08.160 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:08.160 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:08.160 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:08.160 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:08.160 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:08.160 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:08.160 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:08.160 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:08.160 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:08.160 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:08.160 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:08.160 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:08.161 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:08.161 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:08.161 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:08.161 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:08.161 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:08.161 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:08.161 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:08.161 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:08.161 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:08.161 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:08.162 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:08.162 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:08.162 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:08.162 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:08.162 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:08.162 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:08.162 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:08.162 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:08.162 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:08.162 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:08.162 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:08.162 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:08.162 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:08.162 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:08.163 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:08.163 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:08.163 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:08.163 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:08.163 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:08.163 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:08.163 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:08.163 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:08.163 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:08.163 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:08.163 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:08.163 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:08.163 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:08.163 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:08.163 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:08.164 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:08.164 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:08.164 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:08.164 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:08.164 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:08.164 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:08.164 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:08.164 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:08.164 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:08.164 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:08.164 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:08.164 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:07 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:09.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:08 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:09.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:08 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:09.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:08 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:09.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:08 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:09.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:08 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:09.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:09.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:09.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:09.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:09.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:08 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:09.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:08 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:09.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:09.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:09.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:09.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:09.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:08 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:09.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:08 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:09.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:08 smithi130 ceph-mon[84407]: pgmap v208: 161 pgs: 5 peering, 17 active+undersized, 4 active+undersized+degraded, 135 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 9/726 objects degraded (1.240%) 2024-06-18T02:14:09.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:09.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:09.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:09.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:09.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:08 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:09.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:08 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:09.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:09.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:09.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:09.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:09.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:08 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:09.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:08 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:09.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:09.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:09.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:09.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:09.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:08 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:09.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:09.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:09.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:09.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:09.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:08 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:09.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:09.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:09.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:09.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:09.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:08 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:09.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:09.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:09.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:09.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:09.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:08 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:09.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:09.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:09.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:09.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:09.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:08 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:09.125 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:09.125 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:09.125 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:09.125 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:09.125 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:09.125 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:09.125 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:09.125 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:09.125 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:09.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:09.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:09.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:09.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:09.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:09.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:09.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:09.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:09.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[113333]: pgmap v208: 161 pgs: 5 peering, 17 active+undersized, 4 active+undersized+degraded, 135 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 9/726 objects degraded (1.240%) 2024-06-18T02:14:09.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:09.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:09.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:09.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:09.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:09.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:09.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:09.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:09.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:09.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:09.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:09.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:09.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:09.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:09.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:09.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:09.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:09.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:09.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:09.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:09.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:09.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:09.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:09.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:09.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:09.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:09.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:09.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:09.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:09.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:09.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:09.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:09.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:09.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:09.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:09.129 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:09.129 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:09.129 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:09.129 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:09.129 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:09.129 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:09.129 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:09.129 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:09.129 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:09.129 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:09.129 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:09.130 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:09.130 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:09.130 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:09.130 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:09.130 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:09.130 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:09.130 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:09.130 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:09.130 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[99735]: pgmap v208: 161 pgs: 5 peering, 17 active+undersized, 4 active+undersized+degraded, 135 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 9/726 objects degraded (1.240%) 2024-06-18T02:14:09.130 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:09.130 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:09.130 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:09.130 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:09.130 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:09.131 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:09.131 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:09.131 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:09.131 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:09.131 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:09.131 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:09.131 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:09.131 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:09.131 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:09.131 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:09.131 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:09.131 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:09.131 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:09.131 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:09.131 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:09.131 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:09.132 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:09.132 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:09.132 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:09.132 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:09.132 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:09.132 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:09.132 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:09.132 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:09.132 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:09.132 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:09.132 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:09.132 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:09.132 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:09.132 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:09.132 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:09.133 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:08 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:09.977 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:09 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:09.977 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:09 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:09.977 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:09 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:09.977 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:09 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:09.977 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:09 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:09.977 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:09.977 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:09.977 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:09.977 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:09.978 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:09 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:09.978 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:09 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:09.978 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:09.978 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:09.978 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:09.978 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:09.978 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:09 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:09.978 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:09 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:09.978 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:09.978 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:09.978 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:09.978 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:09.978 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:09 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:09.978 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:09 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:09.979 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:09.979 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:09.979 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:09.979 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:09.979 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:09 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:09.979 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:09.979 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:09.980 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:09.980 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:09.980 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:09.980 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:09.980 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:09.980 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:09.980 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:09.980 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:09.980 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:09.980 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:09.980 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:09.981 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:09.981 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:09.981 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:09.981 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:09.981 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:09.981 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:09.981 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:09.981 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:09.981 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:09.981 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:09.981 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:09.981 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:09.981 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:09.981 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:09.982 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:09.982 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:09.982 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:09.982 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:09.982 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:09.982 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:09.982 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:09.983 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:09 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:09.983 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:09.983 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:09.983 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:09.983 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:09.983 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:09 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:09.983 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:09.983 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:09.983 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:09.983 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:09.983 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:09 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:09.983 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:09 smithi130 ceph-mon[84407]: Health check update: Degraded data redundancy: 9/726 objects degraded (1.240%), 4 pgs degraded (PG_DEGRADED) 2024-06-18T02:14:09.983 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:09.983 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:09.984 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:09.984 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:09.984 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:09 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:09.984 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:09.984 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:09.984 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:09.984 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:09.984 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:09 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:09.985 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:09.985 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:09.985 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:09.985 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:09.985 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:09.985 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:09.985 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:09.985 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:09.985 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:09.985 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:09.986 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:09.986 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:09.986 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:09.986 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:09.986 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:09.986 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:09.986 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:09.986 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:09.986 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:09.986 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:09.986 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:09.986 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:09.986 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:09.987 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:09.987 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:09.987 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:09.987 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:09.987 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:09.987 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:09.987 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:09.987 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:09.987 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:09.987 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:09.987 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:09.987 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:09.987 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:09.987 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:09.988 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:09.988 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:09.988 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:09.988 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:09.988 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:09.988 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:09.988 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[113333]: Health check update: Degraded data redundancy: 9/726 objects degraded (1.240%), 4 pgs degraded (PG_DEGRADED) 2024-06-18T02:14:09.988 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:09.988 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:09.988 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:09.988 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:09.988 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:09.988 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:09.989 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:09.989 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:09.989 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:09.989 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:09.989 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:09.989 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:09.989 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:09.989 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:09.989 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:09.989 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:09.990 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:09.990 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:09.990 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:09.990 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:09.990 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:09.990 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:09.990 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:09.990 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[99735]: Health check update: Degraded data redundancy: 9/726 objects degraded (1.240%), 4 pgs degraded (PG_DEGRADED) 2024-06-18T02:14:09.990 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:09.990 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:09.990 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:09.990 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:09.990 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:09.991 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:09.991 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:09.991 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:09.991 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:09.991 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:09 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:11.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:10 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:11.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:10 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:11.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:10 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:11.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:10 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:11.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:10 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:11.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:10 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:11.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:11.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:11.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:11.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:11.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:10 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:11.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:10 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:11.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:11.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:11.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:11.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:11.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:10 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:11.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:10 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:11.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:10 smithi130 ceph-mon[84407]: pgmap v209: 161 pgs: 5 peering, 5 active+undersized, 2 active+undersized+degraded, 149 active+clean; 585 KiB data, 185 MiB used, 715 GiB / 715 GiB avail; 821 B/s rd, 0 op/s; 7/726 objects degraded (0.964%) 2024-06-18T02:14:11.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:11.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:11.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:11.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:11.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:10 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:11.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:10 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:11.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:11.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:11.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:11.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:11.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:10 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:11.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:11.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:11.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:11.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:11.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:10 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:11.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:11.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:11.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:11.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:11.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:10 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:11.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:11.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:11.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:11.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:11.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:10 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:11.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:11.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:11.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:11.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:11.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:10 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:11.052 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:11.052 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:11.052 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:11.053 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:11.053 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:11.053 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:11.053 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:11.053 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:11.053 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:11.053 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:11.053 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:11.053 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:11.053 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:11.053 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:11.053 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:11.053 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:11.054 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:11.054 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:11.054 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[99735]: pgmap v209: 161 pgs: 5 peering, 5 active+undersized, 2 active+undersized+degraded, 149 active+clean; 585 KiB data, 185 MiB used, 715 GiB / 715 GiB avail; 821 B/s rd, 0 op/s; 7/726 objects degraded (0.964%) 2024-06-18T02:14:11.054 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:11.054 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:11.054 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:11.054 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:11.054 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:11.054 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:11.054 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:11.054 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:11.054 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:11.055 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:11.055 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:11.055 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:11.055 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:11.055 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:11.055 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:11.056 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:11.056 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:11.056 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:11.056 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:11.056 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:11.056 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:11.056 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:11.056 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:11.056 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:11.056 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:11.056 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:11.056 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:11.056 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:11.056 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:11.057 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[113333]: pgmap v209: 161 pgs: 5 peering, 5 active+undersized, 2 active+undersized+degraded, 149 active+clean; 585 KiB data, 185 MiB used, 715 GiB / 715 GiB avail; 821 B/s rd, 0 op/s; 7/726 objects degraded (0.964%) 2024-06-18T02:14:11.057 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:11.057 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:11.057 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:11.057 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:11.057 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:11.057 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:11.057 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:11.057 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:11.057 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:11.057 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:11.057 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:11.058 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:11.058 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:11.058 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:11.058 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:11.058 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:11.058 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:11.058 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:11.058 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:11.058 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:11.058 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:11.059 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:11.059 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:11.059 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:11.059 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:11.059 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:11.059 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:11.059 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:11.060 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:11.060 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:11.060 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:11.060 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:11.060 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:11.060 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:11.060 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:11.060 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:11.060 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:11.060 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:11.060 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:11.060 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:11.060 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:11.061 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:11.061 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:11.061 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:11.061 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:11.061 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:11.061 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:11.061 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:11.061 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:11.061 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:11.061 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:10 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:11.835 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:11.836 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:11.836 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:11.836 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:11.836 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:11.836 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:11.836 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:11.836 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:11.836 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:11.836 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:11.836 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:11.836 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:11.836 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:11.836 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:11.837 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:11.837 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:11.837 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:11.837 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:11.837 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:11.837 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:11.837 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:11.837 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:11.837 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:11.837 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:11.837 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:11.837 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:11.837 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:11.837 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:11.838 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:11.838 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:11.838 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:11.838 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:11.838 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:11.838 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:11.838 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:11.838 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:11.838 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:11.838 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:11.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:11.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:11.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:11.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:11.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:11.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:11.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:11.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:11.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:11.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:11.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:11.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:11.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:11.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:11.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:11.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:11.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:11.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:11.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:11.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:11.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:11.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:11.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:11.840 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:11.840 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:11.841 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:11.841 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:11.841 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:14:11.841 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:11.841 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:11.841 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:11.841 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:11.841 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:11.841 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:11.841 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:11.841 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:11.841 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:11.841 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:11.841 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:11.842 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:11.842 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:11.842 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:11.842 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:11.842 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:11.842 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:11.842 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:11.842 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:11.842 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:11.842 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:14:11.842 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:11.843 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:11.843 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:11.843 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:11.843 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:11.843 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:11.843 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:11.843 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:11.843 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:11.843 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:11.843 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:11.843 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:11.843 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:11.843 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:11.843 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:11 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:12.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:11 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:12.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:11 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:12.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:11 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:12.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:11 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:12.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:11 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:12.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:12.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:12.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:12.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:12.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:11 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:12.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:11 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:12.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:12.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:12.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:12.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:12.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:11 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:12.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:11 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:12.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:12.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:12.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:12.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:12.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:11 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:12.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:11 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:12.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:12.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:12.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:12.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:12.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:11 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:12.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:11 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:12.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:12.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:12.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:12.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:12.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:11 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:12.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:11 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:12.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:14:12.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:12.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:12.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:12.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:12.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:11 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:12.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:12.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:12.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:12.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:12.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:11 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:12.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:12.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:12.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:12.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:12.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:11 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:12.731 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:12.731 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:12.731 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:12.731 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:12.732 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:12.732 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:12.732 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:12.732 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:12.732 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:12.732 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:12.732 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:12.732 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:12.732 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:12.732 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:12.732 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:12.732 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:12.732 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[113333]: pgmap v210: 161 pgs: 161 active+clean; 585 KiB data, 185 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-06-18T02:14:12.732 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:12.732 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:12.732 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:12.733 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:12.733 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:12.733 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:12.733 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:12.733 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:12.733 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:12.733 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:12.733 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:12.733 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:12.733 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:12.733 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:12.733 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:12.733 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:12.733 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:12.734 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:12.734 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:12.734 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:12.734 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:12.734 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:12.734 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:12.734 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:12.734 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:12.734 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:12.734 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:12.734 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:12.734 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:12.734 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:12.735 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:12.735 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:12.735 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:12.735 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:12.735 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:12.735 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:12.735 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:12.735 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:12.735 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:12.735 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:12.736 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:12.736 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:12.736 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:12.736 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:12.736 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:12.736 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:12.736 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:12.736 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:12.736 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:12.736 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:12.736 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:12.736 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:12.736 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[99735]: pgmap v210: 161 pgs: 161 active+clean; 585 KiB data, 185 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-06-18T02:14:12.736 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:12.737 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:12.737 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:12.737 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:12.737 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:12.737 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:12.737 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:12.737 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:12.737 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:12.737 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:12.737 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:12.737 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:12.737 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:12.737 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:12.738 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:12.738 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:12.738 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:12.738 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:12.738 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:12.738 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:12.738 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:12.738 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:12.738 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:12.738 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:12.738 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:12.738 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:12.738 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:12.738 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:12.739 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:12.739 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:12.739 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:12.739 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:12.739 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:12.739 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:12.739 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:12.739 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:12 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:12.973 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:12 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:12.973 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:12 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:12.973 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:12 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:12.973 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:12 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:12.973 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:12.973 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:12.974 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:12.974 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:12.974 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:12 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:12.974 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:12 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:12.974 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:12.974 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:12.974 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:12.974 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:12.974 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:12 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:12.974 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:12 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:12.974 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:12 smithi130 ceph-mon[84407]: pgmap v210: 161 pgs: 161 active+clean; 585 KiB data, 185 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-06-18T02:14:12.974 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:12.975 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:12.975 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:12.975 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:12.975 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:12 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:12.975 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:12 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:12.975 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:12.975 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:12.975 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:12.975 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:12.975 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:12 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:12.975 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:12.975 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:12.975 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:12.975 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:12.975 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:12 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:12.976 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:12.976 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:12.976 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:12.976 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:12.976 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:12 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:12.976 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:12.976 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:12.976 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:12.976 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:12.976 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:12 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:12.976 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:12.976 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:12.976 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:12.976 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:12.976 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:12 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:12.977 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:12.977 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:12.977 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:12.977 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:12.977 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:12 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:14.118 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:13 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:14.119 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:13 smithi007 ceph-mon[113333]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:14:14.119 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:13 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:14.119 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:13 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:14.119 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:13 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:14.119 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:13 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:14.119 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:13 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:14.119 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:13 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:14.119 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:13 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:14.119 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:14.119 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:14.119 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:13 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:14.119 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:14.120 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:14.120 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-06-18T02:14:14.120 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:13 smithi007 ceph-mon[113333]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-06-18T02:14:14.120 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:13 smithi007 ceph-mon[113333]: Upgrade: osd.2 is safe to restart 2024-06-18T02:14:14.120 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:13 smithi007 ceph-mon[113333]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/726 objects degraded (0.964%), 2 pgs degraded) 2024-06-18T02:14:14.120 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:13 smithi007 ceph-mon[113333]: Cluster is now healthy 2024-06-18T02:14:14.120 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:13 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:14.120 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:13 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:14.120 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:13 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:14.120 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:13 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:14.121 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:13 smithi007 ceph-mon[99735]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:14:14.121 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:13 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:14.121 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:13 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:14.121 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:13 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:14.121 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:13 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:14.121 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:13 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:14.121 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:13 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:14.121 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:13 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:14.121 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:14.121 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:14.121 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:13 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:14.121 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:14.121 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:14.121 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-06-18T02:14:14.122 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:13 smithi007 ceph-mon[99735]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-06-18T02:14:14.122 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:13 smithi007 ceph-mon[99735]: Upgrade: osd.2 is safe to restart 2024-06-18T02:14:14.122 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:13 smithi007 ceph-mon[99735]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/726 objects degraded (0.964%), 2 pgs degraded) 2024-06-18T02:14:14.122 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:13 smithi007 ceph-mon[99735]: Cluster is now healthy 2024-06-18T02:14:14.122 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:13 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:14.122 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:13 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:14.122 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:13 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:14.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:13 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:14.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:13 smithi130 ceph-mon[84407]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:14:14.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:13 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:14.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:13 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:14.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:13 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:14.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:13 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:14.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:13 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:14.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:13 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:14.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:13 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:14.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:14.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:14.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:13 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:14.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:14.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:14.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-06-18T02:14:14.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:13 smithi130 ceph-mon[84407]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-06-18T02:14:14.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:13 smithi130 ceph-mon[84407]: Upgrade: osd.2 is safe to restart 2024-06-18T02:14:14.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:13 smithi130 ceph-mon[84407]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/726 objects degraded (0.964%), 2 pgs degraded) 2024-06-18T02:14:14.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:13 smithi130 ceph-mon[84407]: Cluster is now healthy 2024-06-18T02:14:14.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:13 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:14.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:13 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:14.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:13 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:15.107 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:14 smithi007 ceph-mon[113333]: pgmap v211: 161 pgs: 161 active+clean; 585 KiB data, 185 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-06-18T02:14:15.107 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:14 smithi007 ceph-mon[99735]: pgmap v211: 161 pgs: 161 active+clean; 585 KiB data, 185 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-06-18T02:14:15.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:14 smithi130 ceph-mon[84407]: pgmap v211: 161 pgs: 161 active+clean; 585 KiB data, 185 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-06-18T02:14:15.702 INFO:teuthology.orchestra.run.smithi007.stdout:true 2024-06-18T02:14:16.131 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-06-18T02:14:16.132 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:16.132 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-06-18T02:14:16.132 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:16.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-06-18T02:14:16.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:16.401 INFO:teuthology.orchestra.run.smithi007.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-18T02:14:16.401 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi007 smithi007 running 0s ago 17m - - 2024-06-18T02:14:16.401 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi130 smithi130 running 2s ago 17m - - 2024-06-18T02:14:16.401 INFO:teuthology.orchestra.run.smithi007.stdout:alertmanager.a smithi007 *:9093,9094 running (7m) 0s ago 12m 23.2M - 0.23.0 ba2b418f427c 5994e8525c64 2024-06-18T02:14:16.401 INFO:teuthology.orchestra.run.smithi007.stdout:grafana.a smithi130 *:3000 running (6m) 2s ago 11m 49.8M - 8.3.5 dad864ee21e9 70ba81d97c8e 2024-06-18T02:14:16.401 INFO:teuthology.orchestra.run.smithi007.stdout:iscsi.foo.smithi007.xvdrwd smithi007 running (5m) 0s ago 10m 57.8M - 3.5 e1d6a67b021e 94121ad2702c 2024-06-18T02:14:16.401 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.x smithi130 *:8443,9283,8765 running (6m) 2s ago 16m 527M - 19.0.0-3124-g3781e3a5 af93c036e016 01017e37bdbe 2024-06-18T02:14:16.401 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.y smithi007 *:8443,9283,8765 running (4m) 0s ago 18m 442M - 19.0.0-3124-g3781e3a5 af93c036e016 2141e131e896 2024-06-18T02:14:16.401 INFO:teuthology.orchestra.run.smithi007.stdout:mon.a smithi007 running (2m) 0s ago 18m 49.8M 2048M 19.0.0-3124-g3781e3a5 af93c036e016 7bbe646cd5b7 2024-06-18T02:14:16.401 INFO:teuthology.orchestra.run.smithi007.stdout:mon.b smithi130 running (3m) 2s ago 16m 48.6M 2048M 19.0.0-3124-g3781e3a5 af93c036e016 baacf2add994 2024-06-18T02:14:16.401 INFO:teuthology.orchestra.run.smithi007.stdout:mon.c smithi007 running (3m) 0s ago 17m 50.7M 2048M 19.0.0-3124-g3781e3a5 af93c036e016 39418356156e 2024-06-18T02:14:16.401 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.a smithi007 *:9100 running (7m) 0s ago 12m 17.8M - 1.3.1 1dbe0e931976 8128e558f099 2024-06-18T02:14:16.402 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.b smithi130 *:9100 running (6m) 2s ago 12m 19.3M - 1.3.1 1dbe0e931976 bab93b43cf16 2024-06-18T02:14:16.402 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0 smithi007 running (91s) 0s ago 16m 46.6M 4096M 19.0.0-3124-g3781e3a5 af93c036e016 07c7f4afd49a 2024-06-18T02:14:16.402 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1 smithi007 running (40s) 0s ago 15m 42.6M 4096M 19.0.0-3124-g3781e3a5 af93c036e016 e8d184614e94 2024-06-18T02:14:16.402 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2 smithi007 running (17s) 0s ago 15m 12.9M 4096M 19.0.0-3124-g3781e3a5 af93c036e016 f3ae8409a895 2024-06-18T02:14:16.402 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3 smithi007 running (15m) 0s ago 15m 62.7M 4096M 17.2.0 e1d6a67b021e 8b91b2a07564 2024-06-18T02:14:16.402 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4 smithi130 running (14m) 2s ago 14m 63.8M 4096M 17.2.0 e1d6a67b021e c428dccffdf0 2024-06-18T02:14:16.402 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5 smithi130 running (14m) 2s ago 14m 61.9M 4096M 17.2.0 e1d6a67b021e f645d7f12378 2024-06-18T02:14:16.402 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6 smithi130 running (13m) 2s ago 13m 56.5M 4096M 17.2.0 e1d6a67b021e c7af86c14959 2024-06-18T02:14:16.402 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7 smithi130 running (13m) 2s ago 13m 60.9M 4096M 17.2.0 e1d6a67b021e 3688af8b2c46 2024-06-18T02:14:16.402 INFO:teuthology.orchestra.run.smithi007.stdout:prometheus.a smithi130 *:9095 running (5m) 2s ago 12m 75.8M - 2.33.4 514e6a882f6e e905fb2eb4a6 2024-06-18T02:14:16.402 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi007.dvbvbk smithi007 *:8000 running (11m) 0s ago 11m 77.5M - 17.2.0 e1d6a67b021e 1344b55b763c 2024-06-18T02:14:16.402 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi130.aakmof smithi130 *:8000 running (11m) 2s ago 11m 75.3M - 17.2.0 e1d6a67b021e e257e3230c6c 2024-06-18T02:14:16.402 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi007.hgrnmk smithi007 *:80 running (10m) 0s ago 10m 75.6M - 17.2.0 e1d6a67b021e 2173947bc4d6 2024-06-18T02:14:16.403 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi130.wwebfk smithi130 *:80 running (10m) 2s ago 10m 77.3M - 17.2.0 e1d6a67b021e 8662706b2231 2024-06-18T02:14:16.818 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:14:16.818 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": { 2024-06-18T02:14:16.818 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 3 2024-06-18T02:14:16.818 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:14:16.818 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": { 2024-06-18T02:14:16.818 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 2 2024-06-18T02:14:16.819 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:14:16.819 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": { 2024-06-18T02:14:16.819 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 5, 2024-06-18T02:14:16.819 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 3 2024-06-18T02:14:16.819 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:14:16.819 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw": { 2024-06-18T02:14:16.819 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-06-18T02:14:16.819 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:14:16.819 INFO:teuthology.orchestra.run.smithi007.stdout: "overall": { 2024-06-18T02:14:16.819 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 9, 2024-06-18T02:14:16.819 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 8 2024-06-18T02:14:16.819 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-06-18T02:14:16.819 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:14:17.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:16 smithi007 ceph-mon[113333]: Upgrade: Updating osd.2 2024-06-18T02:14:17.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:16 smithi007 ceph-mon[113333]: Deploying daemon osd.2 on smithi007 2024-06-18T02:14:17.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:16 smithi007 ceph-mon[113333]: from='client.54319 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:14:17.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:16 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:17.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:16 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:17.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:16 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:17.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:16 smithi007 ceph-mon[113333]: pgmap v212: 161 pgs: 161 active+clean; 585 KiB data, 185 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-06-18T02:14:17.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:16 smithi007 ceph-mon[113333]: from='client.54325 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:14:17.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:16 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:17.069 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:16 smithi007 ceph-mon[113333]: from='client.? 172.21.15.7:0/1844734297' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:17.069 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:16 smithi007 ceph-mon[99735]: Upgrade: Updating osd.2 2024-06-18T02:14:17.069 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:16 smithi007 ceph-mon[99735]: Deploying daemon osd.2 on smithi007 2024-06-18T02:14:17.069 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:16 smithi007 ceph-mon[99735]: from='client.54319 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:14:17.069 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:16 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:17.069 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:16 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:17.069 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:16 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:17.069 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:16 smithi007 ceph-mon[99735]: pgmap v212: 161 pgs: 161 active+clean; 585 KiB data, 185 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-06-18T02:14:17.070 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:16 smithi007 ceph-mon[99735]: from='client.54325 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:14:17.070 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:16 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:17.070 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:16 smithi007 ceph-mon[99735]: from='client.? 172.21.15.7:0/1844734297' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:17.177 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:14:17.177 INFO:teuthology.orchestra.run.smithi007.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00", 2024-06-18T02:14:17.177 INFO:teuthology.orchestra.run.smithi007.stdout: "in_progress": true, 2024-06-18T02:14:17.177 INFO:teuthology.orchestra.run.smithi007.stdout: "which": "Upgrading all daemon types on all hosts", 2024-06-18T02:14:17.177 INFO:teuthology.orchestra.run.smithi007.stdout: "services_complete": [ 2024-06-18T02:14:17.177 INFO:teuthology.orchestra.run.smithi007.stdout: "mon", 2024-06-18T02:14:17.177 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr" 2024-06-18T02:14:17.178 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-06-18T02:14:17.178 INFO:teuthology.orchestra.run.smithi007.stdout: "progress": "8/23 daemons upgraded", 2024-06-18T02:14:17.178 INFO:teuthology.orchestra.run.smithi007.stdout: "message": "Currently upgrading osd daemons", 2024-06-18T02:14:17.178 INFO:teuthology.orchestra.run.smithi007.stdout: "is_paused": false 2024-06-18T02:14:17.178 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:14:17.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:16 smithi130 ceph-mon[84407]: Upgrade: Updating osd.2 2024-06-18T02:14:17.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:16 smithi130 ceph-mon[84407]: Deploying daemon osd.2 on smithi007 2024-06-18T02:14:17.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:16 smithi130 ceph-mon[84407]: from='client.54319 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:14:17.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:16 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:17.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:16 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:17.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:16 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:17.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:16 smithi130 ceph-mon[84407]: pgmap v212: 161 pgs: 161 active+clean; 585 KiB data, 185 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-06-18T02:14:17.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:16 smithi130 ceph-mon[84407]: from='client.54325 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:14:17.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:16 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:17.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:16 smithi130 ceph-mon[84407]: from='client.? 172.21.15.7:0/1844734297' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:17.594 INFO:teuthology.orchestra.run.smithi007.stdout:HEALTH_OK 2024-06-18T02:14:18.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:17 smithi007 ceph-mon[113333]: from='client.94287 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:14:18.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:17 smithi007 ceph-mon[113333]: from='client.? 172.21.15.7:0/2120374192' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:14:18.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:17 smithi007 ceph-mon[99735]: from='client.94287 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:14:18.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:17 smithi007 ceph-mon[99735]: from='client.? 172.21.15.7:0/2120374192' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:14:18.195 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:17 smithi130 ceph-mon[84407]: from='client.94287 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:14:18.195 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:17 smithi130 ceph-mon[84407]: from='client.? 172.21.15.7:0/2120374192' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:14:18.195 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:14:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:14:17] "GET /metrics HTTP/1.1" 200 38412 "" "Prometheus/2.33.4" 2024-06-18T02:14:19.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:18 smithi007 ceph-mon[113333]: from='client.54343 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:14:19.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:18 smithi007 ceph-mon[113333]: pgmap v213: 161 pgs: 161 active+clean; 585 KiB data, 185 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-06-18T02:14:19.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:18 smithi007 ceph-mon[99735]: from='client.54343 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:14:19.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:18 smithi007 ceph-mon[99735]: pgmap v213: 161 pgs: 161 active+clean; 585 KiB data, 185 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-06-18T02:14:19.215 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:18 smithi130 ceph-mon[84407]: from='client.54343 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:14:19.216 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:18 smithi130 ceph-mon[84407]: pgmap v213: 161 pgs: 161 active+clean; 585 KiB data, 185 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-06-18T02:14:20.545 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:14:20 smithi007 systemd[1]: Stopping Ceph osd.2 for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:14:20.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:20 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:20.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:20 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:20.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:20 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:20.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:20 smithi007 ceph-mon[113333]: pgmap v214: 161 pgs: 161 active+clean; 585 KiB data, 185 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:14:20.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:20 smithi007 ceph-mon[113333]: osd.2 marked itself down and dead 2024-06-18T02:14:20.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:20 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:20.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:20 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:20.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:20 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:20.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:20 smithi007 ceph-mon[99735]: pgmap v214: 161 pgs: 161 active+clean; 585 KiB data, 185 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:14:20.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:20 smithi007 ceph-mon[99735]: osd.2 marked itself down and dead 2024-06-18T02:14:20.933 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:14:20 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2[141842]: 2024-06-18T02:14:20.618+0000 7fafc81f9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-18T02:14:20.933 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:14:20 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2[141842]: 2024-06-18T02:14:20.618+0000 7fafc81f9640 -1 osd.2 143 *** Got signal Terminated *** 2024-06-18T02:14:20.933 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:14:20 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2[141842]: 2024-06-18T02:14:20.618+0000 7fafc81f9640 -1 osd.2 143 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-18T02:14:21.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:20 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:21.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:20 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:21.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:20 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:21.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:20 smithi130 ceph-mon[84407]: pgmap v214: 161 pgs: 161 active+clean; 585 KiB data, 185 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:14:21.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:20 smithi130 ceph-mon[84407]: osd.2 marked itself down and dead 2024-06-18T02:14:21.395 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:14:21 smithi007 podman[147759]: 2024-06-18 02:14:21.032746909 +0000 UTC m=+0.522853842 container died f3ae8409a895bda54a26c1fc467783d45577eeea6deb188b86b8899ed9dbb4f8 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , RELEASE=squid-3781e3a, org.label-schema.build-date=20240612, GIT_CLEAN=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.name=CentOS Stream 9 Base Image) 2024-06-18T02:14:21.645 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:14:21 smithi007 podman[147759]: 2024-06-18 02:14:21.64453607 +0000 UTC m=+1.134643001 container cleanup f3ae8409a895bda54a26c1fc467783d45577eeea6deb188b86b8899ed9dbb4f8 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.build-date=20240612, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-3781e3a) 2024-06-18T02:14:21.646 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:14:21 smithi007 bash[147759]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2 2024-06-18T02:14:21.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:21 smithi007 ceph-mon[113333]: Health check failed: 1 osds down (OSD_DOWN) 2024-06-18T02:14:21.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:21 smithi007 ceph-mon[113333]: osdmap e144: 8 total, 7 up, 8 in 2024-06-18T02:14:21.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:21 smithi007 ceph-mon[99735]: Health check failed: 1 osds down (OSD_DOWN) 2024-06-18T02:14:21.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:21 smithi007 ceph-mon[99735]: osdmap e144: 8 total, 7 up, 8 in 2024-06-18T02:14:21.932 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:14:21 smithi007 podman[147775]: 2024-06-18 02:14:21.879527627 +0000 UTC m=+0.846391964 container remove f3ae8409a895bda54a26c1fc467783d45577eeea6deb188b86b8899ed9dbb4f8 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2, org.label-schema.schema-version=1.0, RELEASE=squid-3781e3a, ceph=True, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240612, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-06-18T02:14:22.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:21 smithi130 ceph-mon[84407]: Health check failed: 1 osds down (OSD_DOWN) 2024-06-18T02:14:22.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:21 smithi130 ceph-mon[84407]: osdmap e144: 8 total, 7 up, 8 in 2024-06-18T02:14:22.428 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:14:22 smithi007 podman[147867]: 2024-06-18 02:14:22.330533674 +0000 UTC m=+0.098785931 container create d3d91e561f489bd300c704cc8a9c6d2747f2b6c8eb104617381e9e3d9113b35e (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240612, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3781e3a, GIT_CLEAN=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, io.buildah.version=1.36.0) 2024-06-18T02:14:22.428 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:14:22 smithi007 podman[147867]: 2024-06-18 02:14:22.249772571 +0000 UTC m=+0.018024823 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:14:22.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:22 smithi007 ceph-mon[113333]: osdmap e145: 8 total, 7 up, 8 in 2024-06-18T02:14:22.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:22 smithi007 ceph-mon[113333]: pgmap v217: 161 pgs: 14 stale+active+clean, 147 active+clean; 585 KiB data, 185 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-06-18T02:14:22.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:22 smithi007 ceph-mon[99735]: osdmap e145: 8 total, 7 up, 8 in 2024-06-18T02:14:22.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:22 smithi007 ceph-mon[99735]: pgmap v217: 161 pgs: 14 stale+active+clean, 147 active+clean; 585 KiB data, 185 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-06-18T02:14:22.682 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:14:22 smithi007 podman[147867]: 2024-06-18 02:14:22.525086504 +0000 UTC m=+0.293338770 container init d3d91e561f489bd300c704cc8a9c6d2747f2b6c8eb104617381e9e3d9113b35e (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2-deactivate, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.build-date=20240612, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, RELEASE=squid-3781e3a) 2024-06-18T02:14:22.682 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:14:22 smithi007 podman[147867]: 2024-06-18 02:14:22.528638437 +0000 UTC m=+0.296890698 container start d3d91e561f489bd300c704cc8a9c6d2747f2b6c8eb104617381e9e3d9113b35e (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.build-date=20240612, io.buildah.version=1.36.0, RELEASE=squid-3781e3a, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-06-18T02:14:22.682 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:14:22 smithi007 podman[147867]: 2024-06-18 02:14:22.607990337 +0000 UTC m=+0.376242589 container attach d3d91e561f489bd300c704cc8a9c6d2747f2b6c8eb104617381e9e3d9113b35e (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2-deactivate, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240612, CEPH_POINT_RELEASE=, RELEASE=squid-3781e3a, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-06-18T02:14:23.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:22 smithi130 ceph-mon[84407]: osdmap e145: 8 total, 7 up, 8 in 2024-06-18T02:14:23.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:22 smithi130 ceph-mon[84407]: pgmap v217: 161 pgs: 14 stale+active+clean, 147 active+clean; 585 KiB data, 185 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-06-18T02:14:23.092 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:14:22 smithi007 podman[147867]: 2024-06-18 02:14:22.800996819 +0000 UTC m=+0.569249076 container died d3d91e561f489bd300c704cc8a9c6d2747f2b6c8eb104617381e9e3d9113b35e (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2-deactivate, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, RELEASE=squid-3781e3a, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.build-date=20240612, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-06-18T02:14:23.753 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:23 smithi007 ceph-mon[113333]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:14:23.753 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:23 smithi007 ceph-mon[99735]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:14:23.753 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:14:23 smithi007 podman[147891]: 2024-06-18 02:14:23.503978699 +0000 UTC m=+0.697110496 container remove d3d91e561f489bd300c704cc8a9c6d2747f2b6c8eb104617381e9e3d9113b35e (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240612, RELEASE=squid-3781e3a, maintainer=Guillaume Abrioux , GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47) 2024-06-18T02:14:23.753 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:14:23 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.2.service: Deactivated successfully. 2024-06-18T02:14:23.753 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:14:23 smithi007 systemd[1]: Stopped Ceph osd.2 for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:14:23.754 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:14:23 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.2.service: Consumed 2.064s CPU time. 2024-06-18T02:14:23.754 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:14:23 smithi007 systemd[1]: Starting Ceph osd.2 for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:14:24.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:23 smithi130 ceph-mon[84407]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:14:24.232 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:14:23 smithi007 podman[147989]: 2024-06-18 02:14:23.955223414 +0000 UTC m=+0.097698886 container create 8367e506a0bc7619fc2a9394a1cd7582ece066f2861933ea21401cb61af1a089 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2-activate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240612, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-3781e3a) 2024-06-18T02:14:24.232 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:14:23 smithi007 podman[147989]: 2024-06-18 02:14:23.87525885 +0000 UTC m=+0.017734334 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:14:24.616 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:14:24 smithi007 podman[147989]: 2024-06-18 02:14:24.232843159 +0000 UTC m=+0.375318650 container init 8367e506a0bc7619fc2a9394a1cd7582ece066f2861933ea21401cb61af1a089 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2-activate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-3781e3a, org.label-schema.build-date=20240612, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-06-18T02:14:24.617 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:14:24 smithi007 podman[147989]: 2024-06-18 02:14:24.236593069 +0000 UTC m=+0.379068542 container start 8367e506a0bc7619fc2a9394a1cd7582ece066f2861933ea21401cb61af1a089 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2-activate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240612, org.label-schema.schema-version=1.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, RELEASE=squid-3781e3a) 2024-06-18T02:14:24.617 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:14:24 smithi007 podman[147989]: 2024-06-18 02:14:24.341196264 +0000 UTC m=+0.483671749 container attach 8367e506a0bc7619fc2a9394a1cd7582ece066f2861933ea21401cb61af1a089 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2-activate, org.label-schema.build-date=20240612, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.36.0, RELEASE=squid-3781e3a, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-06-18T02:14:24.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:24 smithi007 ceph-mon[113333]: pgmap v218: 161 pgs: 19 active+undersized, 6 stale+active+clean, 10 active+undersized+degraded, 126 active+clean; 585 KiB data, 186 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 36/726 objects degraded (4.959%) 2024-06-18T02:14:24.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:24 smithi007 ceph-mon[99735]: pgmap v218: 161 pgs: 19 active+undersized, 6 stale+active+clean, 10 active+undersized+degraded, 126 active+clean; 585 KiB data, 186 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 36/726 objects degraded (4.959%) 2024-06-18T02:14:24.932 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:14:24 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2-activate[148003]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-06-18T02:14:24.932 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:14:24 smithi007 bash[147989]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-06-18T02:14:24.932 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:14:24 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2-activate[148003]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-06-18T02:14:24.932 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:14:24 smithi007 bash[147989]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-06-18T02:14:24.933 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:14:24 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2-activate[148003]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-06-18T02:14:24.933 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:14:24 smithi007 bash[147989]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-06-18T02:14:24.933 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:14:24 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2-activate[148003]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-06-18T02:14:24.933 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:14:24 smithi007 bash[147989]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-06-18T02:14:24.933 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:14:24 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2-activate[148003]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-06-18T02:14:24.933 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:14:24 smithi007 bash[147989]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-06-18T02:14:24.933 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:14:24 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2-activate[148003]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-06-18T02:14:24.933 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:14:24 smithi007 bash[147989]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-06-18T02:14:24.933 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:14:24 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2-activate[148003]: --> ceph-volume raw activate successful for osd ID: 2 2024-06-18T02:14:24.933 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:14:24 smithi007 bash[147989]: --> ceph-volume raw activate successful for osd ID: 2 2024-06-18T02:14:24.933 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:14:24 smithi007 podman[147989]: 2024-06-18 02:14:24.672708535 +0000 UTC m=+0.815184011 container died 8367e506a0bc7619fc2a9394a1cd7582ece066f2861933ea21401cb61af1a089 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240612, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-3781e3a, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, GIT_CLEAN=True) 2024-06-18T02:14:25.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:24 smithi130 ceph-mon[84407]: pgmap v218: 161 pgs: 19 active+undersized, 6 stale+active+clean, 10 active+undersized+degraded, 126 active+clean; 585 KiB data, 186 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 36/726 objects degraded (4.959%) 2024-06-18T02:14:25.643 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:14:25 smithi007 podman[148138]: 2024-06-18 02:14:25.329215378 +0000 UTC m=+0.649672462 container remove 8367e506a0bc7619fc2a9394a1cd7582ece066f2861933ea21401cb61af1a089 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2-activate, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-3781e3a, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.36.0, org.label-schema.build-date=20240612, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-18T02:14:25.643 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:14:25 smithi007 podman[148198]: 2024-06-18 02:14:25.530027367 +0000 UTC m=+0.099203511 container create 7d9a05b4bfa5a510c442e580913595af7bbbfc76f5d5ae86e4a7466329366530 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-3781e3a, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.build-date=20240612, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-06-18T02:14:25.644 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:14:25 smithi007 podman[148198]: 2024-06-18 02:14:25.448291765 +0000 UTC m=+0.017467920 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:14:25.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:25 smithi007 ceph-mon[113333]: Health check failed: Degraded data redundancy: 36/726 objects degraded (4.959%), 10 pgs degraded (PG_DEGRADED) 2024-06-18T02:14:25.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:25 smithi007 ceph-mon[99735]: Health check failed: Degraded data redundancy: 36/726 objects degraded (4.959%), 10 pgs degraded (PG_DEGRADED) 2024-06-18T02:14:25.932 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:14:25 smithi007 podman[148198]: 2024-06-18 02:14:25.791271358 +0000 UTC m=+0.360447510 container init 7d9a05b4bfa5a510c442e580913595af7bbbfc76f5d5ae86e4a7466329366530 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.build-date=20240612, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-3781e3a, org.label-schema.name=CentOS Stream 9 Base Image) 2024-06-18T02:14:25.932 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:14:25 smithi007 podman[148198]: 2024-06-18 02:14:25.794938048 +0000 UTC m=+0.364114203 container start 7d9a05b4bfa5a510c442e580913595af7bbbfc76f5d5ae86e4a7466329366530 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, RELEASE=squid-3781e3a, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240612, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-06-18T02:14:25.932 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:14:25 smithi007 ceph-osd[148216]: -- 172.21.15.7:0/307489625 <== mon.1 v2:172.21.15.7:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557151c2fa40 con 0x557151c0dc00 2024-06-18T02:14:25.932 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:14:25 smithi007 bash[148198]: 7d9a05b4bfa5a510c442e580913595af7bbbfc76f5d5ae86e4a7466329366530 2024-06-18T02:14:25.932 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:14:25 smithi007 systemd[1]: Started Ceph osd.2 for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:14:26.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:25 smithi130 ceph-mon[84407]: Health check failed: Degraded data redundancy: 36/726 objects degraded (4.959%), 10 pgs degraded (PG_DEGRADED) 2024-06-18T02:14:26.645 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2[148212]: 2024-06-18T02:14:26.340+0000 7f6c1e5a3640 -1 Falling back to public interface 2024-06-18T02:14:27.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:27.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:27.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:27.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:27.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:27.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:27.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[99735]: pgmap v219: 161 pgs: 33 active+undersized, 14 active+undersized+degraded, 114 active+clean; 585 KiB data, 186 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 65/726 objects degraded (8.953%) 2024-06-18T02:14:27.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:27.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:27.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:27.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:27.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:27.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:27.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:27.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:27.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:27.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:27.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:27.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:27.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:14:27.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:27.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:27.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:27.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:27.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:27.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:27.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:27.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:27.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:27.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:27.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:27.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:27.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:27.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:27.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:27.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:27.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:27.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:27.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:27.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:27.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:27.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:27.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:27.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:27.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:27.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:27.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:27.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:27.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:27.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:27.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:27.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:27.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:27.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:27.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:27.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:27.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[113333]: pgmap v219: 161 pgs: 33 active+undersized, 14 active+undersized+degraded, 114 active+clean; 585 KiB data, 186 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 65/726 objects degraded (8.953%) 2024-06-18T02:14:27.191 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:27.191 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:27.191 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:27.191 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:27.191 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:27.191 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:27.191 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:27.191 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:27.191 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:27.191 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:27.191 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:27.191 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:27.191 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:14:27.192 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:27.192 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:27.192 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:27.192 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:27.192 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:27.192 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:27.192 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:27.192 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:27.192 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:27.192 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:27.192 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:27.192 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:27.192 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:27.192 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:27.193 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:27.193 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:27.193 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:27.193 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:27.193 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:27.193 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:27.193 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:27.193 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:27.193 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:27.193 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:27.193 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:27.193 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:27.193 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:27.194 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:27.194 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:27.194 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:26 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:27.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:27.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:27.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:27.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:27.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:27.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:26 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:27.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:26 smithi130 ceph-mon[84407]: pgmap v219: 161 pgs: 33 active+undersized, 14 active+undersized+degraded, 114 active+clean; 585 KiB data, 186 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 65/726 objects degraded (8.953%) 2024-06-18T02:14:27.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:27.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:27.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:27.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:27.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:27.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:26 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:27.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:27.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:27.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:27.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:27.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:27.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:27.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:14:27.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:27.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:27.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:27.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:27.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:27.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:27.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:27.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:27.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:27.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:27.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:27.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:27.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:27.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:27.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:27.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:27.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:27.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:27.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:27.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:27.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:27.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:27.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:27.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:27.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:27.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:27.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:27.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:27.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:27.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:28.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:28.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:28.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:28.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:28.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:28.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:28.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:28.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:28.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:28.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:28.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:28.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:28.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:28.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:28.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:28.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:28.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:28.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:28.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:28.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:28.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:28.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:28.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:28.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:28.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:28.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:28.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:28.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:28.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:28.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:28.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:28.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:28.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:28.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:28.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:28.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:28.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:28.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:28.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:28.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:28.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:28.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:28.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:28.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:28.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:28.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:28.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:28.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:28.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:28.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:28.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:28.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:28.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:28.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:28.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:28.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:28.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:28.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:28.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:28.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:28.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:28.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:28.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:28.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:28.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:28.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:28.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:28.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:28.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:28.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:28.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:28.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:28.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:28.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:28.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:28.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:28.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:28.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:28.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:28.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:28.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:28.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:28.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:28.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:28.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:28.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:28.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:28.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:28.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:28.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:28.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:28.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:28.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:28.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:28.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:28.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:28.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:28.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:28.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:28.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:28.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:28.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:28.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:28.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:28.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:28.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:28.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:28.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:27 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:28.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:14:27 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:14:27] "GET /metrics HTTP/1.1" 200 38421 "" "Prometheus/2.33.4" 2024-06-18T02:14:28.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:27 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:28.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:27 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:28.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:27 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:28.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:27 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:28.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:27 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:28.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:27 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:28.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:27 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:28.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:28.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:28.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:28.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:28.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:27 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:28.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:27 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:28.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:28.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:28.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:28.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:28.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:27 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:28.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:27 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:28.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:28.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:28.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:28.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:28.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:27 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:28.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:28.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:28.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:28.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:28.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:27 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:28.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:28.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:28.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:28.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:28.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:27 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:28.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:28.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:28.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:28.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:28.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:27 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:28.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:28.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:28.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:28.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:28.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:27 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:28.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:28.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:28.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:28.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:28.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:27 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:28.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:28.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:28.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:28.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:28.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:27 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:29.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:29.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:29.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:29.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:29.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:29.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:29.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:29.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[113333]: pgmap v220: 161 pgs: 33 active+undersized, 14 active+undersized+degraded, 114 active+clean; 585 KiB data, 186 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 65/726 objects degraded (8.953%) 2024-06-18T02:14:29.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:29.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:29.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:29.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:29.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:29.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:29.129 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:29.129 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:29.129 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:29.129 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:29.129 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:29.129 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:29.129 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:29.129 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:29.129 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:29.129 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:29.129 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:29.129 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:29.129 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:29.129 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:29.130 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:29.130 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:29.130 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:29.130 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:29.130 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:29.130 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:29.130 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:29.130 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:29.130 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[99735]: pgmap v220: 161 pgs: 33 active+undersized, 14 active+undersized+degraded, 114 active+clean; 585 KiB data, 186 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 65/726 objects degraded (8.953%) 2024-06-18T02:14:29.130 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:29.131 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:29.131 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:29.131 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:29.131 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:29.131 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:29.131 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:29.131 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:29.131 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:29.131 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:29.131 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:29.131 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:29.131 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:29.131 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:29.131 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:29.132 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:29.132 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:29.132 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:29.132 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:29.132 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:29.132 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:29.132 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:29.132 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:29.132 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:29.132 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:29.132 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:29.133 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:29.133 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:29.133 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:29.133 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:29.133 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:29.133 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:29.133 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:29.133 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:29.133 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:29.133 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:29.133 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:29.133 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:29.133 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:29.133 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:29.133 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:29.134 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:29.134 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:29.134 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:29.134 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:29.134 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:29.134 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:29.134 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:29.134 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:29.135 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:29.135 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:29.135 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:29.135 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:29.135 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:29.135 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:29.135 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:29.135 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:29.135 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:29.135 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:29.135 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:29.135 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:29.135 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:29.135 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:29.135 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:29.136 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:29.136 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:29.136 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:29.136 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:29.136 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:29.136 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:29.136 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:28 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:29.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:28 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:29.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:28 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:29.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:28 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:29.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:28 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:29.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:28 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:29.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:28 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:29.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:28 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:29.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:28 smithi130 ceph-mon[84407]: pgmap v220: 161 pgs: 33 active+undersized, 14 active+undersized+degraded, 114 active+clean; 585 KiB data, 186 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 65/726 objects degraded (8.953%) 2024-06-18T02:14:29.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:29.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:29.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:29.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:29.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:28 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:29.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:28 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:29.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:29.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:29.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:29.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:29.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:28 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:29.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:29.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:29.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:29.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:29.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:28 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:29.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:29.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:29.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:29.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:29.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:28 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:29.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:29.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:29.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:29.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:29.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:28 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:29.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:29.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:29.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:29.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:29.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:28 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:29.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:29.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:29.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:29.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:29.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:28 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:29.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:29.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:29.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:29.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:29.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:28 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:29.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:29.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:29.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:29.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:29.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:28 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:29.431 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2[148212]: 2024-06-18T02:14:29.127+0000 7f6c1e5a3640 -1 osd.2 143 log_to_monitors true 2024-06-18T02:14:29.964 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:29.964 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:29.964 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:29.964 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:29.964 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:29.964 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:29.964 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:29.964 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:29.964 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:29.965 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:29.965 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:29.965 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:29.965 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:29.965 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:29.965 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:29.965 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:29.965 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[113333]: from='osd.2 [v2:172.21.15.7:6816/1939046703,v1:172.21.15.7:6817/1939046703]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-18T02:14:29.965 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[113333]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-18T02:14:29.965 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:29.965 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:29.965 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:29.966 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:29.966 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:29.966 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:29.966 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:29.966 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:29.966 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:29.966 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:29.966 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:29.967 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:29.967 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:29.967 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:29.967 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:29.967 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:29.967 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:29.967 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:29.967 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:29.967 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:29.967 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:29.967 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:29.967 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:29.967 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:29.968 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:29.968 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:29.968 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:29.968 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:29.968 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:29.968 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:29.968 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:29.968 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:29.968 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:29.968 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:29.969 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:29.969 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:29.969 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:29.969 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:29.969 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:29.969 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:29.969 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:29.969 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:29.969 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:29.969 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:29.969 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:29.969 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:29.969 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:29.970 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:29.970 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:29.970 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[99735]: from='osd.2 [v2:172.21.15.7:6816/1939046703,v1:172.21.15.7:6817/1939046703]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-18T02:14:29.970 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[99735]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-18T02:14:29.970 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:29.971 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:29.971 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:29.971 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:29.971 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:29.971 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:29.971 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:29.971 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:29.971 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:29.971 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:29.971 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:29.971 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:29.971 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:29.971 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:29.972 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:29.972 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:29.972 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:29.972 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:29.972 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:29.972 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:29.972 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:29.972 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:29.972 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:29.972 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:29.972 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:29.972 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:29.972 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:29.972 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:29.973 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:29.973 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:29.973 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:29.973 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:29.973 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:29 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:30.275 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2[148212]: 2024-06-18T02:14:30.046+0000 7f6c1634e640 -1 osd.2 143 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-18T02:14:30.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:29 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:30.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:29 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:30.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:29 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:30.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:29 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:30.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:29 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:30.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:29 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:30.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:29 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:30.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:29 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:30.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:30.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:30.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:30.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:30.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:29 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:30.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:29 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:30.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:30.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:30.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:29 smithi130 ceph-mon[84407]: from='osd.2 [v2:172.21.15.7:6816/1939046703,v1:172.21.15.7:6817/1939046703]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-18T02:14:30.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:29 smithi130 ceph-mon[84407]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-18T02:14:30.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:30.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:30.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:29 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:30.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:30.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:30.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:30.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:30.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:29 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:30.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:30.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:30.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:30.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:30.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:29 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:30.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:30.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:30.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:30.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:30.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:29 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:30.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:30.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:30.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:30.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:30.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:29 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:30.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:30.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:30.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:30.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:30.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:29 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:30.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:30.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:30.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:30.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:30.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:29 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:31.047 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:31.048 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:31.048 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:31.048 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:31.048 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:31.048 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:31.048 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:31.048 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:31.048 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:31.048 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:31.048 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:31.049 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:31.049 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:31.049 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: pgmap v221: 161 pgs: 33 active+undersized, 14 active+undersized+degraded, 114 active+clean; 585 KiB data, 186 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 65/726 objects degraded (8.953%) 2024-06-18T02:14:31.049 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-06-18T02:14:31.049 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: osdmap e146: 8 total, 7 up, 8 in 2024-06-18T02:14:31.049 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: from='osd.2 [v2:172.21.15.7:6816/1939046703,v1:172.21.15.7:6817/1939046703]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-06-18T02:14:31.049 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-06-18T02:14:31.049 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:31.049 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:31.049 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:31.049 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:31.049 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:31.049 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:31.049 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:31.050 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:31.050 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:31.050 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:31.050 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:31.050 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:31.050 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:31.050 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:31.050 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:31.050 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:31.050 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:31.051 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:31.051 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:31.051 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:31.051 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:31.051 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:31.051 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:31.051 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:31.051 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: pgmap v221: 161 pgs: 33 active+undersized, 14 active+undersized+degraded, 114 active+clean; 585 KiB data, 186 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 65/726 objects degraded (8.953%) 2024-06-18T02:14:31.051 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-06-18T02:14:31.051 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: osdmap e146: 8 total, 7 up, 8 in 2024-06-18T02:14:31.051 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: from='osd.2 [v2:172.21.15.7:6816/1939046703,v1:172.21.15.7:6817/1939046703]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-06-18T02:14:31.051 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-06-18T02:14:31.051 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:31.051 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:31.052 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:31.052 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:31.052 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:31.052 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:31.052 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:31.052 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:31.052 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:31.052 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:31.052 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:31.052 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:31.053 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:31.053 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:31.053 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:31.053 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:31.053 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:31.053 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:31.053 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:31.053 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:31.053 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:31.053 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:31.053 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:31.053 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:31.053 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:31.054 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:31.054 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:31.054 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:31.054 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:31.054 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:31.054 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:31.054 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:31.054 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:31.054 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:31.054 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:31.054 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:31.054 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:31.054 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:31.054 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:31.055 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:31.055 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:31.055 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:31.055 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:31.055 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:31.055 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:31.055 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:31.055 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:31.055 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:31.055 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:31.055 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:31.055 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:31.056 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:31.056 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:31.056 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:31.056 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:31.056 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:31.056 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:31.056 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:31.056 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:31.056 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:31.056 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:31.056 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:31.056 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:31.056 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:31.056 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:31.057 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:31.057 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:31.057 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:31.057 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:31.057 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:31.057 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:30 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:31.274 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:31.274 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:31.274 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:31.274 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:31.274 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:31.274 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:31.274 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:31.274 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:31.274 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:31.274 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:31.275 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:31.275 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:31.275 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:31.275 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: pgmap v221: 161 pgs: 33 active+undersized, 14 active+undersized+degraded, 114 active+clean; 585 KiB data, 186 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 65/726 objects degraded (8.953%) 2024-06-18T02:14:31.275 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-06-18T02:14:31.275 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: osdmap e146: 8 total, 7 up, 8 in 2024-06-18T02:14:31.275 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: from='osd.2 [v2:172.21.15.7:6816/1939046703,v1:172.21.15.7:6817/1939046703]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-06-18T02:14:31.275 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-06-18T02:14:31.275 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:31.275 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:31.275 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:31.275 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:31.275 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:31.276 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:31.276 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:31.276 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:31.276 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:31.276 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:31.276 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:31.276 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:31.276 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:31.276 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:31.277 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:31.277 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:31.277 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:31.277 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:31.277 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:31.277 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:31.277 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:31.277 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:31.277 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:31.277 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:31.277 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:31.277 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:31.277 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:31.277 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:31.278 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:31.278 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:31.278 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:31.278 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:31.278 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:31.278 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:31.278 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:31.278 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:31.278 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:31.278 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:31.278 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:31.278 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:31.279 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:30 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:32.221 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:32.222 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:32.222 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:32.222 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:32.222 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:32.222 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:32.222 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:32.222 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:32.222 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:32.222 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:32.222 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:32.222 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:32.223 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:32.223 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[113333]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-06-18T02:14:32.223 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[113333]: osd.2 [v2:172.21.15.7:6816/1939046703,v1:172.21.15.7:6817/1939046703] boot 2024-06-18T02:14:32.223 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[113333]: osdmap e147: 8 total, 8 up, 8 in 2024-06-18T02:14:32.223 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-18T02:14:32.223 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:32.223 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:32.223 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:32.223 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:32.223 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:32.223 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:32.223 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:32.223 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:32.223 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:32.224 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:32.224 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:32.224 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:32.224 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:32.224 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:32.224 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:32.224 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:32.224 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:32.224 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:32.224 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:32.224 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:32.225 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:32.225 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:32.225 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:32.225 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:32.225 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:32.225 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:32.225 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:32.225 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[99735]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-06-18T02:14:32.225 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[99735]: osd.2 [v2:172.21.15.7:6816/1939046703,v1:172.21.15.7:6817/1939046703] boot 2024-06-18T02:14:32.225 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[99735]: osdmap e147: 8 total, 8 up, 8 in 2024-06-18T02:14:32.225 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-18T02:14:32.225 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:32.225 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:32.225 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:32.226 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:32.226 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:32.226 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:32.226 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:32.226 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:32.226 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:32.226 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:32.226 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:32.226 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:32.226 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:32.226 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:32.227 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:32.227 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:32.227 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:32.227 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:32.227 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:32.227 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:32.227 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:32.227 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:32.227 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:32.227 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:32.228 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:32.228 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:32.228 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:32.228 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:32.228 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:32.228 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:32.229 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:32.229 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:32.229 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:32.229 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:32.229 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:32.230 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:32.230 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:32.230 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:32.230 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:32.230 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:32.230 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:32.230 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:32.231 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:32.231 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:32.231 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:32.231 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:32.231 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:32.231 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:32.231 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:32.231 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:32.232 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:32.232 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:32.232 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:32.232 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:32.232 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:32.232 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:31 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:32.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:31 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:32.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:31 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:32.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:31 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:32.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:31 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:32.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:31 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:32.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:31 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:32.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:31 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:32.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:32.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:32.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:32.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:32.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:31 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:32.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:31 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:32.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:31 smithi130 ceph-mon[84407]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-06-18T02:14:32.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:31 smithi130 ceph-mon[84407]: osd.2 [v2:172.21.15.7:6816/1939046703,v1:172.21.15.7:6817/1939046703] boot 2024-06-18T02:14:32.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:31 smithi130 ceph-mon[84407]: osdmap e147: 8 total, 8 up, 8 in 2024-06-18T02:14:32.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-18T02:14:32.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:32.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:32.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:32.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:32.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:31 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:32.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:32.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:32.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:32.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:32.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:31 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:32.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:32.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:32.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:32.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:32.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:31 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:32.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:32.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:32.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:32.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:32.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:31 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:32.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:32.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:32.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:32.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:32.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:31 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:32.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:32.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:32.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:32.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:32.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:31 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:32.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:32.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:32.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:32.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:32.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:31 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:33.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:32 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:33.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:32 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:33.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:32 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:33.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:32 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:33.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:32 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:33.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:32 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:33.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:32 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:33.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:32 smithi130 ceph-mon[84407]: pgmap v224: 161 pgs: 33 active+undersized, 14 active+undersized+degraded, 114 active+clean; 585 KiB data, 182 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 65/726 objects degraded (8.953%) 2024-06-18T02:14:33.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:33.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:33.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:33.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:33.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:32 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:33.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:32 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:33.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:32 smithi130 ceph-mon[84407]: osdmap e148: 8 total, 8 up, 8 in 2024-06-18T02:14:33.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:33.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:33.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:33.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:33.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:32 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:33.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:32 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:33.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:33.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:33.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:33.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:33.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:32 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:33.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:33.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:33.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:33.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:33.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:32 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:33.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:33.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:33.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:33.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:33.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:32 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:33.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:33.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:33.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:33.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:33.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:32 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:33.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:33.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:33.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:33.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:33.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:32 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:33.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:33.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:33.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:33.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:33.047 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:32 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:33.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:33.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:33.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:33.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:33.048 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:32 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:33.225 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:33.225 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:33.225 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:33.225 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:33.226 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:33.226 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:33.226 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:33.226 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[113333]: pgmap v224: 161 pgs: 33 active+undersized, 14 active+undersized+degraded, 114 active+clean; 585 KiB data, 182 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 65/726 objects degraded (8.953%) 2024-06-18T02:14:33.226 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:33.226 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:33.226 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:33.226 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:33.226 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:33.226 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:33.226 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[113333]: osdmap e148: 8 total, 8 up, 8 in 2024-06-18T02:14:33.226 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:33.226 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:33.227 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:33.227 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:33.227 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:33.227 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:33.227 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:33.227 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:33.227 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:33.227 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:33.227 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:33.227 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:33.227 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:33.227 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:33.227 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:33.228 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:33.228 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:33.228 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:33.228 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:33.228 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:33.228 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:33.228 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:33.228 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[99735]: pgmap v224: 161 pgs: 33 active+undersized, 14 active+undersized+degraded, 114 active+clean; 585 KiB data, 182 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 65/726 objects degraded (8.953%) 2024-06-18T02:14:33.228 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:33.228 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:33.228 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:33.228 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:33.228 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:33.229 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:33.229 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[99735]: osdmap e148: 8 total, 8 up, 8 in 2024-06-18T02:14:33.229 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:33.229 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:33.229 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:33.229 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:33.229 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:33.229 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:33.229 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:33.229 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:33.229 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:33.229 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:33.229 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:33.229 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:33.229 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:33.230 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:33.230 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:33.230 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:33.230 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:33.230 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:33.230 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:33.230 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:33.230 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:33.230 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:33.230 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:33.231 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:33.231 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:33.231 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:33.231 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:33.231 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:33.231 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:33.231 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:33.231 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:33.231 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:33.231 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:33.231 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:33.231 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:33.231 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:33.231 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:33.232 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:33.232 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:33.232 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:33.232 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:33.232 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:33.232 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:33.232 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:33.232 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:33.232 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:33.232 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:33.232 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:33.232 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:33.232 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:33.233 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:33.233 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:33.233 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:33.233 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:33.233 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:33.233 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:33.233 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:33.233 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:33.233 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:33.233 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:33.233 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:33.233 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:33.233 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:33.233 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:33.233 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:33.234 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:33.234 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:32 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:34.270 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[99735]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:14:34.271 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:34.271 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:34.271 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:34.271 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:34.271 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:34.271 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:34.271 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:34.271 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:34.271 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:34.271 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:34.271 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:34.271 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:34.271 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:34.272 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:34.272 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:34.272 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:34.272 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:34.272 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:34.272 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:34.272 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:34.272 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:34.272 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:34.272 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:34.272 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:34.272 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:34.272 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:34.272 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:34.272 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:34.272 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:34.273 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[113333]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:14:34.273 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:34.273 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:34.273 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:34.273 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:34.273 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:34.273 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:34.273 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:34.273 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:34.273 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:34.273 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:34.273 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:34.274 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:34.274 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:34.274 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:34.274 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:34.274 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:34.274 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:34.274 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:34.274 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:34.274 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:34.274 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:34.274 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:34.274 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:34.274 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:34.274 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:34.275 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:34.275 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:34.275 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:34.275 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:34.275 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:34.275 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:34.275 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:34.275 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:34.275 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:34.275 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:34.275 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:34.276 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:34.276 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:34.276 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:34.276 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:34.276 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:34.276 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:34.276 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:34.276 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:34.276 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:34.276 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:34.276 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:34.276 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:34.276 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:34.276 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:34.276 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:34.277 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:34.277 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:34.277 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:34.277 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:34.277 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:34.277 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:34.277 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:34.277 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:34.277 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:34.277 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:34.277 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:34.277 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:34.277 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:34.277 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:34.278 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:34.278 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:34.278 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:34.278 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:34.278 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:34.278 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:34.278 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:34.278 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:33 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:34.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:33 smithi130 ceph-mon[84407]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:14:34.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:33 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:34.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:33 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:34.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:33 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:34.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:33 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:34.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:33 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:34.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:33 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:34.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:33 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:34.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:34.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:34.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:34.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:34.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:33 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:34.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:33 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:34.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:34.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:34.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:34.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:34.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:33 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:34.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:34.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:34.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:34.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:34.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:33 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:34.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:34.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:34.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:34.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:34.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:33 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:34.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:34.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:34.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:34.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:34.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:33 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:34.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:34.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:34.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:34.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:34.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:33 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:34.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:33 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:34.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:33 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:34.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:33 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:34.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:34.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:34.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:34.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:34.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:33 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:34.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:34.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:34.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:34.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:34.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:33 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:35.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:35.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:35.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:35.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:35.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:35.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:35.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:35.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[113333]: pgmap v226: 161 pgs: 20 active+undersized, 6 active+undersized+degraded, 135 active+clean; 585 KiB data, 187 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 31/726 objects degraded (4.270%) 2024-06-18T02:14:35.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:35.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:35.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:35.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:35.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:35.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:35.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:35.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:35.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:35.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:35.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:35.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:35.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:35.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:35.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:35.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:35.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:35.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:35.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:35.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:35.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:35.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:35.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:35.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:35.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:35.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:35.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:35.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:35.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[99735]: pgmap v226: 161 pgs: 20 active+undersized, 6 active+undersized+degraded, 135 active+clean; 585 KiB data, 187 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 31/726 objects degraded (4.270%) 2024-06-18T02:14:35.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:35.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:35.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:35.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:35.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:35.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:35.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:35.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:35.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:35.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:35.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:35.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:35.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:35.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:35.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:35.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:35.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:35.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:35.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:35.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:35.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:35.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:35.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:35.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:35.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:35.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:35.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:35.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[113333]: Health check update: Degraded data redundancy: 65/726 objects degraded (8.953%), 14 pgs degraded (PG_DEGRADED) 2024-06-18T02:14:35.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:35.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:35.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:35.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:35.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:35.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:35.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:35.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:35.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:35.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:35.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:35.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:35.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:35.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:35.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:35.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:35.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:35.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:35.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:35.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:35.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:35.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:35.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:35.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[99735]: Health check update: Degraded data redundancy: 65/726 objects degraded (8.953%), 14 pgs degraded (PG_DEGRADED) 2024-06-18T02:14:35.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:35.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:35.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:35.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:35.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:35.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:35.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:35.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:35.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:35.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:35.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:35.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:35.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:35.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:35.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:35.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:35.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:35.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:35.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:35.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:34 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:35.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:34 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:35.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:34 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:35.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:34 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:35.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:34 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:35.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:34 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:35.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:34 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:35.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:34 smithi130 ceph-mon[84407]: pgmap v226: 161 pgs: 20 active+undersized, 6 active+undersized+degraded, 135 active+clean; 585 KiB data, 187 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 31/726 objects degraded (4.270%) 2024-06-18T02:14:35.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:35.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:35.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:35.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:35.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:34 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:35.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:34 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:35.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:35.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:35.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:35.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:35.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:34 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:35.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:35.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:35.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:35.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:35.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:34 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:35.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:35.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:35.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:35.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:35.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:34 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:35.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:35.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:35.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:35.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:35.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:34 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:35.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:34 smithi130 ceph-mon[84407]: Health check update: Degraded data redundancy: 65/726 objects degraded (8.953%), 14 pgs degraded (PG_DEGRADED) 2024-06-18T02:14:35.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:35.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:35.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:35.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:35.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:34 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:35.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:35.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:35.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:35.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:35.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:34 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:35.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:35.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:35.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:35.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:35.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:34 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:35.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:35.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:35.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:35.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:36.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:35 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:36.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:35 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:36.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:35 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:36.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:35 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:36.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:35 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:36.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:35 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:36.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:35 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:36.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:35 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:36.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:35 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:36.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:36.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:36.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:36.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:36.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:35 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:36.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:35 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:36.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:36.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:36.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:36.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:36.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:35 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:36.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:36.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:36.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:36.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:36.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:35 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:36.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:36.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:36.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:36.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:36.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:35 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:36.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:36.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:36.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:36.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:36.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:35 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:36.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:36.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:36.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:36.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:36.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:35 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:36.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:36.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:36.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:36.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:36.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:35 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:36.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:36.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:36.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:36.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:36.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:35 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:36.359 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:36.359 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:36.359 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:36.359 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:36.359 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:36.359 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:36.360 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:36.360 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:36.360 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:36.360 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:36.360 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:36.360 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:36.360 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:36.361 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:36.361 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:36.361 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:36.361 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:36.361 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:36.361 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:36.361 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:36.362 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:36.362 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:36.362 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:36.362 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:36.362 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:36.362 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:36.362 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:36.362 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:36.363 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:36.363 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:36.363 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:36.363 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:36.364 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:36.364 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:36.364 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:36.364 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:36.364 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:36.364 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:36.364 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:36.364 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:36.364 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:36.364 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:36.364 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:36.365 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:36.365 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:36.365 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:36.365 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:36.365 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:36.365 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:36.365 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:36.365 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:36.365 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:36.365 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:36.365 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:36.365 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:36.366 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:36.366 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:36.366 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:36.366 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:36.366 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:36.366 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:36.366 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:36.367 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:36.367 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:36.367 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:36.367 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:36.367 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:36.367 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:36.367 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:36.367 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:36.367 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:36.367 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:36.368 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:36.368 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:36.368 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:36.368 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:36.368 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:36.368 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:36.368 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:36.368 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:36.368 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:36.368 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:36.368 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:36.368 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:36.369 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:36.369 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:36.369 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:36.369 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:36.369 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:36.369 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:36.369 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:36.369 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:36.369 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:36.369 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:36.369 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:36.369 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:36.369 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:36.369 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:36.370 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:36.370 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:35 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:37.276 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:37.276 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:37.276 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:37.276 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:37.276 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:37.277 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:37.277 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:37.277 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[113333]: pgmap v227: 161 pgs: 161 active+clean; 585 KiB data, 187 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:14:37.277 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:37.277 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:37.277 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:37.277 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:37.277 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:37.277 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:37.277 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:37.277 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:37.277 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:37.277 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:37.277 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:37.278 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:37.278 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:37.278 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:37.278 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:37.278 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:37.278 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:37.278 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:37.278 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:37.278 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:37.278 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:37.278 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:37.279 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:37.279 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:37.279 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:37.279 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:37.279 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:37.279 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:37.279 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:37.279 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[99735]: pgmap v227: 161 pgs: 161 active+clean; 585 KiB data, 187 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:14:37.279 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:37.279 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:37.279 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:37.279 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:37.280 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:37.280 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:37.280 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:37.280 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:37.280 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:37.280 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:37.280 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:37.280 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:37.280 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:37.280 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:37.280 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:37.280 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:37.280 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:37.280 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:37.281 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:37.281 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:37.281 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:37.281 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:37.281 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:37.281 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:37.281 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:37.281 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:37.281 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:37.281 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:37.282 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:37.282 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:37.282 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:37.282 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:37.282 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:37.282 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:37.282 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:37.282 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:37.282 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:37.282 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:37.282 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:37.282 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:37.282 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:37.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:37.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[113333]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 31/726 objects degraded (4.270%), 6 pgs degraded) 2024-06-18T02:14:37.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[113333]: Cluster is now healthy 2024-06-18T02:14:37.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:37.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:37.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:37.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:37.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:37.283 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:37.283 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:37.283 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:37.283 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:37.284 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:37.284 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:37.284 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:37.284 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:37.284 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:37.284 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:37.284 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:37.284 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:37.284 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:37.284 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:37.284 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:37.284 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:37.284 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:37.284 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:37.284 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:37.285 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:37.285 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[99735]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 31/726 objects degraded (4.270%), 6 pgs degraded) 2024-06-18T02:14:37.285 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[99735]: Cluster is now healthy 2024-06-18T02:14:37.285 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:37.285 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:37.285 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:37.285 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:37.285 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:36 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:37.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:36 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:37.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:36 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:37.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:36 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:37.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:36 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:37.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:36 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:37.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:36 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:37.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:36 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:37.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:36 smithi130 ceph-mon[84407]: pgmap v227: 161 pgs: 161 active+clean; 585 KiB data, 187 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:14:37.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:37.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:37.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:37.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:37.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:36 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:37.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:36 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:37.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:37.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:37.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:37.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:37.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:36 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:37.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:36 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:37.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:37.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:37.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:37.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:37.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:36 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:37.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:37.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:37.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:37.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:37.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:36 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:37.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:37.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:37.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:37.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:37.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:36 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:37.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:37.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:37.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:37.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:37.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:36 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:37.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:37.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:37.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:37.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:37.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:36 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:37.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:37.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:37.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:37.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:37.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:36 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:37.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:36 smithi130 ceph-mon[84407]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 31/726 objects degraded (4.270%), 6 pgs degraded) 2024-06-18T02:14:37.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:36 smithi130 ceph-mon[84407]: Cluster is now healthy 2024-06-18T02:14:37.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:37.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:37.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:37.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:37.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:36 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:38.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:38.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:38.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:38.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:38.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:38.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:38.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:38.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:38.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:38.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:38.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:38.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:38.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:38.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:38.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:38.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:38.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:38.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:38.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:38.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:38.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:38.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:38.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:38.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:38.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:38.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:38.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:38.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:38.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:38.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:38.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:38.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:38.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:38.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:38.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:38.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:38.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:38.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:38.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:38.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:38.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:38.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:38.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:38.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:38.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:38.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:38.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:38.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:38.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:38.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:38.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:38.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:38.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:38.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:38.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:38.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:38.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:38.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:38.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:38.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:38.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:38.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:38.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:38.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:38.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:38.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:38.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:38.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:38.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:38.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:38.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:38.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:38.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:38.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:38.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:38.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:38.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:38.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:38.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:38.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:38.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:38.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:38.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:38.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:38.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:38.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:38.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:38.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:38.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:38.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:38.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:38.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:38.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:38.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:38.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:38.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:37 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:38.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:14:37 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:14:37] "GET /metrics HTTP/1.1" 200 38421 "" "Prometheus/2.33.4" 2024-06-18T02:14:38.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:37 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:38.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:37 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:38.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:37 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:38.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:37 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:38.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:37 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:38.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:37 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:38.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:37 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:38.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:38.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:38.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:38.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:38.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:37 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:38.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:37 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:38.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:38.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:38.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:38.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:38.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:37 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:38.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:38.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:38.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:38.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:38.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:37 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:38.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:38.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:38.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:38.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:38.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:37 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:38.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:38.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:38.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:38.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:38.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:37 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:38.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:38.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:38.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:38.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:38.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:37 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:38.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:38.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:38.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:38.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:38.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:37 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:38.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:38.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:38.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:38.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:38.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:37 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:39.218 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:39.219 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:39.219 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:39.219 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:39.219 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:39.219 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:39.219 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:39.219 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[99735]: pgmap v228: 161 pgs: 161 active+clean; 585 KiB data, 187 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-06-18T02:14:39.219 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:39.219 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:39.219 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:39.219 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:39.219 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:39.220 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:39.220 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:39.220 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:39.220 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:39.220 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:39.220 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:39.220 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:39.220 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:39.220 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:39.220 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:39.220 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:39.220 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:39.220 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:39.220 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:39.221 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:39.221 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:39.221 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:39.221 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:39.221 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:39.221 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:39.221 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:39.221 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:39.221 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:39.222 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:39.222 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[113333]: pgmap v228: 161 pgs: 161 active+clean; 585 KiB data, 187 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-06-18T02:14:39.222 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:39.222 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:39.222 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:39.222 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:39.222 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:39.222 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:39.222 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:39.222 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:39.222 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:39.222 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:39.222 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:39.223 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:39.223 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:39.223 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:39.223 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:39.223 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:39.223 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:39.223 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:39.223 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:39.223 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:39.223 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:39.223 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:39.224 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:39.224 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:39.224 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:39.224 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:39.224 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:39.224 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:39.224 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:39.224 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:39.224 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:39.224 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:39.224 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:39.224 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:39.224 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:39.225 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:39.225 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:39.225 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:39.225 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:39.225 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:39.225 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:39.225 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:39.225 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:39.225 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:39.225 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-06-18T02:14:39.225 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:39.225 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:39.226 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:39.226 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:39.226 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:39.226 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:39.226 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:39.226 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:39.226 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:39.226 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:39.226 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:39.226 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:39.226 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:39.226 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:39.227 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:39.227 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:39.227 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:39.227 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:39.227 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:39.227 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:39.227 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:39.227 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:39.227 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-06-18T02:14:39.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:38 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:39.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:38 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:39.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:38 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:39.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:38 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:39.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:38 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:39.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:38 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:39.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:38 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:39.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:38 smithi130 ceph-mon[84407]: pgmap v228: 161 pgs: 161 active+clean; 585 KiB data, 187 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-06-18T02:14:39.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:39.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:39.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:39.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:39.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:38 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:39.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:38 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:39.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:39.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:39.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:39.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:39.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:38 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:39.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:38 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:39.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:39.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:39.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:39.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:39.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:38 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:39.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:39.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:39.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:39.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:39.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:38 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:39.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:39.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:39.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:39.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:39.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:38 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:39.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:39.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:39.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:39.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:39.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:38 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:39.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:39.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:39.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:39.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:39.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:38 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:39.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:38 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:39.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:38 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:39.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:38 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:39.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:39.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:39.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:39.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:39.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-06-18T02:14:40.216 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:39 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:40.217 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:39 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:40.217 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:39 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:40.217 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:39 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:40.217 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:39 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:40.217 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:39 smithi007 ceph-mon[113333]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-06-18T02:14:40.217 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:39 smithi007 ceph-mon[113333]: Upgrade: osd.3 is safe to restart 2024-06-18T02:14:40.217 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:39 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:40.217 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:39 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:40.217 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:39 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:40.217 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:39 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:40.217 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:39 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:40.218 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:39 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:40.218 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:39 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:40.218 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:39 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:40.218 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:39 smithi007 ceph-mon[99735]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-06-18T02:14:40.218 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:39 smithi007 ceph-mon[99735]: Upgrade: osd.3 is safe to restart 2024-06-18T02:14:40.218 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:39 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:40.218 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:39 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:40.218 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:39 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:40.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:39 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:40.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:39 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:40.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:39 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:40.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:39 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:40.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:39 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:40.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:39 smithi130 ceph-mon[84407]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-06-18T02:14:40.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:39 smithi130 ceph-mon[84407]: Upgrade: osd.3 is safe to restart 2024-06-18T02:14:40.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:39 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:40.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:39 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:40.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:39 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:41.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:40 smithi007 ceph-mon[113333]: pgmap v229: 161 pgs: 161 active+clean; 585 KiB data, 187 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-06-18T02:14:41.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:40 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:41.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-06-18T02:14:41.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:41.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:40 smithi007 ceph-mon[99735]: pgmap v229: 161 pgs: 161 active+clean; 585 KiB data, 187 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-06-18T02:14:41.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:40 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:41.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-06-18T02:14:41.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:41.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:40 smithi130 ceph-mon[84407]: pgmap v229: 161 pgs: 161 active+clean; 585 KiB data, 187 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-06-18T02:14:41.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:40 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:41.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-06-18T02:14:41.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:42.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:41 smithi130 ceph-mon[84407]: Upgrade: Updating osd.3 2024-06-18T02:14:42.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:41 smithi130 ceph-mon[84407]: Deploying daemon osd.3 on smithi007 2024-06-18T02:14:42.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:41 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:42.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:14:42.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:41 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:42.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd rm-pg-upmap-items", "format": "json", "pgid": "5.1"}]: dispatch 2024-06-18T02:14:42.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd rm-pg-upmap-items", "format": "json", "pgid": "5.4"}]: dispatch 2024-06-18T02:14:42.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:41 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "osd rm-pg-upmap-items", "format": "json", "pgid": "5.1"}]: dispatch 2024-06-18T02:14:42.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd rm-pg-upmap-items", "format": "json", "pgid": "5.1f"}]: dispatch 2024-06-18T02:14:42.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:41 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "osd rm-pg-upmap-items", "format": "json", "pgid": "5.4"}]: dispatch 2024-06-18T02:14:42.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:41 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "osd rm-pg-upmap-items", "format": "json", "pgid": "5.1f"}]: dispatch 2024-06-18T02:14:42.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:41 smithi007 ceph-mon[113333]: Upgrade: Updating osd.3 2024-06-18T02:14:42.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:41 smithi007 ceph-mon[113333]: Deploying daemon osd.3 on smithi007 2024-06-18T02:14:42.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:41 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:42.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:14:42.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:41 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:42.307 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd rm-pg-upmap-items", "format": "json", "pgid": "5.1"}]: dispatch 2024-06-18T02:14:42.307 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd rm-pg-upmap-items", "format": "json", "pgid": "5.4"}]: dispatch 2024-06-18T02:14:42.307 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:41 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "osd rm-pg-upmap-items", "format": "json", "pgid": "5.1"}]: dispatch 2024-06-18T02:14:42.307 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd rm-pg-upmap-items", "format": "json", "pgid": "5.1f"}]: dispatch 2024-06-18T02:14:42.307 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:41 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "osd rm-pg-upmap-items", "format": "json", "pgid": "5.4"}]: dispatch 2024-06-18T02:14:42.307 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:41 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "osd rm-pg-upmap-items", "format": "json", "pgid": "5.1f"}]: dispatch 2024-06-18T02:14:42.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:41 smithi007 ceph-mon[99735]: Upgrade: Updating osd.3 2024-06-18T02:14:42.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:41 smithi007 ceph-mon[99735]: Deploying daemon osd.3 on smithi007 2024-06-18T02:14:42.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:41 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:42.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:14:42.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:41 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:42.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd rm-pg-upmap-items", "format": "json", "pgid": "5.1"}]: dispatch 2024-06-18T02:14:42.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd rm-pg-upmap-items", "format": "json", "pgid": "5.4"}]: dispatch 2024-06-18T02:14:42.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:41 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "osd rm-pg-upmap-items", "format": "json", "pgid": "5.1"}]: dispatch 2024-06-18T02:14:42.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd rm-pg-upmap-items", "format": "json", "pgid": "5.1f"}]: dispatch 2024-06-18T02:14:42.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:41 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "osd rm-pg-upmap-items", "format": "json", "pgid": "5.4"}]: dispatch 2024-06-18T02:14:42.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:41 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "osd rm-pg-upmap-items", "format": "json", "pgid": "5.1f"}]: dispatch 2024-06-18T02:14:43.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:42 smithi130 ceph-mon[84407]: pgmap v230: 161 pgs: 161 active+clean; 585 KiB data, 187 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-06-18T02:14:43.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:42 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "osd rm-pg-upmap-items", "format": "json", "pgid": "5.1"}]': finished 2024-06-18T02:14:43.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:42 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "osd rm-pg-upmap-items", "format": "json", "pgid": "5.4"}]': finished 2024-06-18T02:14:43.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:42 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "osd rm-pg-upmap-items", "format": "json", "pgid": "5.1f"}]': finished 2024-06-18T02:14:43.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:42 smithi130 ceph-mon[84407]: osdmap e149: 8 total, 8 up, 8 in 2024-06-18T02:14:43.309 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:42 smithi007 ceph-mon[113333]: pgmap v230: 161 pgs: 161 active+clean; 585 KiB data, 187 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-06-18T02:14:43.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:42 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "osd rm-pg-upmap-items", "format": "json", "pgid": "5.1"}]': finished 2024-06-18T02:14:43.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:42 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "osd rm-pg-upmap-items", "format": "json", "pgid": "5.4"}]': finished 2024-06-18T02:14:43.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:42 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "osd rm-pg-upmap-items", "format": "json", "pgid": "5.1f"}]': finished 2024-06-18T02:14:43.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:42 smithi007 ceph-mon[113333]: osdmap e149: 8 total, 8 up, 8 in 2024-06-18T02:14:43.310 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:42 smithi007 ceph-mon[99735]: pgmap v230: 161 pgs: 161 active+clean; 585 KiB data, 187 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-06-18T02:14:43.310 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "osd rm-pg-upmap-items", "format": "json", "pgid": "5.1"}]': finished 2024-06-18T02:14:43.310 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "osd rm-pg-upmap-items", "format": "json", "pgid": "5.4"}]': finished 2024-06-18T02:14:43.310 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "osd rm-pg-upmap-items", "format": "json", "pgid": "5.1f"}]': finished 2024-06-18T02:14:43.310 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:42 smithi007 ceph-mon[99735]: osdmap e149: 8 total, 8 up, 8 in 2024-06-18T02:14:44.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:43 smithi130 ceph-mon[84407]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:14:44.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:43 smithi130 ceph-mon[84407]: osdmap e150: 8 total, 8 up, 8 in 2024-06-18T02:14:44.370 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:43 smithi007 ceph-mon[113333]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:14:44.370 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:43 smithi007 ceph-mon[113333]: osdmap e150: 8 total, 8 up, 8 in 2024-06-18T02:14:44.370 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:43 smithi007 ceph-mon[99735]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:14:44.370 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:43 smithi007 ceph-mon[99735]: osdmap e150: 8 total, 8 up, 8 in 2024-06-18T02:14:44.932 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:14:44 smithi007 systemd[1]: Stopping Ceph osd.3 for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:14:45.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:44 smithi130 ceph-mon[84407]: pgmap v233: 161 pgs: 161 active+clean; 585 KiB data, 187 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:14:45.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:44 smithi007 ceph-mon[113333]: pgmap v233: 161 pgs: 161 active+clean; 585 KiB data, 187 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:14:45.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:44 smithi007 ceph-mon[99735]: pgmap v233: 161 pgs: 161 active+clean; 585 KiB data, 187 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:14:45.432 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:14:45 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3[41915]: 2024-06-18T02:14:45.007+0000 7f268306a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-18T02:14:45.432 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:14:45 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3[41915]: 2024-06-18T02:14:45.007+0000 7f268306a700 -1 osd.3 150 *** Got signal Terminated *** 2024-06-18T02:14:45.432 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:14:45 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3[41915]: 2024-06-18T02:14:45.007+0000 7f268306a700 -1 osd.3 150 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-18T02:14:46.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:45 smithi130 ceph-mon[84407]: osd.3 marked itself down and dead 2024-06-18T02:14:46.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:45 smithi007 ceph-mon[113333]: osd.3 marked itself down and dead 2024-06-18T02:14:46.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:45 smithi007 ceph-mon[99735]: osd.3 marked itself down and dead 2024-06-18T02:14:46.789 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:14:46 smithi007 podman[153821]: 2024-06-18 02:14:46.511469245 +0000 UTC m=+1.618185653 container died 8b91b2a07564a9cd7fa17051eb4f08e2d7d9240ec529ab68da48a82e355a4e70 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3, io.openshift.tags=base centos centos-stream, architecture=x86_64, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, com.redhat.component=centos-stream-container, release=754, io.openshift.expose-services=, io.buildah.version=1.19.8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, build-date=2022-05-03T08:36:31.336870, distribution-scope=public, GIT_CLEAN=True, version=8, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_BRANCH=HEAD, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., RELEASE=HEAD, vendor=Red Hat, Inc., vcs-type=git, name=centos-stream, ceph=True, io.k8s.display-name=CentOS Stream 8, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=-17.2.0, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com) 2024-06-18T02:14:47.066 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:46 smithi007 ceph-mon[113333]: pgmap v234: 161 pgs: 161 active+clean; 585 KiB data, 187 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-06-18T02:14:47.066 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:46 smithi007 ceph-mon[113333]: Health check failed: 1 osds down (OSD_DOWN) 2024-06-18T02:14:47.066 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:46 smithi007 ceph-mon[113333]: osdmap e151: 8 total, 7 up, 8 in 2024-06-18T02:14:47.066 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:46 smithi007 ceph-mon[99735]: pgmap v234: 161 pgs: 161 active+clean; 585 KiB data, 187 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-06-18T02:14:47.066 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:46 smithi007 ceph-mon[99735]: Health check failed: 1 osds down (OSD_DOWN) 2024-06-18T02:14:47.066 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:46 smithi007 ceph-mon[99735]: osdmap e151: 8 total, 7 up, 8 in 2024-06-18T02:14:47.067 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:14:46 smithi007 podman[153821]: 2024-06-18 02:14:46.790612109 +0000 UTC m=+1.897328509 container cleanup 8b91b2a07564a9cd7fa17051eb4f08e2d7d9240ec529ab68da48a82e355a4e70 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3, io.openshift.expose-services=, io.k8s.display-name=CentOS Stream 8, CEPH_POINT_RELEASE=-17.2.0, vendor=Red Hat, Inc., release=754, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, ceph=True, io.buildah.version=1.19.8, GIT_REPO=https://github.com/ceph/ceph-container.git, build-date=2022-05-03T08:36:31.336870, architecture=x86_64, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, version=8, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, maintainer=Guillaume Abrioux , GIT_CLEAN=True, distribution-scope=public, com.redhat.component=centos-stream-container, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., RELEASE=HEAD, vcs-type=git, GIT_BRANCH=HEAD, name=centos-stream, io.openshift.tags=base centos centos-stream) 2024-06-18T02:14:47.067 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:14:46 smithi007 bash[153821]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3 2024-06-18T02:14:47.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:46 smithi130 ceph-mon[84407]: pgmap v234: 161 pgs: 161 active+clean; 585 KiB data, 187 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-06-18T02:14:47.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:46 smithi130 ceph-mon[84407]: Health check failed: 1 osds down (OSD_DOWN) 2024-06-18T02:14:47.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:46 smithi130 ceph-mon[84407]: osdmap e151: 8 total, 7 up, 8 in 2024-06-18T02:14:47.390 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:14:47 smithi007 podman[153839]: 2024-06-18 02:14:47.067233031 +0000 UTC m=+0.548081942 container remove 8b91b2a07564a9cd7fa17051eb4f08e2d7d9240ec529ab68da48a82e355a4e70 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3, io.buildah.version=1.19.8, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_BRANCH=HEAD, release=754, io.k8s.display-name=CentOS Stream 8, vcs-type=git, io.openshift.expose-services=, ceph=True, io.openshift.tags=base centos centos-stream, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, com.redhat.component=centos-stream-container, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, distribution-scope=public, name=centos-stream, version=8, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, maintainer=Guillaume Abrioux , vendor=Red Hat, Inc., build-date=2022-05-03T08:36:31.336870, GIT_REPO=https://github.com/ceph/ceph-container.git, architecture=x86_64, GIT_CLEAN=True, CEPH_POINT_RELEASE=-17.2.0, RELEASE=HEAD) 2024-06-18T02:14:47.641 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:14:47 smithi007 podman[153925]: 2024-06-18 02:14:47.294128503 +0000 UTC m=+0.018156940 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:14:47.641 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:14:47 smithi007 podman[153925]: 2024-06-18 02:14:47.409719913 +0000 UTC m=+0.133748339 container create 703bcda8d46283e1aa3504a0d9f24f8b4e8b72d662451eff51208055f8375532 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240612, org.label-schema.license=GPLv2, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-3781e3a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True) 2024-06-18T02:14:47.641 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:14:47 smithi007 podman[153925]: 2024-06-18 02:14:47.637859305 +0000 UTC m=+0.361887747 container init 703bcda8d46283e1aa3504a0d9f24f8b4e8b72d662451eff51208055f8375532 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-3781e3a, io.buildah.version=1.36.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240612, ceph=True, org.label-schema.schema-version=1.0) 2024-06-18T02:14:47.919 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:14:47 smithi007 podman[153925]: 2024-06-18 02:14:47.641934633 +0000 UTC m=+0.365963064 container start 703bcda8d46283e1aa3504a0d9f24f8b4e8b72d662451eff51208055f8375532 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240612, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-3781e3a, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-06-18T02:14:47.919 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:14:47 smithi007 podman[153925]: 2024-06-18 02:14:47.737482887 +0000 UTC m=+0.461511333 container attach 703bcda8d46283e1aa3504a0d9f24f8b4e8b72d662451eff51208055f8375532 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3-deactivate, RELEASE=squid-3781e3a, org.label-schema.license=GPLv2, org.label-schema.build-date=20240612, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-06-18T02:14:47.968 INFO:teuthology.orchestra.run.smithi007.stdout:true 2024-06-18T02:14:48.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:47 smithi007 ceph-mon[113333]: osdmap e152: 8 total, 7 up, 8 in 2024-06-18T02:14:48.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:47 smithi007 ceph-mon[99735]: osdmap e152: 8 total, 7 up, 8 in 2024-06-18T02:14:48.183 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:14:47 smithi007 podman[153925]: 2024-06-18 02:14:47.920707685 +0000 UTC m=+0.644736118 container died 703bcda8d46283e1aa3504a0d9f24f8b4e8b72d662451eff51208055f8375532 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.36.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-3781e3a, org.label-schema.build-date=20240612, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True) 2024-06-18T02:14:48.195 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:47 smithi130 ceph-mon[84407]: osdmap e152: 8 total, 7 up, 8 in 2024-06-18T02:14:48.195 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:14:47 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:14:47] "GET /metrics HTTP/1.1" 200 38417 "" "Prometheus/2.33.4" 2024-06-18T02:14:48.655 INFO:teuthology.orchestra.run.smithi007.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-18T02:14:48.655 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi007 smithi007 running 9s ago 18m - - 2024-06-18T02:14:48.656 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi130 smithi130 running 14s ago 17m - - 2024-06-18T02:14:48.656 INFO:teuthology.orchestra.run.smithi007.stdout:alertmanager.a smithi007 *:9093,9094 running (7m) 9s ago 12m 23.3M - 0.23.0 ba2b418f427c 5994e8525c64 2024-06-18T02:14:48.656 INFO:teuthology.orchestra.run.smithi007.stdout:grafana.a smithi130 *:3000 running (7m) 14s ago 12m 49.4M - 8.3.5 dad864ee21e9 70ba81d97c8e 2024-06-18T02:14:48.656 INFO:teuthology.orchestra.run.smithi007.stdout:iscsi.foo.smithi007.xvdrwd smithi007 running (5m) 9s ago 11m 59.9M - 3.5 e1d6a67b021e 94121ad2702c 2024-06-18T02:14:48.656 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.x smithi130 *:8443,9283,8765 running (6m) 14s ago 17m 528M - 19.0.0-3124-g3781e3a5 af93c036e016 01017e37bdbe 2024-06-18T02:14:48.656 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.y smithi007 *:8443,9283,8765 running (5m) 9s ago 19m 443M - 19.0.0-3124-g3781e3a5 af93c036e016 2141e131e896 2024-06-18T02:14:48.656 INFO:teuthology.orchestra.run.smithi007.stdout:mon.a smithi007 running (2m) 9s ago 19m 53.5M 2048M 19.0.0-3124-g3781e3a5 af93c036e016 7bbe646cd5b7 2024-06-18T02:14:48.656 INFO:teuthology.orchestra.run.smithi007.stdout:mon.b smithi130 running (3m) 14s ago 17m 51.7M 2048M 19.0.0-3124-g3781e3a5 af93c036e016 baacf2add994 2024-06-18T02:14:48.656 INFO:teuthology.orchestra.run.smithi007.stdout:mon.c smithi007 running (4m) 9s ago 17m 55.6M 2048M 19.0.0-3124-g3781e3a5 af93c036e016 39418356156e 2024-06-18T02:14:48.656 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.a smithi007 *:9100 running (7m) 9s ago 13m 18.0M - 1.3.1 1dbe0e931976 8128e558f099 2024-06-18T02:14:48.656 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.b smithi130 *:9100 running (7m) 14s ago 13m 15.9M - 1.3.1 1dbe0e931976 bab93b43cf16 2024-06-18T02:14:48.656 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0 smithi007 running (2m) 9s ago 16m 48.0M 4096M 19.0.0-3124-g3781e3a5 af93c036e016 07c7f4afd49a 2024-06-18T02:14:48.656 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1 smithi007 running (73s) 9s ago 16m 43.8M 4096M 19.0.0-3124-g3781e3a5 af93c036e016 e8d184614e94 2024-06-18T02:14:48.657 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2 smithi007 running (23s) 9s ago 16m 40.6M 4096M 19.0.0-3124-g3781e3a5 af93c036e016 7d9a05b4bfa5 2024-06-18T02:14:48.657 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3 smithi007 running (15m) 9s ago 15m 63.1M 4096M 17.2.0 e1d6a67b021e 8b91b2a07564 2024-06-18T02:14:48.657 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4 smithi130 running (15m) 14s ago 15m 64.2M 4096M 17.2.0 e1d6a67b021e c428dccffdf0 2024-06-18T02:14:48.657 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5 smithi130 running (14m) 14s ago 14m 62.7M 4096M 17.2.0 e1d6a67b021e f645d7f12378 2024-06-18T02:14:48.657 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6 smithi130 running (14m) 14s ago 14m 57.0M 4096M 17.2.0 e1d6a67b021e c7af86c14959 2024-06-18T02:14:48.657 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7 smithi130 running (14m) 14s ago 14m 61.7M 4096M 17.2.0 e1d6a67b021e 3688af8b2c46 2024-06-18T02:14:48.657 INFO:teuthology.orchestra.run.smithi007.stdout:prometheus.a smithi130 *:9095 running (6m) 14s ago 13m 75.8M - 2.33.4 514e6a882f6e e905fb2eb4a6 2024-06-18T02:14:48.657 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi007.dvbvbk smithi007 *:8000 running (11m) 9s ago 11m 77.7M - 17.2.0 e1d6a67b021e 1344b55b763c 2024-06-18T02:14:48.657 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi130.aakmof smithi130 *:8000 running (11m) 14s ago 11m 75.4M - 17.2.0 e1d6a67b021e e257e3230c6c 2024-06-18T02:14:48.657 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi007.hgrnmk smithi007 *:80 running (11m) 9s ago 11m 75.7M - 17.2.0 e1d6a67b021e 2173947bc4d6 2024-06-18T02:14:48.657 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi130.wwebfk smithi130 *:80 running (11m) 14s ago 11m 77.4M - 17.2.0 e1d6a67b021e 8662706b2231 2024-06-18T02:14:48.922 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:14:48 smithi007 podman[153971]: 2024-06-18 02:14:48.685399304 +0000 UTC m=+0.758884098 container remove 703bcda8d46283e1aa3504a0d9f24f8b4e8b72d662451eff51208055f8375532 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-3781e3a, org.label-schema.license=GPLv2, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240612, org.label-schema.vendor=CentOS) 2024-06-18T02:14:48.922 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:14:48 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.3.service: Deactivated successfully. 2024-06-18T02:14:48.922 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:14:48 smithi007 systemd[1]: Stopped Ceph osd.3 for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:14:48.922 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:14:48 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.3.service: Consumed 11.981s CPU time. 2024-06-18T02:14:49.105 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:14:49.105 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": { 2024-06-18T02:14:49.105 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 3 2024-06-18T02:14:49.105 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:14:49.105 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": { 2024-06-18T02:14:49.105 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 2 2024-06-18T02:14:49.105 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:14:49.105 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": { 2024-06-18T02:14:49.105 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4, 2024-06-18T02:14:49.106 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 3 2024-06-18T02:14:49.106 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:14:49.106 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw": { 2024-06-18T02:14:49.106 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-06-18T02:14:49.106 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:14:49.106 INFO:teuthology.orchestra.run.smithi007.stdout: "overall": { 2024-06-18T02:14:49.106 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8, 2024-06-18T02:14:49.106 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 8 2024-06-18T02:14:49.106 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-06-18T02:14:49.106 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:14:49.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:48 smithi007 ceph-mon[113333]: from='client.54361 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:14:49.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:48 smithi007 ceph-mon[113333]: pgmap v237: 161 pgs: 17 active+undersized, 13 stale+active+clean, 13 active+undersized+degraded, 118 active+clean; 585 KiB data, 187 MiB used, 715 GiB / 715 GiB avail; 43/726 objects degraded (5.923%) 2024-06-18T02:14:49.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:48 smithi007 ceph-mon[113333]: Health check failed: Degraded data redundancy: 43/726 objects degraded (5.923%), 13 pgs degraded (PG_DEGRADED) 2024-06-18T02:14:49.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:48 smithi007 ceph-mon[99735]: from='client.54361 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:14:49.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:48 smithi007 ceph-mon[99735]: pgmap v237: 161 pgs: 17 active+undersized, 13 stale+active+clean, 13 active+undersized+degraded, 118 active+clean; 585 KiB data, 187 MiB used, 715 GiB / 715 GiB avail; 43/726 objects degraded (5.923%) 2024-06-18T02:14:49.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:48 smithi007 ceph-mon[99735]: Health check failed: Degraded data redundancy: 43/726 objects degraded (5.923%), 13 pgs degraded (PG_DEGRADED) 2024-06-18T02:14:49.183 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:14:48 smithi007 systemd[1]: Starting Ceph osd.3 for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:14:49.183 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:14:49 smithi007 podman[154141]: 2024-06-18 02:14:49.059086846 +0000 UTC m=+0.018525233 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:14:49.183 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:14:49 smithi007 podman[154141]: 2024-06-18 02:14:49.159569891 +0000 UTC m=+0.119008266 container create 62901cc39918a952af4983dc618ece06b0d60b5caffc9bd5f72d4eef60e88e95 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3-activate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240612, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-3781e3a, io.buildah.version=1.36.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47) 2024-06-18T02:14:49.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:48 smithi130 ceph-mon[84407]: from='client.54361 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:14:49.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:48 smithi130 ceph-mon[84407]: pgmap v237: 161 pgs: 17 active+undersized, 13 stale+active+clean, 13 active+undersized+degraded, 118 active+clean; 585 KiB data, 187 MiB used, 715 GiB / 715 GiB avail; 43/726 objects degraded (5.923%) 2024-06-18T02:14:49.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:48 smithi130 ceph-mon[84407]: Health check failed: Degraded data redundancy: 43/726 objects degraded (5.923%), 13 pgs degraded (PG_DEGRADED) 2024-06-18T02:14:49.459 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:14:49.459 INFO:teuthology.orchestra.run.smithi007.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00", 2024-06-18T02:14:49.460 INFO:teuthology.orchestra.run.smithi007.stdout: "in_progress": true, 2024-06-18T02:14:49.460 INFO:teuthology.orchestra.run.smithi007.stdout: "which": "Upgrading all daemon types on all hosts", 2024-06-18T02:14:49.460 INFO:teuthology.orchestra.run.smithi007.stdout: "services_complete": [ 2024-06-18T02:14:49.460 INFO:teuthology.orchestra.run.smithi007.stdout: "mon", 2024-06-18T02:14:49.460 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr" 2024-06-18T02:14:49.460 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-06-18T02:14:49.460 INFO:teuthology.orchestra.run.smithi007.stdout: "progress": "8/23 daemons upgraded", 2024-06-18T02:14:49.460 INFO:teuthology.orchestra.run.smithi007.stdout: "message": "Currently upgrading osd daemons", 2024-06-18T02:14:49.460 INFO:teuthology.orchestra.run.smithi007.stdout: "is_paused": false 2024-06-18T02:14:49.460 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:14:49.682 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:14:49 smithi007 podman[154141]: 2024-06-18 02:14:49.429709333 +0000 UTC m=+0.389147726 container init 62901cc39918a952af4983dc618ece06b0d60b5caffc9bd5f72d4eef60e88e95 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3-activate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240612, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3781e3a, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47) 2024-06-18T02:14:49.682 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:14:49 smithi007 podman[154141]: 2024-06-18 02:14:49.434738408 +0000 UTC m=+0.394176789 container start 62901cc39918a952af4983dc618ece06b0d60b5caffc9bd5f72d4eef60e88e95 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3-activate, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240612, RELEASE=squid-3781e3a) 2024-06-18T02:14:49.682 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:14:49 smithi007 podman[154141]: 2024-06-18 02:14:49.521121406 +0000 UTC m=+0.480559803 container attach 62901cc39918a952af4983dc618ece06b0d60b5caffc9bd5f72d4eef60e88e95 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240612, RELEASE=squid-3781e3a, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, io.buildah.version=1.36.0, GIT_CLEAN=True) 2024-06-18T02:14:49.898 INFO:teuthology.orchestra.run.smithi007.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 43/726 objects degraded (5.923%), 13 pgs degraded 2024-06-18T02:14:49.898 INFO:teuthology.orchestra.run.smithi007.stdout:[WRN] OSD_DOWN: 1 osds down 2024-06-18T02:14:49.898 INFO:teuthology.orchestra.run.smithi007.stdout: osd.3 (root=default,host=smithi007) is down 2024-06-18T02:14:49.898 INFO:teuthology.orchestra.run.smithi007.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 43/726 objects degraded (5.923%), 13 pgs degraded 2024-06-18T02:14:49.898 INFO:teuthology.orchestra.run.smithi007.stdout: pg 2.12 is active+undersized+degraded, acting [5,0] 2024-06-18T02:14:49.898 INFO:teuthology.orchestra.run.smithi007.stdout: pg 2.19 is active+undersized+degraded, acting [6,0] 2024-06-18T02:14:49.898 INFO:teuthology.orchestra.run.smithi007.stdout: pg 2.1b is active+undersized+degraded, acting [7,6] 2024-06-18T02:14:49.898 INFO:teuthology.orchestra.run.smithi007.stdout: pg 3.2 is active+undersized+degraded, acting [5,6] 2024-06-18T02:14:49.898 INFO:teuthology.orchestra.run.smithi007.stdout: pg 3.5 is active+undersized+degraded, acting [5,2] 2024-06-18T02:14:49.898 INFO:teuthology.orchestra.run.smithi007.stdout: pg 3.7 is active+undersized+degraded, acting [7,0] 2024-06-18T02:14:49.898 INFO:teuthology.orchestra.run.smithi007.stdout: pg 3.c is active+undersized+degraded, acting [5,6] 2024-06-18T02:14:49.899 INFO:teuthology.orchestra.run.smithi007.stdout: pg 3.15 is active+undersized+degraded, acting [7,4] 2024-06-18T02:14:49.899 INFO:teuthology.orchestra.run.smithi007.stdout: pg 3.1e is active+undersized+degraded, acting [6,2] 2024-06-18T02:14:49.899 INFO:teuthology.orchestra.run.smithi007.stdout: pg 4.0 is active+undersized+degraded, acting [7,0] 2024-06-18T02:14:49.899 INFO:teuthology.orchestra.run.smithi007.stdout: pg 4.9 is active+undersized+degraded, acting [4,1] 2024-06-18T02:14:49.899 INFO:teuthology.orchestra.run.smithi007.stdout: pg 4.15 is active+undersized+degraded, acting [5,7] 2024-06-18T02:14:49.899 INFO:teuthology.orchestra.run.smithi007.stdout: pg 6.c is active+undersized+degraded, acting [6,5] 2024-06-18T02:14:50.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:49 smithi007 ceph-mon[113333]: from='client.94323 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:14:50.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:49 smithi007 ceph-mon[113333]: from='client.54373 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:14:50.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:49 smithi007 ceph-mon[113333]: from='client.? 172.21.15.7:0/298270243' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:50.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:49 smithi007 ceph-mon[113333]: from='client.? 172.21.15.7:0/1895256652' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:14:50.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:49 smithi007 ceph-mon[99735]: from='client.94323 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:14:50.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:49 smithi007 ceph-mon[99735]: from='client.54373 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:14:50.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:49 smithi007 ceph-mon[99735]: from='client.? 172.21.15.7:0/298270243' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:50.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:49 smithi007 ceph-mon[99735]: from='client.? 172.21.15.7:0/1895256652' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:14:50.183 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:14:49 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3-activate[154179]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-06-18T02:14:50.183 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:14:49 smithi007 bash[154141]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-06-18T02:14:50.183 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:14:49 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3-activate[154179]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_1 2024-06-18T02:14:50.183 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:14:49 smithi007 bash[154141]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_1 2024-06-18T02:14:50.183 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:14:49 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3-activate[154179]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_1 2024-06-18T02:14:50.183 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:14:49 smithi007 bash[154141]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_1 2024-06-18T02:14:50.183 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:14:49 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3-activate[154179]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-06-18T02:14:50.184 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:14:49 smithi007 bash[154141]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-06-18T02:14:50.184 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:14:49 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3-activate[154179]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-3/block 2024-06-18T02:14:50.184 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:14:49 smithi007 bash[154141]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-3/block 2024-06-18T02:14:50.184 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:14:49 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3-activate[154179]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-06-18T02:14:50.184 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:14:49 smithi007 bash[154141]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-06-18T02:14:50.184 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:14:49 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3-activate[154179]: --> ceph-volume raw activate successful for osd ID: 3 2024-06-18T02:14:50.184 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:14:49 smithi007 bash[154141]: --> ceph-volume raw activate successful for osd ID: 3 2024-06-18T02:14:50.184 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:14:49 smithi007 podman[154141]: 2024-06-18 02:14:49.885103931 +0000 UTC m=+0.844542307 container died 62901cc39918a952af4983dc618ece06b0d60b5caffc9bd5f72d4eef60e88e95 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3-activate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-3781e3a, org.label-schema.vendor=CentOS, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.build-date=20240612, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True) 2024-06-18T02:14:50.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:49 smithi130 ceph-mon[84407]: from='client.94323 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:14:50.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:49 smithi130 ceph-mon[84407]: from='client.54373 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:14:50.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:49 smithi130 ceph-mon[84407]: from='client.? 172.21.15.7:0/298270243' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:50.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:49 smithi130 ceph-mon[84407]: from='client.? 172.21.15.7:0/1895256652' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:14:50.885 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:14:50 smithi007 podman[154319]: 2024-06-18 02:14:50.542101954 +0000 UTC m=+0.651116891 container remove 62901cc39918a952af4983dc618ece06b0d60b5caffc9bd5f72d4eef60e88e95 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240612, RELEASE=squid-3781e3a, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-06-18T02:14:50.886 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:14:50 smithi007 podman[154384]: 2024-06-18 02:14:50.668567508 +0000 UTC m=+0.018219879 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:14:50.886 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:14:50 smithi007 podman[154384]: 2024-06-18 02:14:50.76801388 +0000 UTC m=+0.117666279 container create b8e85735efff193bcc83afad3f9e0e614e4f32f2c28cec950a3eccd986a16b12 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240612, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, ceph=True, RELEASE=squid-3781e3a, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-06-18T02:14:51.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:50 smithi130 ceph-mon[84407]: from='client.94341 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:14:51.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:50 smithi130 ceph-mon[84407]: pgmap v238: 161 pgs: 28 active+undersized, 6 stale+active+clean, 19 active+undersized+degraded, 108 active+clean; 585 KiB data, 187 MiB used, 715 GiB / 715 GiB avail; 70/726 objects degraded (9.642%) 2024-06-18T02:14:51.342 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:50 smithi007 ceph-mon[113333]: from='client.94341 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:14:51.342 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:50 smithi007 ceph-mon[113333]: pgmap v238: 161 pgs: 28 active+undersized, 6 stale+active+clean, 19 active+undersized+degraded, 108 active+clean; 585 KiB data, 187 MiB used, 715 GiB / 715 GiB avail; 70/726 objects degraded (9.642%) 2024-06-18T02:14:51.343 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:50 smithi007 ceph-mon[99735]: from='client.94341 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:14:51.343 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:50 smithi007 ceph-mon[99735]: pgmap v238: 161 pgs: 28 active+undersized, 6 stale+active+clean, 19 active+undersized+degraded, 108 active+clean; 585 KiB data, 187 MiB used, 715 GiB / 715 GiB avail; 70/726 objects degraded (9.642%) 2024-06-18T02:14:51.343 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:14:51 smithi007 podman[154384]: 2024-06-18 02:14:51.021058816 +0000 UTC m=+0.370711249 container init b8e85735efff193bcc83afad3f9e0e614e4f32f2c28cec950a3eccd986a16b12 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3, GIT_BRANCH=HEAD, RELEASE=squid-3781e3a, org.label-schema.build-date=20240612, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-06-18T02:14:51.343 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:14:51 smithi007 podman[154384]: 2024-06-18 02:14:51.02498146 +0000 UTC m=+0.374633817 container start b8e85735efff193bcc83afad3f9e0e614e4f32f2c28cec950a3eccd986a16b12 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3, org.label-schema.build-date=20240612, org.label-schema.vendor=CentOS, RELEASE=squid-3781e3a, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-06-18T02:14:51.343 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:14:51 smithi007 ceph-osd[154402]: -- 172.21.15.7:0/2657802763 <== mon.1 v2:172.21.15.7:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56146aa73a40 con 0x56146aa51c00 2024-06-18T02:14:51.343 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:14:51 smithi007 bash[154384]: b8e85735efff193bcc83afad3f9e0e614e4f32f2c28cec950a3eccd986a16b12 2024-06-18T02:14:51.343 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:14:51 smithi007 systemd[1]: Started Ceph osd.3 for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:14:51.640 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:14:51 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3[154398]: 2024-06-18T02:14:51.578+0000 7ff38aaae640 -1 Falling back to public interface 2024-06-18T02:14:52.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:52.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:52.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:52.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:52.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:52.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:52.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:52.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:52.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:52.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:52.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:52.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:52.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:52.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:52.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:52.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:52.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:52.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:52.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:52.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:52.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:52.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:52.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:52.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:52.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:52.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:52.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:52.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:52.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:52.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:52.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:52.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:52.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:52.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:52.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:52.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:52.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:52.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:52.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:52.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:52.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:52.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:52.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:52.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:52.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:52.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:52.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:52.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:52.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:52.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:52.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:52.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:52.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:52.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:52.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:52.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:52.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:52.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:52.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:52.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:52.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:52.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:52.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:52.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:52.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:52.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:52.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:52.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:52.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:52.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:52.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:52.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:52.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:52.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[113333]: pgmap v239: 161 pgs: 40 active+undersized, 26 active+undersized+degraded, 95 active+clean; 585 KiB data, 187 MiB used, 715 GiB / 715 GiB avail; 96/726 objects degraded (13.223%) 2024-06-18T02:14:52.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:52.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:52.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:52.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:52.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:52.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:52.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:52.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:52.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:52.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:52.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:52.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:52.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:52.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:52.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:52.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:52.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:52.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:52.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:52.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:52.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:52.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:52.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[99735]: pgmap v239: 161 pgs: 40 active+undersized, 26 active+undersized+degraded, 95 active+clean; 585 KiB data, 187 MiB used, 715 GiB / 715 GiB avail; 96/726 objects degraded (13.223%) 2024-06-18T02:14:52.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:52.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:52.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:52.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:52.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:52.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:52.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:52.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:52.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:52.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:52.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:52 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:52.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:52 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:52.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:52 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:52.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:52.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:52.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:52 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:52.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:52 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:52.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:52.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:52.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:52.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:52.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:52 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:52.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:52 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:52.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:52.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:52.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:52.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:52.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:52 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:52.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:52 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:52.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:52.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:52.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:52.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:52.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:52 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:52.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:52 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:52.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:52.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:52.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:52.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:52.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:52 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:52.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:52 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:52.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:52.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:52.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:52.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:52.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:52 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:52.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:52 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:52.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:52.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:52.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:52.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:52.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:52 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:52.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:52 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:52.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:52 smithi130 ceph-mon[84407]: pgmap v239: 161 pgs: 40 active+undersized, 26 active+undersized+degraded, 95 active+clean; 585 KiB data, 187 MiB used, 715 GiB / 715 GiB avail; 96/726 objects degraded (13.223%) 2024-06-18T02:14:52.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:52.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:52.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:52.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:52.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:52 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:52.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:52 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:52.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:52.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:52.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:52.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:52.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:52 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:53.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:53 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:53.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:53 smithi130 ceph-mon[84407]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:14:53.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:53.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:53.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:53.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:53.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:53 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:53.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:53 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:53.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:53.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:53.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:53.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:53.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:53 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:53.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:53 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:53.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:53.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:53.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:53.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:53.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:53 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:53.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:53 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:53.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:53.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:53.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:53.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:53.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:53 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:53.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:53 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:53.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:53.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:53.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:53.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:53.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:53 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:53.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:53 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:53.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:53.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:53.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:53.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:53.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:53 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:53.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:53 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:53.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:53.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:53.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:53.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:53.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:53 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:53.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:53 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:53.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:53.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:53.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:53.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:53.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:53 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:53.357 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:53.357 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[113333]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:14:53.357 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:53.357 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:53.357 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:53.357 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:53.358 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:53.358 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:53.358 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:53.358 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:53.358 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:53.358 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:53.358 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:53.358 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:53.358 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:53.358 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:53.358 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:53.358 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:53.358 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:53.359 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:53.359 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:53.359 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:53.359 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:53.359 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:53.359 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:53.359 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:53.359 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:53.359 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:53.359 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:53.360 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:53.360 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[99735]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:14:53.360 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:53.360 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:53.360 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:53.360 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:53.360 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:53.360 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:53.360 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:53.360 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:53.360 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:53.360 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:53.361 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:53.361 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:53.361 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:53.361 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:53.361 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:53.361 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:53.361 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:53.361 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:53.361 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:53.361 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:53.361 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:53.361 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:53.361 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:53.362 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:53.362 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:53.362 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:53.362 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:53.362 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:53.362 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:53.362 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:53.362 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:53.362 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:53.362 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:53.363 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:53.363 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:53.363 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:53.363 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:53.363 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:53.363 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:53.363 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:53.363 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:53.363 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:53.363 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:53.363 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:53.363 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:53.363 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:53.364 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:53.364 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:53.364 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:53.364 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:53.364 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:53.364 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:53.364 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:53.364 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:53.364 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:53.364 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:53.364 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:53.364 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:53.365 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:53.365 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:53.365 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:53.365 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:53.365 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:53.365 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:53.365 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:53.365 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:53.365 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:53 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:54.315 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:54.315 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:54.315 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:54.315 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:54.315 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:54.315 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:54.315 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:54.315 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:54.315 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:54.315 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:54.315 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:54.316 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:54.316 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:54.316 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:54.316 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:54.316 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:54.316 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:54.316 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:54.316 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:54.316 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:54.316 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:54.316 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:54.316 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:54.316 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:54.316 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:54.317 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:54.317 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:54.317 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:54.317 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:54.317 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:54.317 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:54.317 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:54.317 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:54.317 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:54.317 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:54.317 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:54.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:54.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:54.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:54.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:54.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:54.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:54.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:54.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:54.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:54.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:54.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:54.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:54.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:54.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:54.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:54.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:54.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:54.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:54.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:54.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:54.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:54.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:54.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:54.320 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:54.320 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:54.320 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:54.320 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:54.320 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:54.320 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:54.320 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:54.320 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:54.320 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:54.320 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:54.320 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[99735]: pgmap v240: 161 pgs: 40 active+undersized, 26 active+undersized+degraded, 95 active+clean; 585 KiB data, 188 MiB used, 715 GiB / 715 GiB avail; 96/726 objects degraded (13.223%) 2024-06-18T02:14:54.320 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:54.321 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:54.321 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:54.321 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:54.321 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:54.321 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:54.321 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:54.321 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:54.321 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:54.321 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:54.321 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:54.321 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:54.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:54.322 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:54.322 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:54.322 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:54.322 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:54.322 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:54.322 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:54.322 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:54.322 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:54.322 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:54.322 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:54.322 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[113333]: pgmap v240: 161 pgs: 40 active+undersized, 26 active+undersized+degraded, 95 active+clean; 585 KiB data, 188 MiB used, 715 GiB / 715 GiB avail; 96/726 objects degraded (13.223%) 2024-06-18T02:14:54.322 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:54.322 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:54.322 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:54.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:54.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:54.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:54.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:54.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:54.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:54.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:54.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:54.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:54.507 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:54 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:54.507 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:54.508 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:54.508 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:54.508 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:54.508 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:54 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:54.508 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:54 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:54.508 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:54.508 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:54.508 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:54.508 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:54.508 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:54 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:54.509 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:54 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:54.509 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:54.509 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:54.509 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:54.509 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:54.509 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:54 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:54.509 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:54 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:54.509 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:54.509 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:54.510 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:54.510 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:54.510 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:54 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:54.510 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:54 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:54.510 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:54.510 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:54.510 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:54.510 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:54.510 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:54 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:54.511 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:54 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:54.511 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:54 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:54.511 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:54 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:54.511 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:54 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:54.512 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:54.512 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:54.512 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:54.512 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:54.512 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:54 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:54.512 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:54 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:54.512 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:54 smithi130 ceph-mon[84407]: pgmap v240: 161 pgs: 40 active+undersized, 26 active+undersized+degraded, 95 active+clean; 585 KiB data, 188 MiB used, 715 GiB / 715 GiB avail; 96/726 objects degraded (13.223%) 2024-06-18T02:14:54.512 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:54.512 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:54.513 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:54.513 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:54.513 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:54 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:54.513 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:54 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:54.513 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:54.513 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:54.513 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:54.513 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:54.513 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:54 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:54.514 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:54 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:54.672 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3[154398]: 2024-06-18T02:14:54.315+0000 7ff38aaae640 -1 osd.3 0 read_superblock omap replica is missing. 2024-06-18T02:14:54.673 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:14:54 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3[154398]: 2024-06-18T02:14:54.357+0000 7ff38aaae640 -1 osd.3 150 log_to_monitors true 2024-06-18T02:14:55.331 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:55.331 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:55.331 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:55.331 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:55.331 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:55.331 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:55.331 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:55.331 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:55.331 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:55.331 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:55.331 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:55.332 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:55.332 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[113333]: from='osd.3 [v2:172.21.15.7:6824/2515130704,v1:172.21.15.7:6825/2515130704]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-18T02:14:55.332 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[113333]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-18T02:14:55.332 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:55.332 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:55.332 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:55.332 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:55.332 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:55.332 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:55.332 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:55.332 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:55.332 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:55.332 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:55.332 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:55.332 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:55.333 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[113333]: Health check update: Degraded data redundancy: 96/726 objects degraded (13.223%), 26 pgs degraded (PG_DEGRADED) 2024-06-18T02:14:55.333 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:55.333 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:55.333 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:55.333 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:55.333 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:55.333 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:55.333 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:55.333 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:55.333 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:55.333 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:55.333 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:55.333 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:55.333 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:55.333 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:55.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:55.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:55.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:55.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:55.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:55.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:55.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:55.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:55.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:55.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:55.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:55.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:55.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:55.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:55.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:55.335 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:55.335 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:55.335 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:55.335 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:55.335 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:55.335 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:55.335 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:55.336 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:55.336 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:55.336 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:55.336 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:55.336 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:55.336 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[99735]: from='osd.3 [v2:172.21.15.7:6824/2515130704,v1:172.21.15.7:6825/2515130704]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-18T02:14:55.336 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[99735]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-18T02:14:55.336 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:55.336 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:55.336 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:55.336 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:55.336 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:55.336 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:55.337 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:55.337 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:55.337 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:55.337 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:55.337 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:55.337 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:55.337 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[99735]: Health check update: Degraded data redundancy: 96/726 objects degraded (13.223%), 26 pgs degraded (PG_DEGRADED) 2024-06-18T02:14:55.337 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:55.337 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:55.337 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:55.338 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:55.338 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:55.338 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:55.338 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:55.338 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:55.338 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:55.338 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:55.338 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:55.338 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:55.338 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:55.339 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:55.339 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:55.339 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:55.339 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:55.339 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:55.339 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:55.339 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:55.339 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:55.339 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:55.339 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:55.339 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:55.339 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:55.340 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:55.340 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:55.340 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:55.340 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:55.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:55.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:55.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:55.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:55.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:55 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:55.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:55 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:55.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:55.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:55.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:55.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:55.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:55 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:55.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:55 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:55.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:55 smithi130 ceph-mon[84407]: from='osd.3 [v2:172.21.15.7:6824/2515130704,v1:172.21.15.7:6825/2515130704]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-18T02:14:55.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:55 smithi130 ceph-mon[84407]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-18T02:14:55.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:55.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:55.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:55.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:55.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:55 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:55.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:55 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:55.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:55.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:55.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:55.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:55.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:55 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:55.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:55 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:55.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:55 smithi130 ceph-mon[84407]: Health check update: Degraded data redundancy: 96/726 objects degraded (13.223%), 26 pgs degraded (PG_DEGRADED) 2024-06-18T02:14:55.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:55.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:55.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:55.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:55.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:55 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:55.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:55 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:55.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:55.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:55.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:55.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:55.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:55 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:55.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:55 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:55.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:55.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:55.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:55.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:55.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:55 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:55.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:55 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:55.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:55.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:55.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:55.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:55.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:55 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:55.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:55 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:55.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:55.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:55.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:55.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:55.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:55 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:55.682 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:14:55 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3[154398]: 2024-06-18T02:14:55.353+0000 7ff382859640 -1 osd.3 150 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-18T02:14:56.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:56.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:56.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:56.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:56.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:56.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:56.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:56.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-06-18T02:14:56.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: osdmap e153: 8 total, 7 up, 8 in 2024-06-18T02:14:56.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: from='osd.3 [v2:172.21.15.7:6824/2515130704,v1:172.21.15.7:6825/2515130704]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-06-18T02:14:56.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-06-18T02:14:56.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:56.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:56.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:56.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:56.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:56.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:56.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:56.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:56.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:56.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:56.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:56.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:56.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:56.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:56.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:56.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:56.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:56.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:56.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:56.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:56.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:56.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:56.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:56.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:56.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:56.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-06-18T02:14:56.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: osdmap e153: 8 total, 7 up, 8 in 2024-06-18T02:14:56.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: from='osd.3 [v2:172.21.15.7:6824/2515130704,v1:172.21.15.7:6825/2515130704]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-06-18T02:14:56.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-06-18T02:14:56.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:56.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:56.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:56.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:56.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:56.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:56.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:56.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:56.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:56.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:56.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:56.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:56.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:56.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:56.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:56.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:56.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:56.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:56.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:56.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:56.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:56.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:56.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:56.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:56.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:56.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:56.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:56.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:56.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:56.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:56.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:56.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:56.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:56.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:56.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:56.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:56.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: pgmap v242: 161 pgs: 40 active+undersized, 26 active+undersized+degraded, 95 active+clean; 585 KiB data, 198 MiB used, 715 GiB / 715 GiB avail; 96/726 objects degraded (13.223%) 2024-06-18T02:14:56.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:56.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:56.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:56.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:56.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:56.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:56.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:56.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:56.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:56.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:56.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:56.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:56.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:56.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:56.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:56.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:56.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:56.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:56.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:56.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:56.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:56.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:56.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:56.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:56.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:56.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:56.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:56.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:56.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:56.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: pgmap v242: 161 pgs: 40 active+undersized, 26 active+undersized+degraded, 95 active+clean; 585 KiB data, 198 MiB used, 715 GiB / 715 GiB avail; 96/726 objects degraded (13.223%) 2024-06-18T02:14:56.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:56.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:56.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:56.441 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:56.441 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:56.441 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:56.441 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:56.441 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:56.441 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:56.441 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:56.441 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:56 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:56.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:56.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:56.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:56.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:56.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:56.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:56.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:56.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-06-18T02:14:56.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: osdmap e153: 8 total, 7 up, 8 in 2024-06-18T02:14:56.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: from='osd.3 [v2:172.21.15.7:6824/2515130704,v1:172.21.15.7:6825/2515130704]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-06-18T02:14:56.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-06-18T02:14:56.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:56.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:56.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:56.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:56.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:56.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:56.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:56.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:56.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:56.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:56.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:56.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:56.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:56.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:56.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:56.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:56.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:56.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:56.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:56.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:56.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:56.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:56.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:56.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:56.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:56.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:56.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:56.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:56.549 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:56.549 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:56.549 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:56.549 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:56.549 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:56.549 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:56.549 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:56.549 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:56.549 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: pgmap v242: 161 pgs: 40 active+undersized, 26 active+undersized+degraded, 95 active+clean; 585 KiB data, 198 MiB used, 715 GiB / 715 GiB avail; 96/726 objects degraded (13.223%) 2024-06-18T02:14:56.550 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:56.550 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:56.550 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:56.550 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:56.550 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:56.550 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:56.550 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:56.550 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:56.550 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:56.550 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:56.551 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:56 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:57.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:57.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:57.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:14:57.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:57.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:57.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:57.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:57.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:57.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:57.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-06-18T02:14:57.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: osd.3 [v2:172.21.15.7:6824/2515130704,v1:172.21.15.7:6825/2515130704] boot 2024-06-18T02:14:57.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: osdmap e154: 8 total, 8 up, 8 in 2024-06-18T02:14:57.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-18T02:14:57.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:57.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:57.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:57.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:57.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:57.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:57.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:57.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:57.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:57.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:57.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:57.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:57.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:57.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:57.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:57.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:57.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:57.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:57.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:57.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:57.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:14:57.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:57.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:57.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:57.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:57.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:57.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:57.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-06-18T02:14:57.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: osd.3 [v2:172.21.15.7:6824/2515130704,v1:172.21.15.7:6825/2515130704] boot 2024-06-18T02:14:57.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: osdmap e154: 8 total, 8 up, 8 in 2024-06-18T02:14:57.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-18T02:14:57.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:57.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:57.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:57.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:57.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:57.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:57.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:57.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:57.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:57.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:57.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:57.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:57.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:57.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:57.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:57.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:57.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:57.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:57.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:57.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:57.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:57.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:57.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:57.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:57.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:57.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:57.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:57.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:57.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:57.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:57.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:57.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:57.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:57.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:57.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:57.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:57.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:57.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:57.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:57.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:57.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:57.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:57.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:57.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:57.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:57.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:57.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:57.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:57.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:57.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:57.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:57.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:57.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:57.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:57.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:57.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:57.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:57.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:57.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:57.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:57.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:57.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:57.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:57.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:57.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:57.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:57.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:57.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:57.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:57.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:57.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:57.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:57.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:57.442 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:57.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:57.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:57.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:14:57.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:57.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:57.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:57.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:57.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:57.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:57.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-06-18T02:14:57.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: osd.3 [v2:172.21.15.7:6824/2515130704,v1:172.21.15.7:6825/2515130704] boot 2024-06-18T02:14:57.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: osdmap e154: 8 total, 8 up, 8 in 2024-06-18T02:14:57.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-18T02:14:57.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:57.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:57.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:57.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:57.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:57.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:57.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:57.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:57.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:57.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:57.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:57.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:57.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:57.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:57.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:57.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:57.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:57.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:57.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:57.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:57.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:57.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:57.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:57.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:57.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:57.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:57.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:57.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:57.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:57.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:57.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:57.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:57.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:57.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:57.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:57.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:57.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:57.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:57.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:57.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:57.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:57.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:57.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:57.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:57.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:57.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:58.210 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:14:57 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:14:57] "GET /metrics HTTP/1.1" 200 38270 "" "Prometheus/2.33.4" 2024-06-18T02:14:58.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:58.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:58.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:58.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:58.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:58.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:58.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:58.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:58.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[113333]: osdmap e155: 8 total, 8 up, 8 in 2024-06-18T02:14:58.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:58.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:58.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:58.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:58.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:58.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:58.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:58.307 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:58.307 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:58.307 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:58.307 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:58.307 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:58.307 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:58.307 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:58.307 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:58.307 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:58.307 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:58.307 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:58.307 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:58.307 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:58.307 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:58.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:58.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:58.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:58.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:58.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:58.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:58.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:58.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:58.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[99735]: osdmap e155: 8 total, 8 up, 8 in 2024-06-18T02:14:58.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:58.309 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:58.309 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:58.309 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:58.309 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:58.309 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:58.309 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:58.309 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:58.309 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:58.309 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:58.309 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:58.309 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:58.309 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:58.309 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:58.310 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:58.310 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:58.310 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:58.310 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:58.310 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:58.310 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:58.310 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:58.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:58.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:58.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:58.313 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:58.313 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:58.313 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:58.313 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:58.313 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:58.313 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:58.313 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[113333]: pgmap v245: 161 pgs: 16 peering, 30 active+undersized, 20 active+undersized+degraded, 95 active+clean; 585 KiB data, 198 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 75/726 objects degraded (10.331%) 2024-06-18T02:14:58.313 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:58.314 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:58.314 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:58.314 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:58.314 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:58.314 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:58.314 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:58.314 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:58.314 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:58.314 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:58.314 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:58.315 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:58.315 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:58.315 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:58.315 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:58.315 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:58.315 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:58.315 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:58.315 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:58.315 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:58.315 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[99735]: pgmap v245: 161 pgs: 16 peering, 30 active+undersized, 20 active+undersized+degraded, 95 active+clean; 585 KiB data, 198 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 75/726 objects degraded (10.331%) 2024-06-18T02:14:58.315 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:58.315 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:58.315 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:58.316 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:58.316 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:58.316 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:58.316 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:58.316 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:58.316 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:58.316 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:58.316 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:58 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:58.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:58 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:58.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:58 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:58.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:58.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:58.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:58.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:58.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:58 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:58.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:58 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:58.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:58 smithi130 ceph-mon[84407]: osdmap e155: 8 total, 8 up, 8 in 2024-06-18T02:14:58.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:58.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:58.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:58.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:58.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:58 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:58.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:58 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:58.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:58.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:58.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:58.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:58.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:58 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:58.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:58 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:58.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:58.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:58.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:58.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:58.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:58 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:58.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:58 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:58.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:58.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:58.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:58.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:58.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:58 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:58.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:58 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:58.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:58.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:58.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:58.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:58.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:58 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:58.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:58 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:58.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:58 smithi130 ceph-mon[84407]: pgmap v245: 161 pgs: 16 peering, 30 active+undersized, 20 active+undersized+degraded, 95 active+clean; 585 KiB data, 198 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 75/726 objects degraded (10.331%) 2024-06-18T02:14:58.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:58.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:58.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:58.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:58.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:58 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:58.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:58 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:58.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:58.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:58.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:58.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:58.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:58 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:59.417 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:59.417 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:59.417 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:59.417 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:59.418 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:59.418 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:59.418 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:59.418 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:59.418 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:59.418 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:59.418 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:59.418 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:59.418 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:59.418 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:59.418 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:59.418 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:59.418 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:59.418 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:59.419 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:59.419 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:59.419 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:59.419 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:59.419 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:59.419 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:59.419 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:59.419 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:59.419 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:59.419 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:59.419 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:59.420 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:59.420 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:59.420 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:59.420 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:59.420 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:59.420 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:59.420 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:59.420 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:59.420 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:59.420 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:59.420 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:59.420 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:59.420 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:59.420 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:59.421 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:59.421 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:59.421 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:59.421 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:59.421 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:59.421 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:59.421 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:59.421 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:59.421 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:59.421 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:59.421 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:59.421 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:59.421 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:59.421 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:59.422 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:59.422 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:59.422 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:59.422 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:59.422 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:59.422 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:59.422 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:59.422 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:59.422 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:59.422 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:59.423 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:59.423 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:59.423 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:59.423 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:59.423 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:59.423 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:59.423 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:59.423 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:59.423 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:59.423 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:59.423 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:59.423 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:59.423 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:59.423 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:59.424 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:59.424 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:59.424 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:59.424 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:59.424 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:59.424 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:59.424 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:59.424 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:59.424 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:59.424 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:59.424 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:59.425 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:59.425 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:59.425 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:59.425 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:59.425 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:59.425 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:59.425 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:59.425 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:59.425 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:59.425 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:59.425 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:59.425 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:59.425 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:59.425 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:59.426 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:59.426 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:14:59 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:59.543 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:14:59 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:14:59.387+0000 7f680f9b8640 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2024-06-18T02:14:59.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:59 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:59.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:59.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:59.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:59.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:59.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:59 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:59.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:59 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:59.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:59.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:59.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:59.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:59.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:59 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:59.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:59 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:59.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:59.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:59.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:59.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:59.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:59 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:59.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:59 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:59.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:59.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:59.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:59.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:59.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:59 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:59.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:59 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:59.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:59.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:59.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:59.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:59.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:59 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:59.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:59 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:59.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:59.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:59.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:59.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:59.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:59 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:59.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:59 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:59.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:59.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:59.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:59.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:59.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:59 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:59.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:59 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:59.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:59.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:59.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:59.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:59.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:59 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:14:59.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:59 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:14:59.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:14:59.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:14:59.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:14:59.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:14:59.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:14:59 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:00.375 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:00 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:00.375 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:00.375 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:00.375 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:00.375 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:00.375 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:00 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:00.375 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:00 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:00.375 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:00 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:00.376 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:00 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:00.376 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:00 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:00.376 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:00.376 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:00.376 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:00.376 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:00.376 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-06-18T02:15:00.376 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:00 smithi007 ceph-mon[99735]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-06-18T02:15:00.376 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:00 smithi007 ceph-mon[99735]: Upgrade: unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2024-06-18T02:15:00.376 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:00 smithi007 ceph-mon[99735]: Health check update: Degraded data redundancy: 75/726 objects degraded (10.331%), 20 pgs degraded (PG_DEGRADED) 2024-06-18T02:15:00.376 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:00 smithi007 ceph-mon[99735]: pgmap v246: 161 pgs: 16 peering, 24 active+undersized, 16 active+undersized+degraded, 105 active+clean; 585 KiB data, 198 MiB used, 715 GiB / 715 GiB avail; 58/726 objects degraded (7.989%) 2024-06-18T02:15:00.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:00 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:00.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:00.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:00.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:00.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:00.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:00 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:00.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:00 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:00.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:00 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:00.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:00 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:00.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:00 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:00.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:00.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:00.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:00.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:00.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-06-18T02:15:00.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:00 smithi007 ceph-mon[113333]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-06-18T02:15:00.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:00 smithi007 ceph-mon[113333]: Upgrade: unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2024-06-18T02:15:00.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:00 smithi007 ceph-mon[113333]: Health check update: Degraded data redundancy: 75/726 objects degraded (10.331%), 20 pgs degraded (PG_DEGRADED) 2024-06-18T02:15:00.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:00 smithi007 ceph-mon[113333]: pgmap v246: 161 pgs: 16 peering, 24 active+undersized, 16 active+undersized+degraded, 105 active+clean; 585 KiB data, 198 MiB used, 715 GiB / 715 GiB avail; 58/726 objects degraded (7.989%) 2024-06-18T02:15:00.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:00 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:00.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:00.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:00.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:00.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:00.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:00 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:00.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:00 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:00.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:00 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:00.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:00 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:00.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:00 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:00.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:00.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:00.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:00.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:00.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-06-18T02:15:00.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:00 smithi130 ceph-mon[84407]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-06-18T02:15:00.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:00 smithi130 ceph-mon[84407]: Upgrade: unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2024-06-18T02:15:00.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:00 smithi130 ceph-mon[84407]: Health check update: Degraded data redundancy: 75/726 objects degraded (10.331%), 20 pgs degraded (PG_DEGRADED) 2024-06-18T02:15:00.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:00 smithi130 ceph-mon[84407]: pgmap v246: 161 pgs: 16 peering, 24 active+undersized, 16 active+undersized+degraded, 105 active+clean; 585 KiB data, 198 MiB used, 715 GiB / 715 GiB avail; 58/726 objects degraded (7.989%) 2024-06-18T02:15:02.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:02 smithi007 ceph-mon[113333]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 58/726 objects degraded (7.989%), 16 pgs degraded) 2024-06-18T02:15:02.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:02 smithi007 ceph-mon[113333]: Cluster is now healthy 2024-06-18T02:15:02.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:02 smithi007 ceph-mon[99735]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 58/726 objects degraded (7.989%), 16 pgs degraded) 2024-06-18T02:15:02.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:02 smithi007 ceph-mon[99735]: Cluster is now healthy 2024-06-18T02:15:02.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:02 smithi130 ceph-mon[84407]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 58/726 objects degraded (7.989%), 16 pgs degraded) 2024-06-18T02:15:02.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:02 smithi130 ceph-mon[84407]: Cluster is now healthy 2024-06-18T02:15:03.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:03 smithi007 ceph-mon[113333]: pgmap v247: 161 pgs: 16 peering, 145 active+clean; 585 KiB data, 198 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:15:03.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:03 smithi007 ceph-mon[99735]: pgmap v247: 161 pgs: 16 peering, 145 active+clean; 585 KiB data, 198 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:15:03.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:03 smithi130 ceph-mon[84407]: pgmap v247: 161 pgs: 16 peering, 145 active+clean; 585 KiB data, 198 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:15:04.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:04 smithi007 ceph-mon[113333]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:15:04.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:04 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:04.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:04 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:04.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:04 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:04.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:04 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:04.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:04 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:04.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:04 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:04.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:04 smithi007 ceph-mon[99735]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:15:04.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:04 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:04.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:04 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:04.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:04 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:04.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:04 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:04.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:04 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:04.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:04 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:04.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:04 smithi130 ceph-mon[84407]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:15:04.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:04 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:04.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:04 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:04.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:04 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:04.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:04 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:04.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:04 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:04.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:04 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:05.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:05 smithi007 ceph-mon[113333]: pgmap v248: 161 pgs: 161 active+clean; 585 KiB data, 198 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:15:05.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:05 smithi007 ceph-mon[99735]: pgmap v248: 161 pgs: 161 active+clean; 585 KiB data, 198 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:15:05.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:05 smithi130 ceph-mon[84407]: pgmap v248: 161 pgs: 161 active+clean; 585 KiB data, 198 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:15:07.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:07 smithi007 ceph-mon[113333]: pgmap v249: 161 pgs: 161 active+clean; 585 KiB data, 198 MiB used, 715 GiB / 715 GiB avail; 212 B/s rd, 0 op/s 2024-06-18T02:15:07.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:07 smithi007 ceph-mon[99735]: pgmap v249: 161 pgs: 161 active+clean; 585 KiB data, 198 MiB used, 715 GiB / 715 GiB avail; 212 B/s rd, 0 op/s 2024-06-18T02:15:07.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:07 smithi130 ceph-mon[84407]: pgmap v249: 161 pgs: 161 active+clean; 585 KiB data, 198 MiB used, 715 GiB / 715 GiB avail; 212 B/s rd, 0 op/s 2024-06-18T02:15:08.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:15:07 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:15:07] "GET /metrics HTTP/1.1" 200 38270 "" "Prometheus/2.33.4" 2024-06-18T02:15:09.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:09 smithi007 ceph-mon[113333]: pgmap v250: 161 pgs: 161 active+clean; 585 KiB data, 198 MiB used, 715 GiB / 715 GiB avail; 192 B/s rd, 0 op/s 2024-06-18T02:15:09.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:09 smithi007 ceph-mon[99735]: pgmap v250: 161 pgs: 161 active+clean; 585 KiB data, 198 MiB used, 715 GiB / 715 GiB avail; 192 B/s rd, 0 op/s 2024-06-18T02:15:09.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:09 smithi130 ceph-mon[84407]: pgmap v250: 161 pgs: 161 active+clean; 585 KiB data, 198 MiB used, 715 GiB / 715 GiB avail; 192 B/s rd, 0 op/s 2024-06-18T02:15:11.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:11 smithi007 ceph-mon[113333]: pgmap v251: 161 pgs: 161 active+clean; 585 KiB data, 198 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-06-18T02:15:11.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:11 smithi007 ceph-mon[99735]: pgmap v251: 161 pgs: 161 active+clean; 585 KiB data, 198 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-06-18T02:15:11.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:11 smithi130 ceph-mon[84407]: pgmap v251: 161 pgs: 161 active+clean; 585 KiB data, 198 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-06-18T02:15:12.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:12 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:12.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:15:12.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:12 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:12.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:12 smithi130 ceph-mon[84407]: pgmap v252: 161 pgs: 161 active+clean; 585 KiB data, 198 MiB used, 715 GiB / 715 GiB avail; 597 B/s rd, 0 op/s 2024-06-18T02:15:12.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:12 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:12.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:15:12.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:12 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:12.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:12 smithi007 ceph-mon[113333]: pgmap v252: 161 pgs: 161 active+clean; 585 KiB data, 198 MiB used, 715 GiB / 715 GiB avail; 597 B/s rd, 0 op/s 2024-06-18T02:15:12.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:12 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:12.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:15:12.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:12 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:12.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:12 smithi007 ceph-mon[99735]: pgmap v252: 161 pgs: 161 active+clean; 585 KiB data, 198 MiB used, 715 GiB / 715 GiB avail; 597 B/s rd, 0 op/s 2024-06-18T02:15:13.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:13 smithi130 ceph-mon[84407]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:15:13.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:13 smithi007 ceph-mon[113333]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:15:13.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:13 smithi007 ceph-mon[99735]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:15:15.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:14 smithi007 ceph-mon[113333]: pgmap v253: 161 pgs: 161 active+clean; 585 KiB data, 198 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:15:15.085 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:14 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:15.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:14 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:15.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:14 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:15.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-06-18T02:15:15.086 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:14 smithi007 ceph-mon[99735]: pgmap v253: 161 pgs: 161 active+clean; 585 KiB data, 198 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:15:15.086 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:14 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:15.086 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:14 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:15.086 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:14 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:15.086 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-06-18T02:15:15.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:14 smithi130 ceph-mon[84407]: pgmap v253: 161 pgs: 161 active+clean; 585 KiB data, 198 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:15:15.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:14 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:15.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:14 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:15.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:14 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:15.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-06-18T02:15:16.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:15 smithi007 ceph-mon[113333]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-06-18T02:15:16.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:15 smithi007 ceph-mon[113333]: Upgrade: osd.3 is safe to restart 2024-06-18T02:15:16.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-06-18T02:15:16.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:16.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:15 smithi007 ceph-mon[99735]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-06-18T02:15:16.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:15 smithi007 ceph-mon[99735]: Upgrade: osd.3 is safe to restart 2024-06-18T02:15:16.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-06-18T02:15:16.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:16.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:15 smithi130 ceph-mon[84407]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-06-18T02:15:16.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:15 smithi130 ceph-mon[84407]: Upgrade: osd.3 is safe to restart 2024-06-18T02:15:16.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-06-18T02:15:16.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:17.095 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:16 smithi007 ceph-mon[113333]: Upgrade: Updating osd.3 2024-06-18T02:15:17.095 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:16 smithi007 ceph-mon[113333]: Deploying daemon osd.3 on smithi007 2024-06-18T02:15:17.095 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:16 smithi007 ceph-mon[113333]: pgmap v254: 161 pgs: 161 active+clean; 585 KiB data, 198 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:15:17.095 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:16 smithi007 ceph-mon[99735]: Upgrade: Updating osd.3 2024-06-18T02:15:17.096 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:16 smithi007 ceph-mon[99735]: Deploying daemon osd.3 on smithi007 2024-06-18T02:15:17.096 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:16 smithi007 ceph-mon[99735]: pgmap v254: 161 pgs: 161 active+clean; 585 KiB data, 198 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:15:17.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:16 smithi130 ceph-mon[84407]: Upgrade: Updating osd.3 2024-06-18T02:15:17.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:16 smithi130 ceph-mon[84407]: Deploying daemon osd.3 on smithi007 2024-06-18T02:15:17.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:16 smithi130 ceph-mon[84407]: pgmap v254: 161 pgs: 161 active+clean; 585 KiB data, 198 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:15:18.195 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:15:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:15:17] "GET /metrics HTTP/1.1" 200 38417 "" "Prometheus/2.33.4" 2024-06-18T02:15:19.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:18 smithi007 ceph-mon[113333]: pgmap v255: 161 pgs: 161 active+clean; 585 KiB data, 198 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:15:19.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:18 smithi007 ceph-mon[99735]: pgmap v255: 161 pgs: 161 active+clean; 585 KiB data, 198 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:15:19.182 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:15:18 smithi007 systemd[1]: Stopping Ceph osd.3 for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:15:19.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:18 smithi130 ceph-mon[84407]: pgmap v255: 161 pgs: 161 active+clean; 585 KiB data, 198 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:15:19.681 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:15:19 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3[154398]: 2024-06-18T02:15:19.191+0000 7ff387a46640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-18T02:15:19.682 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:15:19 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3[154398]: 2024-06-18T02:15:19.191+0000 7ff387a46640 -1 osd.3 155 *** Got signal Terminated *** 2024-06-18T02:15:19.682 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:15:19 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3[154398]: 2024-06-18T02:15:19.191+0000 7ff387a46640 -1 osd.3 155 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-18T02:15:20.087 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:19 smithi007 ceph-mon[113333]: osd.3 marked itself down and dead 2024-06-18T02:15:20.088 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:19 smithi007 ceph-mon[99735]: osd.3 marked itself down and dead 2024-06-18T02:15:20.292 INFO:teuthology.orchestra.run.smithi007.stdout:true 2024-06-18T02:15:20.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:19 smithi130 ceph-mon[84407]: osd.3 marked itself down and dead 2024-06-18T02:15:20.931 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:15:20 smithi007 podman[158653]: 2024-06-18 02:15:20.691942045 +0000 UTC m=+1.594131400 container died b8e85735efff193bcc83afad3f9e0e614e4f32f2c28cec950a3eccd986a16b12 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240612, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-3781e3a, ceph=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, maintainer=Guillaume Abrioux ) 2024-06-18T02:15:20.983 INFO:teuthology.orchestra.run.smithi007.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-18T02:15:20.983 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi007 smithi007 running 17s ago 18m - - 2024-06-18T02:15:20.983 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi130 smithi130 running 7s ago 18m - - 2024-06-18T02:15:20.983 INFO:teuthology.orchestra.run.smithi007.stdout:alertmanager.a smithi007 *:9093,9094 running (8m) 17s ago 13m 23.6M - 0.23.0 ba2b418f427c 5994e8525c64 2024-06-18T02:15:20.983 INFO:teuthology.orchestra.run.smithi007.stdout:grafana.a smithi130 *:3000 running (7m) 7s ago 12m 49.8M - 8.3.5 dad864ee21e9 70ba81d97c8e 2024-06-18T02:15:20.984 INFO:teuthology.orchestra.run.smithi007.stdout:iscsi.foo.smithi007.xvdrwd smithi007 running (6m) 17s ago 11m 61.8M - 3.5 e1d6a67b021e 94121ad2702c 2024-06-18T02:15:20.984 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.x smithi130 *:8443,9283,8765 running (7m) 7s ago 17m 530M - 19.0.0-3124-g3781e3a5 af93c036e016 01017e37bdbe 2024-06-18T02:15:20.984 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.y smithi007 *:8443,9283,8765 running (5m) 17s ago 19m 443M - 19.0.0-3124-g3781e3a5 af93c036e016 2141e131e896 2024-06-18T02:15:20.984 INFO:teuthology.orchestra.run.smithi007.stdout:mon.a smithi007 running (3m) 17s ago 19m 57.5M 2048M 19.0.0-3124-g3781e3a5 af93c036e016 7bbe646cd5b7 2024-06-18T02:15:20.984 INFO:teuthology.orchestra.run.smithi007.stdout:mon.b smithi130 running (4m) 7s ago 18m 54.0M 2048M 19.0.0-3124-g3781e3a5 af93c036e016 baacf2add994 2024-06-18T02:15:20.984 INFO:teuthology.orchestra.run.smithi007.stdout:mon.c smithi007 running (4m) 17s ago 18m 56.9M 2048M 19.0.0-3124-g3781e3a5 af93c036e016 39418356156e 2024-06-18T02:15:20.984 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.a smithi007 *:9100 running (8m) 17s ago 13m 17.6M - 1.3.1 1dbe0e931976 8128e558f099 2024-06-18T02:15:20.984 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.b smithi130 *:9100 running (7m) 7s ago 13m 16.2M - 1.3.1 1dbe0e931976 bab93b43cf16 2024-06-18T02:15:20.984 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0 smithi007 running (2m) 17s ago 17m 49.4M 4096M 19.0.0-3124-g3781e3a5 af93c036e016 07c7f4afd49a 2024-06-18T02:15:20.984 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1 smithi007 running (105s) 17s ago 17m 45.8M 4096M 19.0.0-3124-g3781e3a5 af93c036e016 e8d184614e94 2024-06-18T02:15:20.984 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2 smithi007 running (55s) 17s ago 16m 42.5M 4096M 19.0.0-3124-g3781e3a5 af93c036e016 7d9a05b4bfa5 2024-06-18T02:15:20.984 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3 smithi007 running (30s) 17s ago 16m 43.9M 4096M 19.0.0-3124-g3781e3a5 af93c036e016 b8e85735efff 2024-06-18T02:15:20.984 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4 smithi130 running (15m) 7s ago 15m 64.9M 4096M 17.2.0 e1d6a67b021e c428dccffdf0 2024-06-18T02:15:20.984 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5 smithi130 running (15m) 7s ago 15m 63.3M 4096M 17.2.0 e1d6a67b021e f645d7f12378 2024-06-18T02:15:20.985 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6 smithi130 running (15m) 7s ago 15m 57.7M 4096M 17.2.0 e1d6a67b021e c7af86c14959 2024-06-18T02:15:20.985 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7 smithi130 running (14m) 7s ago 14m 63.2M 4096M 17.2.0 e1d6a67b021e 3688af8b2c46 2024-06-18T02:15:20.985 INFO:teuthology.orchestra.run.smithi007.stdout:prometheus.a smithi130 *:9095 running (6m) 7s ago 13m 75.8M - 2.33.4 514e6a882f6e e905fb2eb4a6 2024-06-18T02:15:20.985 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi007.dvbvbk smithi007 *:8000 running (12m) 17s ago 12m 78.0M - 17.2.0 e1d6a67b021e 1344b55b763c 2024-06-18T02:15:20.985 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi130.aakmof smithi130 *:8000 running (12m) 7s ago 12m 75.7M - 17.2.0 e1d6a67b021e e257e3230c6c 2024-06-18T02:15:20.985 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi007.hgrnmk smithi007 *:80 running (11m) 17s ago 11m 75.9M - 17.2.0 e1d6a67b021e 2173947bc4d6 2024-06-18T02:15:20.985 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi130.wwebfk smithi130 *:80 running (11m) 7s ago 11m 77.7M - 17.2.0 e1d6a67b021e 8662706b2231 2024-06-18T02:15:21.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:20 smithi130 ceph-mon[84407]: pgmap v256: 161 pgs: 161 active+clean; 585 KiB data, 198 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:15:21.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:20 smithi130 ceph-mon[84407]: Health check failed: 1 osds down (OSD_DOWN) 2024-06-18T02:15:21.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:20 smithi130 ceph-mon[84407]: osdmap e156: 8 total, 7 up, 8 in 2024-06-18T02:15:21.327 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:20 smithi007 ceph-mon[113333]: pgmap v256: 161 pgs: 161 active+clean; 585 KiB data, 198 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:15:21.327 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:20 smithi007 ceph-mon[113333]: Health check failed: 1 osds down (OSD_DOWN) 2024-06-18T02:15:21.327 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:20 smithi007 ceph-mon[113333]: osdmap e156: 8 total, 7 up, 8 in 2024-06-18T02:15:21.328 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:20 smithi007 ceph-mon[99735]: pgmap v256: 161 pgs: 161 active+clean; 585 KiB data, 198 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:15:21.328 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:20 smithi007 ceph-mon[99735]: Health check failed: 1 osds down (OSD_DOWN) 2024-06-18T02:15:21.328 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:20 smithi007 ceph-mon[99735]: osdmap e156: 8 total, 7 up, 8 in 2024-06-18T02:15:21.328 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:15:21 smithi007 podman[158653]: 2024-06-18 02:15:21.136272839 +0000 UTC m=+2.038462190 container cleanup b8e85735efff193bcc83afad3f9e0e614e4f32f2c28cec950a3eccd986a16b12 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-3781e3a, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240612, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS) 2024-06-18T02:15:21.328 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:15:21 smithi007 bash[158653]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3 2024-06-18T02:15:21.418 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:15:21.419 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": { 2024-06-18T02:15:21.419 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 3 2024-06-18T02:15:21.419 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:15:21.419 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": { 2024-06-18T02:15:21.419 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 2 2024-06-18T02:15:21.419 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:15:21.419 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": { 2024-06-18T02:15:21.419 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4, 2024-06-18T02:15:21.419 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 3 2024-06-18T02:15:21.419 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:15:21.419 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw": { 2024-06-18T02:15:21.419 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-06-18T02:15:21.420 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:15:21.420 INFO:teuthology.orchestra.run.smithi007.stdout: "overall": { 2024-06-18T02:15:21.420 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8, 2024-06-18T02:15:21.420 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 8 2024-06-18T02:15:21.420 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-06-18T02:15:21.420 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:15:21.778 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:15:21.778 INFO:teuthology.orchestra.run.smithi007.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00", 2024-06-18T02:15:21.778 INFO:teuthology.orchestra.run.smithi007.stdout: "in_progress": true, 2024-06-18T02:15:21.778 INFO:teuthology.orchestra.run.smithi007.stdout: "which": "Upgrading all daemon types on all hosts", 2024-06-18T02:15:21.778 INFO:teuthology.orchestra.run.smithi007.stdout: "services_complete": [ 2024-06-18T02:15:21.778 INFO:teuthology.orchestra.run.smithi007.stdout: "mon", 2024-06-18T02:15:21.779 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr" 2024-06-18T02:15:21.779 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-06-18T02:15:21.779 INFO:teuthology.orchestra.run.smithi007.stdout: "progress": "9/23 daemons upgraded", 2024-06-18T02:15:21.779 INFO:teuthology.orchestra.run.smithi007.stdout: "message": "Currently upgrading osd daemons", 2024-06-18T02:15:21.779 INFO:teuthology.orchestra.run.smithi007.stdout: "is_paused": false 2024-06-18T02:15:21.779 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:15:22.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:21 smithi007 ceph-mon[113333]: from='client.54403 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:15:22.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:21 smithi007 ceph-mon[113333]: from='client.54409 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:15:22.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:21 smithi007 ceph-mon[113333]: from='client.54415 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:15:22.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:21 smithi007 ceph-mon[113333]: osdmap e157: 8 total, 7 up, 8 in 2024-06-18T02:15:22.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:21 smithi007 ceph-mon[113333]: from='client.? 172.21.15.7:0/1194711634' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:22.042 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:15:21 smithi007 podman[158850]: 2024-06-18 02:15:21.756567046 +0000 UTC m=+1.384301920 container remove b8e85735efff193bcc83afad3f9e0e614e4f32f2c28cec950a3eccd986a16b12 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.build-date=20240612, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-3781e3a, maintainer=Guillaume Abrioux ) 2024-06-18T02:15:22.042 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:21 smithi007 ceph-mon[99735]: from='client.54403 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:15:22.043 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:21 smithi007 ceph-mon[99735]: from='client.54409 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:15:22.043 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:21 smithi007 ceph-mon[99735]: from='client.54415 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:15:22.043 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:21 smithi007 ceph-mon[99735]: osdmap e157: 8 total, 7 up, 8 in 2024-06-18T02:15:22.043 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:21 smithi007 ceph-mon[99735]: from='client.? 172.21.15.7:0/1194711634' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:22.248 INFO:teuthology.orchestra.run.smithi007.stdout:HEALTH_WARN 1 osds down 2024-06-18T02:15:22.249 INFO:teuthology.orchestra.run.smithi007.stdout:[WRN] OSD_DOWN: 1 osds down 2024-06-18T02:15:22.249 INFO:teuthology.orchestra.run.smithi007.stdout: osd.3 (root=default,host=smithi007) is down 2024-06-18T02:15:22.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:21 smithi130 ceph-mon[84407]: from='client.54403 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:15:22.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:21 smithi130 ceph-mon[84407]: from='client.54409 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:15:22.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:21 smithi130 ceph-mon[84407]: from='client.54415 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:15:22.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:21 smithi130 ceph-mon[84407]: osdmap e157: 8 total, 7 up, 8 in 2024-06-18T02:15:22.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:21 smithi130 ceph-mon[84407]: from='client.? 172.21.15.7:0/1194711634' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:23.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:22 smithi007 ceph-mon[113333]: from='client.94383 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:15:23.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:22 smithi007 ceph-mon[113333]: pgmap v259: 161 pgs: 13 peering, 27 stale+active+clean, 121 active+clean; 585 KiB data, 198 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-06-18T02:15:23.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:22 smithi007 ceph-mon[113333]: from='client.? 172.21.15.7:0/357539889' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:15:23.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:22 smithi007 ceph-mon[99735]: from='client.94383 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:15:23.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:22 smithi007 ceph-mon[99735]: pgmap v259: 161 pgs: 13 peering, 27 stale+active+clean, 121 active+clean; 585 KiB data, 198 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-06-18T02:15:23.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:22 smithi007 ceph-mon[99735]: from='client.? 172.21.15.7:0/357539889' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:15:23.182 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:15:23 smithi007 podman[159162]: 2024-06-18 02:15:23.072860077 +0000 UTC m=+0.102280756 container create 4f12553ea0a68d5896b0d26055b4289ec807e72a65e579756929500fa78db4b5 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, ceph=True, RELEASE=squid-3781e3a, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240612, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-18T02:15:23.183 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:15:23 smithi007 podman[159162]: 2024-06-18 02:15:22.991554399 +0000 UTC m=+0.020975086 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:15:23.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:22 smithi130 ceph-mon[84407]: from='client.94383 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:15:23.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:22 smithi130 ceph-mon[84407]: pgmap v259: 161 pgs: 13 peering, 27 stale+active+clean, 121 active+clean; 585 KiB data, 198 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-06-18T02:15:23.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:22 smithi130 ceph-mon[84407]: from='client.? 172.21.15.7:0/357539889' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:15:23.619 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:15:23 smithi007 podman[159162]: 2024-06-18 02:15:23.32556475 +0000 UTC m=+0.354985438 container init 4f12553ea0a68d5896b0d26055b4289ec807e72a65e579756929500fa78db4b5 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240612, GIT_BRANCH=HEAD, RELEASE=squid-3781e3a) 2024-06-18T02:15:23.619 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:15:23 smithi007 podman[159162]: 2024-06-18 02:15:23.329234152 +0000 UTC m=+0.358654830 container start 4f12553ea0a68d5896b0d26055b4289ec807e72a65e579756929500fa78db4b5 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3-deactivate, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, RELEASE=squid-3781e3a, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240612, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-06-18T02:15:23.619 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:15:23 smithi007 podman[159162]: 2024-06-18 02:15:23.433831681 +0000 UTC m=+0.463252360 container attach 4f12553ea0a68d5896b0d26055b4289ec807e72a65e579756929500fa78db4b5 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240612, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, RELEASE=squid-3781e3a, org.label-schema.vendor=CentOS) 2024-06-18T02:15:23.932 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:15:23 smithi007 podman[159162]: 2024-06-18 02:15:23.620550381 +0000 UTC m=+0.649971074 container died 4f12553ea0a68d5896b0d26055b4289ec807e72a65e579756929500fa78db4b5 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240612, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-3781e3a, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, ceph=True) 2024-06-18T02:15:24.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:23 smithi130 ceph-mon[84407]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:15:24.338 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:23 smithi007 ceph-mon[113333]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:15:24.338 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:23 smithi007 ceph-mon[99735]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:15:24.339 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:15:24 smithi007 podman[159277]: 2024-06-18 02:15:24.21324836 +0000 UTC m=+0.586838205 container remove 4f12553ea0a68d5896b0d26055b4289ec807e72a65e579756929500fa78db4b5 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-3781e3a, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.build-date=20240612, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-06-18T02:15:24.339 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:15:24 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.3.service: Deactivated successfully. 2024-06-18T02:15:24.339 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:15:24 smithi007 systemd[1]: Stopped Ceph osd.3 for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:15:24.339 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:15:24 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.3.service: Consumed 2.179s CPU time. 2024-06-18T02:15:24.681 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:15:24 smithi007 systemd[1]: Starting Ceph osd.3 for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:15:25.039 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:15:25 smithi007 podman[159479]: 2024-06-18 02:15:24.920583509 +0000 UTC m=+0.018483430 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:15:25.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:24 smithi007 ceph-mon[113333]: pgmap v260: 161 pgs: 17 active+undersized, 13 peering, 13 stale+active+clean, 13 active+undersized+degraded, 105 active+clean; 585 KiB data, 199 MiB used, 715 GiB / 715 GiB avail; 43/726 objects degraded (5.923%) 2024-06-18T02:15:25.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:24 smithi007 ceph-mon[113333]: Health check failed: Degraded data redundancy: 43/726 objects degraded (5.923%), 13 pgs degraded (PG_DEGRADED) 2024-06-18T02:15:25.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:24 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:25.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:24 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:25.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:24 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:25.040 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:24 smithi007 ceph-mon[99735]: pgmap v260: 161 pgs: 17 active+undersized, 13 peering, 13 stale+active+clean, 13 active+undersized+degraded, 105 active+clean; 585 KiB data, 199 MiB used, 715 GiB / 715 GiB avail; 43/726 objects degraded (5.923%) 2024-06-18T02:15:25.040 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:24 smithi007 ceph-mon[99735]: Health check failed: Degraded data redundancy: 43/726 objects degraded (5.923%), 13 pgs degraded (PG_DEGRADED) 2024-06-18T02:15:25.041 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:24 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:25.041 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:24 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:25.041 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:24 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:25.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:24 smithi130 ceph-mon[84407]: pgmap v260: 161 pgs: 17 active+undersized, 13 peering, 13 stale+active+clean, 13 active+undersized+degraded, 105 active+clean; 585 KiB data, 199 MiB used, 715 GiB / 715 GiB avail; 43/726 objects degraded (5.923%) 2024-06-18T02:15:25.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:24 smithi130 ceph-mon[84407]: Health check failed: Degraded data redundancy: 43/726 objects degraded (5.923%), 13 pgs degraded (PG_DEGRADED) 2024-06-18T02:15:25.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:24 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:25.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:24 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:25.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:24 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:25.432 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:15:25 smithi007 podman[159479]: 2024-06-18 02:15:25.041191106 +0000 UTC m=+0.139091024 container create c044a1a477d8c6c5545aafc6fe9ebdf7316962b49d1c2945d963cead7eeb843b (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3-activate, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-3781e3a, org.label-schema.build-date=20240612, io.buildah.version=1.36.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True) 2024-06-18T02:15:25.904 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:15:25 smithi007 podman[159479]: 2024-06-18 02:15:25.620880651 +0000 UTC m=+0.718780577 container init c044a1a477d8c6c5545aafc6fe9ebdf7316962b49d1c2945d963cead7eeb843b (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3-activate, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, RELEASE=squid-3781e3a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240612, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-06-18T02:15:25.904 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:15:25 smithi007 podman[159479]: 2024-06-18 02:15:25.624581843 +0000 UTC m=+0.722481763 container start c044a1a477d8c6c5545aafc6fe9ebdf7316962b49d1c2945d963cead7eeb843b (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3-activate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-3781e3a, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240612, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.license=GPLv2) 2024-06-18T02:15:25.905 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:15:25 smithi007 podman[159479]: 2024-06-18 02:15:25.712432629 +0000 UTC m=+0.810332549 container attach c044a1a477d8c6c5545aafc6fe9ebdf7316962b49d1c2945d963cead7eeb843b (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3-activate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-3781e3a, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240612, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-06-18T02:15:26.182 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:15:26 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3-activate[159497]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-06-18T02:15:26.182 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:15:26 smithi007 bash[159479]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-06-18T02:15:26.182 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:15:26 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3-activate[159497]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_1 2024-06-18T02:15:26.182 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:15:26 smithi007 bash[159479]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_1 2024-06-18T02:15:26.182 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:15:26 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3-activate[159497]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_1 2024-06-18T02:15:26.182 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:15:26 smithi007 bash[159479]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_1 2024-06-18T02:15:26.182 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:15:26 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3-activate[159497]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-06-18T02:15:26.182 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:15:26 smithi007 bash[159479]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-06-18T02:15:26.182 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:15:26 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3-activate[159497]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-3/block 2024-06-18T02:15:26.182 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:15:26 smithi007 bash[159479]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-3/block 2024-06-18T02:15:26.183 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:15:26 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3-activate[159497]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-06-18T02:15:26.183 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:15:26 smithi007 bash[159479]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-06-18T02:15:26.183 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:15:26 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3-activate[159497]: --> ceph-volume raw activate successful for osd ID: 3 2024-06-18T02:15:26.183 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:15:26 smithi007 bash[159479]: --> ceph-volume raw activate successful for osd ID: 3 2024-06-18T02:15:26.681 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:15:26 smithi007 podman[159479]: 2024-06-18 02:15:26.493426505 +0000 UTC m=+1.591326425 container died c044a1a477d8c6c5545aafc6fe9ebdf7316962b49d1c2945d963cead7eeb843b (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3-activate, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-3781e3a, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240612, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-06-18T02:15:27.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:26 smithi007 ceph-mon[113333]: pgmap v261: 161 pgs: 40 active+undersized, 26 active+undersized+degraded, 95 active+clean; 585 KiB data, 199 MiB used, 715 GiB / 715 GiB avail; 96/726 objects degraded (13.223%) 2024-06-18T02:15:27.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:26 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:27.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:15:27.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:26 smithi007 ceph-mon[99735]: pgmap v261: 161 pgs: 40 active+undersized, 26 active+undersized+degraded, 95 active+clean; 585 KiB data, 199 MiB used, 715 GiB / 715 GiB avail; 96/726 objects degraded (13.223%) 2024-06-18T02:15:27.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:27.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:15:27.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:26 smithi130 ceph-mon[84407]: pgmap v261: 161 pgs: 40 active+undersized, 26 active+undersized+degraded, 95 active+clean; 585 KiB data, 199 MiB used, 715 GiB / 715 GiB avail; 96/726 objects degraded (13.223%) 2024-06-18T02:15:27.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:27.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:15:27.890 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:15:27 smithi007 podman[159703]: 2024-06-18 02:15:27.5983415 +0000 UTC m=+1.527972198 container remove c044a1a477d8c6c5545aafc6fe9ebdf7316962b49d1c2945d963cead7eeb843b (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3-activate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-3781e3a, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.build-date=20240612, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47) 2024-06-18T02:15:28.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:15:27 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:15:27] "GET /metrics HTTP/1.1" 200 38425 "" "Prometheus/2.33.4" 2024-06-18T02:15:28.682 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:15:28 smithi007 podman[159881]: 2024-06-18 02:15:28.428154408 +0000 UTC m=+0.721294804 container create 7e879cda3b51bea60341d15fa9ed4aba268f14066e66b22a3d665f0bcbea4098 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-3781e3a, io.buildah.version=1.36.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240612, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-06-18T02:15:28.682 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:15:28 smithi007 podman[159881]: 2024-06-18 02:15:28.354469907 +0000 UTC m=+0.647610303 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:15:28.682 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:15:28 smithi007 podman[159881]: 2024-06-18 02:15:28.664429333 +0000 UTC m=+0.957569729 container init 7e879cda3b51bea60341d15fa9ed4aba268f14066e66b22a3d665f0bcbea4098 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3, org.label-schema.build-date=20240612, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-3781e3a, org.label-schema.schema-version=1.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-06-18T02:15:28.682 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:15:28 smithi007 podman[159881]: 2024-06-18 02:15:28.668037939 +0000 UTC m=+0.961178342 container start 7e879cda3b51bea60341d15fa9ed4aba268f14066e66b22a3d665f0bcbea4098 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3, GIT_CLEAN=True, io.buildah.version=1.36.0, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240612, RELEASE=squid-3781e3a, org.label-schema.vendor=CentOS) 2024-06-18T02:15:28.958 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:15:28 smithi007 ceph-osd[159941]: -- 172.21.15.7:0/617140043 <== mon.0 v2:172.21.15.7:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5560b224ba40 con 0x5560b2229c00 2024-06-18T02:15:28.958 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:15:28 smithi007 bash[159881]: 7e879cda3b51bea60341d15fa9ed4aba268f14066e66b22a3d665f0bcbea4098 2024-06-18T02:15:28.958 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:15:28 smithi007 systemd[1]: Started Ceph osd.3 for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:15:29.211 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:29 smithi007 ceph-mon[113333]: pgmap v262: 161 pgs: 40 active+undersized, 26 active+undersized+degraded, 95 active+clean; 585 KiB data, 199 MiB used, 715 GiB / 715 GiB avail; 96/726 objects degraded (13.223%) 2024-06-18T02:15:29.211 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:29 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:29.211 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:29 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:29.211 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:29 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:29.211 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:29 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:29.211 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:29 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:29.211 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:29.212 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:29.212 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:29 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:29.212 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:29.212 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:29.212 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:29.212 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:29.212 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:29 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:29.212 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:15:29 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3[159937]: 2024-06-18T02:15:29.206+0000 7f065ab94640 -1 Falling back to public interface 2024-06-18T02:15:29.212 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:29 smithi007 ceph-mon[99735]: pgmap v262: 161 pgs: 40 active+undersized, 26 active+undersized+degraded, 95 active+clean; 585 KiB data, 199 MiB used, 715 GiB / 715 GiB avail; 96/726 objects degraded (13.223%) 2024-06-18T02:15:29.213 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:29 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:29.213 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:29 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:29.213 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:29 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:29.213 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:29 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:29.213 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:29 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:29.213 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:29.213 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:29.213 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:29 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:29.213 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:29.213 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:29.213 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:29.213 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:29.213 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:29 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:29.288 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:29 smithi130 ceph-mon[84407]: pgmap v262: 161 pgs: 40 active+undersized, 26 active+undersized+degraded, 95 active+clean; 585 KiB data, 199 MiB used, 715 GiB / 715 GiB avail; 96/726 objects degraded (13.223%) 2024-06-18T02:15:29.289 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:29 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:29.289 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:29 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:29.289 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:29 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:29.289 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:29 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:29.289 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:29 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:29.290 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:29.290 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:29.290 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:29 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:29.290 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:29.290 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:29.290 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:29.291 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:29.291 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:29 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:30.100 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[113333]: pgmap v263: 161 pgs: 40 active+undersized, 26 active+undersized+degraded, 95 active+clean; 585 KiB data, 199 MiB used, 715 GiB / 715 GiB avail; 96/726 objects degraded (13.223%) 2024-06-18T02:15:30.101 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[113333]: pgmap v264: 161 pgs: 40 active+undersized, 26 active+undersized+degraded, 95 active+clean; 585 KiB data, 199 MiB used, 715 GiB / 715 GiB avail; 96/726 objects degraded (13.223%) 2024-06-18T02:15:30.101 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:30.101 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:30.101 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:30.102 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:30.102 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:30.102 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:30.102 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:30.102 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:30.102 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:30.103 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:30.103 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:30.103 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:30.103 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:30.103 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:30.103 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:30.103 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:30.104 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:30.104 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:30.104 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:30.104 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:30.104 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:30.104 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:30.104 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:30.104 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:30.105 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:30.105 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:30.105 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[99735]: pgmap v263: 161 pgs: 40 active+undersized, 26 active+undersized+degraded, 95 active+clean; 585 KiB data, 199 MiB used, 715 GiB / 715 GiB avail; 96/726 objects degraded (13.223%) 2024-06-18T02:15:30.105 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[99735]: pgmap v264: 161 pgs: 40 active+undersized, 26 active+undersized+degraded, 95 active+clean; 585 KiB data, 199 MiB used, 715 GiB / 715 GiB avail; 96/726 objects degraded (13.223%) 2024-06-18T02:15:30.105 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:30.106 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:30.106 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:30.106 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:30.106 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:30.106 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:30.106 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:30.107 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:30.107 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:30.107 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:30.107 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:30.107 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:30.107 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:30.107 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:30.108 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:30.108 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:30.108 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:30.108 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:30.108 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:30.108 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:30.109 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:30.109 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:30.109 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:30.109 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:30.109 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:30.109 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:30.109 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:30.110 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:30.110 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[113333]: Health check update: Degraded data redundancy: 96/726 objects degraded (13.223%), 26 pgs degraded (PG_DEGRADED) 2024-06-18T02:15:30.110 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:30.110 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:30.110 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:30.110 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:30.110 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:30.110 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:30.110 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:30.110 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:30.110 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:30.110 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:30.110 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:30.111 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:30.111 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:30.111 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:30.111 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:30.111 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:30.111 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:30.111 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[99735]: Health check update: Degraded data redundancy: 96/726 objects degraded (13.223%), 26 pgs degraded (PG_DEGRADED) 2024-06-18T02:15:30.111 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:30.111 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:30.111 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:30.111 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:30.111 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:30.112 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:30.112 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:30.112 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:30.112 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:30.112 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:30.112 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:30.112 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:30.112 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:30.112 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:30.112 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:30 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:30.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:30 smithi130 ceph-mon[84407]: pgmap v263: 161 pgs: 40 active+undersized, 26 active+undersized+degraded, 95 active+clean; 585 KiB data, 199 MiB used, 715 GiB / 715 GiB avail; 96/726 objects degraded (13.223%) 2024-06-18T02:15:30.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:30 smithi130 ceph-mon[84407]: pgmap v264: 161 pgs: 40 active+undersized, 26 active+undersized+degraded, 95 active+clean; 585 KiB data, 199 MiB used, 715 GiB / 715 GiB avail; 96/726 objects degraded (13.223%) 2024-06-18T02:15:30.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:30 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:30.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:30 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:30.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:30.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:30.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:30.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:30.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:30 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:30.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:30 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:30.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:30.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:30.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:30.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:30.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:30 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:30.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:30.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:30.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:30.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:30.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:30 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:30.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:30.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:30.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:30.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:30.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:30 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:30.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:30.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:30.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:30.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:30.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:30 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:30.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:30 smithi130 ceph-mon[84407]: Health check update: Degraded data redundancy: 96/726 objects degraded (13.223%), 26 pgs degraded (PG_DEGRADED) 2024-06-18T02:15:30.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:30.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:30.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:30.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:30.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:30 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:30.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:30.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:30.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:30.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:30.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:30 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:30.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:30.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:30.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:30.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:30.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:30 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:31.242 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:31.243 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:31.243 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:31.243 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:31.243 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:31.243 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:31.243 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:31.243 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:31.243 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:31.243 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:31.243 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:31.243 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:31.243 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:31.243 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:31.244 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:31.244 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:31.244 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:31.244 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:31.244 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:31.244 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:31.244 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:31.244 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:31.244 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:31.244 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:31.244 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:31.244 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:31.244 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:31.244 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:31.245 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:31.245 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:31.245 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:31.245 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:31.245 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:31.245 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:31.245 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:31.245 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:31.245 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:31.245 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:31.246 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:31.246 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:31.246 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:31.246 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:31.246 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:31.246 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:31.246 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:31.246 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:31.246 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:31.246 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:31.246 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:31.246 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:31.246 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:31.246 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:31.247 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:31.247 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:31.247 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:31.247 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:31.247 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:31.247 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:31.247 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:31.247 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:31.247 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:31.247 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:31.248 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:31.248 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:31.248 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:31.248 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:31.248 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:31.248 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:31.248 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:31.248 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:31.248 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:31.248 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:31.248 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:31.248 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:31.248 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:31.248 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:31.249 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:31.249 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:31.249 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:31.249 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:31.249 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:31.249 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:31.249 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:31.249 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:31.249 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:31.249 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:31.249 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:31.250 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:31.250 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:31.250 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:31.250 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:31.250 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:31.250 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:31.250 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:31.250 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:31.250 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:31.250 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:31.250 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:31.250 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:31.250 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:31.251 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:31.251 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:31.251 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:31.251 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:31.251 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:31.251 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:31.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:31 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:31.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:31 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:31.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:31 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:31.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:31 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:31.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:31 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:31.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:31 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:31.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:31 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:31.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:31.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:31.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:31.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:31.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:31 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:31.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:31 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:31.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:31.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:31.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:31.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:31.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:31 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:31.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:31.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:31.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:31.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:31.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:31 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:31.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:31.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:31.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:31.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:31.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:31 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:31.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:31.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:31.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:31.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:31.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:31 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:31.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:31.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:31.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:31.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:31.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:31 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:31.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:31.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:31.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:31.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:31.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:31 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:31.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:31.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:31.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:31.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:31.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:31 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:31.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:31.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:31.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:31.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:31.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:31 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:32.232 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:15:31 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3[159937]: 2024-06-18T02:15:31.967+0000 7f065ab94640 -1 osd.3 155 log_to_monitors true 2024-06-18T02:15:32.232 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:32.232 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:32.232 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:32.232 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:32.232 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:32.233 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:32.233 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[113333]: pgmap v265: 161 pgs: 40 active+undersized, 26 active+undersized+degraded, 95 active+clean; 585 KiB data, 199 MiB used, 715 GiB / 715 GiB avail; 96/726 objects degraded (13.223%) 2024-06-18T02:15:32.233 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:32.233 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:32.233 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:32.233 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:32.233 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:32.233 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:32.233 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:32.233 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:32.233 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:32.233 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:32.233 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:32.234 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:32.234 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:32.234 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:32.234 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:32.234 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:32.234 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:32.234 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:32.234 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:32.234 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:32.234 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:32.234 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:32.234 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:32.235 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:32.235 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:32.235 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:32.235 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:32.235 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:32.235 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:32.235 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[99735]: pgmap v265: 161 pgs: 40 active+undersized, 26 active+undersized+degraded, 95 active+clean; 585 KiB data, 199 MiB used, 715 GiB / 715 GiB avail; 96/726 objects degraded (13.223%) 2024-06-18T02:15:32.235 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:32.235 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:32.235 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:32.235 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:32.236 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:32.236 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:32.236 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:32.236 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:32.236 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:32.236 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:32.236 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:32.236 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:32.236 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:32.236 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:32.236 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:32.236 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:32.237 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:32.237 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:32.237 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:32.237 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:32.237 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:32.237 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:32.237 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:32.237 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:32.237 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:32.237 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:32.237 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:32.238 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:32.238 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:32.238 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:32.238 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:32.238 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:32.238 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:32.238 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:32.238 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:32.238 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:32.238 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:32.238 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:32.238 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:32.238 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:32.239 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:32.239 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:32.239 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:32.239 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[113333]: from='osd.3 [v2:172.21.15.7:6824/970656497,v1:172.21.15.7:6825/970656497]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-18T02:15:32.239 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:32.239 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:32.239 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:32.239 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:32.239 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:32.239 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:32.239 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:32.239 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:32.240 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:32.240 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:32.240 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:32.240 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:32.240 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:32.240 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:32.240 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:32.240 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:32.240 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:32.240 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:32.240 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:32.240 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:32.241 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:32 smithi007 ceph-mon[99735]: from='osd.3 [v2:172.21.15.7:6824/970656497,v1:172.21.15.7:6825/970656497]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-18T02:15:32.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:32 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:32.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:32 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:32.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:32 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:32.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:32 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:32.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:32 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:32.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:32 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:32.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:32 smithi130 ceph-mon[84407]: pgmap v265: 161 pgs: 40 active+undersized, 26 active+undersized+degraded, 95 active+clean; 585 KiB data, 199 MiB used, 715 GiB / 715 GiB avail; 96/726 objects degraded (13.223%) 2024-06-18T02:15:32.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:32 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:32.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:32 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:32.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:32.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:32.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:32.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:32.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:32 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:32.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:32 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:32.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:32.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:32.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:32.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:32.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:32 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:32.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:32.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:32.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:32.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:32.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:32 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:32.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:32.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:32.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:32.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:32.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:32 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:32.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:32.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:32.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:32.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:32.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:32 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:32.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:32.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:32.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:32.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:32.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:32 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:32.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:32.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:32.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:32.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:32.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:32 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:32.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:32.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:32.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:32.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:32.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:32 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:32.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:32 smithi130 ceph-mon[84407]: from='osd.3 [v2:172.21.15.7:6824/970656497,v1:172.21.15.7:6825/970656497]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-18T02:15:33.149 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:33 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:33.149 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:33 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:33.149 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:33 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:33.149 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:33 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:33.149 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:33 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:33.149 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:33 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:33.149 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:33 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:33.149 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:33.150 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:33.150 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:33.150 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:33.150 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:33 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:33.150 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:33 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:33.150 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:33.150 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:33.150 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:33.150 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:33.150 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:33 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:33.150 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:33.150 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:33.151 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:33.151 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:33.151 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:33 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:33.151 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:33.151 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:33.151 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:33.151 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:33.151 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:33 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:33.151 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:33.151 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:33.152 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:33.152 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:33.152 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:33 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:33.152 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:33.152 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:33.152 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:33.152 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:33.152 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:33 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:33.152 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:33.152 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:33.152 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:33.152 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:33.152 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:33 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:33.152 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:33.153 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:33.153 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:33.153 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:33.153 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:33 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:33.153 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:33 smithi130 ceph-mon[84407]: from='osd.3 [v2:172.21.15.7:6824/970656497,v1:172.21.15.7:6825/970656497]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-06-18T02:15:33.153 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:33 smithi130 ceph-mon[84407]: osdmap e158: 8 total, 7 up, 8 in 2024-06-18T02:15:33.153 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:33 smithi130 ceph-mon[84407]: from='osd.3 [v2:172.21.15.7:6824/970656497,v1:172.21.15.7:6825/970656497]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-06-18T02:15:33.153 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:33.153 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:33.153 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:33.153 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:33 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:33.153 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:33 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:33.431 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3[159937]: 2024-06-18T02:15:33.197+0000 7f064e937640 -1 osd.3 155 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-18T02:15:33.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:33.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:33.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:33.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:33.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:33.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:33.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:33.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:33.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:33.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:33.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:33.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:33.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:33.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:33.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:33.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:33.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:33.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:33.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:33.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:33.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:33.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:33.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:33.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:33.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:33.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:33.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:33.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:33.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:33.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:33.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:33.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:33.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:33.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:33.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:33.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:33.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:33.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:33.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:33.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:33.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:33.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:33.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:33.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:33.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:33.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:33.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:33.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:33.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[113333]: from='osd.3 [v2:172.21.15.7:6824/970656497,v1:172.21.15.7:6825/970656497]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-06-18T02:15:33.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[113333]: osdmap e158: 8 total, 7 up, 8 in 2024-06-18T02:15:33.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[113333]: from='osd.3 [v2:172.21.15.7:6824/970656497,v1:172.21.15.7:6825/970656497]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-06-18T02:15:33.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:33.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:33.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:33.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:33.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:33.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:33.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:33.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:33.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:33.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:33.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:33.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:33.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:33.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:33.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:33.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:33.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:33.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:33.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:33.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:33.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:33.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:33.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:33.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:33.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:33.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:33.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:33.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:33.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:33.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:33.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:33.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:33.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:33.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:33.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:33.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:33.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:33.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:33.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:33.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:33.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:33.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:33.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:33.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:33.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:33.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:33.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:33.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:33.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:33.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:33.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:33.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:33.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:33.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[99735]: from='osd.3 [v2:172.21.15.7:6824/970656497,v1:172.21.15.7:6825/970656497]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-06-18T02:15:33.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[99735]: osdmap e158: 8 total, 7 up, 8 in 2024-06-18T02:15:33.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[99735]: from='osd.3 [v2:172.21.15.7:6824/970656497,v1:172.21.15.7:6825/970656497]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-06-18T02:15:33.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:33.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:33.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:33.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:33.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:33 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:34.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:34.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[113333]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:15:34.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:34.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:34.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:34.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:34.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:34.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:34.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[113333]: pgmap v266: 161 pgs: 40 active+undersized, 26 active+undersized+degraded, 95 active+clean; 585 KiB data, 199 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 96/726 objects degraded (13.223%) 2024-06-18T02:15:34.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:34.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:34.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:34.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:34.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:34.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:34.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:34.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[113333]: from='osd.3 [v2:172.21.15.7:6824/970656497,v1:172.21.15.7:6825/970656497]' entity='osd.3' 2024-06-18T02:15:34.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:34.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:34.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:34.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:34.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:34.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:34.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:34.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:34.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:34.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:34.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:34.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:34.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:34.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[99735]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:15:34.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:34.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:34.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:34.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:34.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:34.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:34.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[99735]: pgmap v266: 161 pgs: 40 active+undersized, 26 active+undersized+degraded, 95 active+clean; 585 KiB data, 199 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 96/726 objects degraded (13.223%) 2024-06-18T02:15:34.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:34.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:34.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:34.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:34.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:34.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:34.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:34.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[99735]: from='osd.3 [v2:172.21.15.7:6824/970656497,v1:172.21.15.7:6825/970656497]' entity='osd.3' 2024-06-18T02:15:34.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:34.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:34.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:34.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:34.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:34.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:34.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:34.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:34.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:34.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:34.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:34.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:34.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:34.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:34.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:34.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:34.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:34.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:34.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:34.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:34.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:34.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:34.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:34.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:34.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:34.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:34.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:34.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:34.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:34.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:34.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:34.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:34.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:34.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:34.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:34.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:34.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:34.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:34.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:34.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:34.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:34.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:34.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:34.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:34.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:34.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:34.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:34.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:34.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:34.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:34.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:34.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:34.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:34.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:34.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:34.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:34.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:34.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:34 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:34.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:34 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:34.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:34 smithi130 ceph-mon[84407]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:15:34.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:34 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:34.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:34 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:34.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:34 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:34.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:34 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:34.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:34 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:34.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:34 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:34.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:34 smithi130 ceph-mon[84407]: pgmap v266: 161 pgs: 40 active+undersized, 26 active+undersized+degraded, 95 active+clean; 585 KiB data, 199 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 96/726 objects degraded (13.223%) 2024-06-18T02:15:34.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:34 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:34.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:34.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:34.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:34.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:34.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:34 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:34.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:34 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:34.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:34 smithi130 ceph-mon[84407]: from='osd.3 [v2:172.21.15.7:6824/970656497,v1:172.21.15.7:6825/970656497]' entity='osd.3' 2024-06-18T02:15:34.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:34.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:34.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:34.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:34.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:34 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:34.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:34.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:34.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:34.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:34.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:34 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:34.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:34.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:34.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:34.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:34.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:34 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:34.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:34.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:34.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:34.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:34.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:34 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:34.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:34.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:34.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:34.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:34.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:34 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:34.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:34.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:34.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:34.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:34.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:34 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:34.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:34.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:34.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:34.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:34 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:34.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:34 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:35.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:35 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:35.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:35 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:35.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:35 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:35.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:35 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:35.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:35 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:35.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:35 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:35.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:35 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:35.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:35.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:35.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:35.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:35.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:35 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:35.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:35 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:35.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:35 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:35.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:35 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:35.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:35 smithi130 ceph-mon[84407]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-06-18T02:15:35.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:35 smithi130 ceph-mon[84407]: osd.3 [v2:172.21.15.7:6824/970656497,v1:172.21.15.7:6825/970656497] boot 2024-06-18T02:15:35.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:35 smithi130 ceph-mon[84407]: osdmap e159: 8 total, 8 up, 8 in 2024-06-18T02:15:35.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-18T02:15:35.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:35.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:35.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:35.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:35.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:35 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:35.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:35.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:35.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:35.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:35.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:35 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:35.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:35.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:35.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:35.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:35.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:35 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:35.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:35.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:35.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:35.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:35.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:35 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:35.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:35.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:35.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:35.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:35.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:35 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:35.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:35.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:35.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:35.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:35.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:35 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:35.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:35.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:35.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:35.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:35 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:35.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:35 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:35.341 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:35.341 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:35.342 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:35.342 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:35.342 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:35.342 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:35.342 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:35.342 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:35.342 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:35.342 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:35.342 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:35.342 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:35.342 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:35.343 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:35.343 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:35.343 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[99735]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-06-18T02:15:35.343 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[99735]: osd.3 [v2:172.21.15.7:6824/970656497,v1:172.21.15.7:6825/970656497] boot 2024-06-18T02:15:35.343 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[99735]: osdmap e159: 8 total, 8 up, 8 in 2024-06-18T02:15:35.343 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-18T02:15:35.343 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:35.343 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:35.343 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:35.343 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:35.343 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:35.343 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:35.343 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:35.344 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:35.344 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:35.344 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:35.344 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:35.344 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:35.344 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:35.344 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:35.344 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:35.345 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:35.345 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:35.345 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:35.345 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:35.345 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:35.345 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:35.345 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:35.345 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:35.345 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:35.345 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:35.345 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:35.345 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:35.345 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:35.346 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[113333]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-06-18T02:15:35.346 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[113333]: osd.3 [v2:172.21.15.7:6824/970656497,v1:172.21.15.7:6825/970656497] boot 2024-06-18T02:15:35.346 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[113333]: osdmap e159: 8 total, 8 up, 8 in 2024-06-18T02:15:35.346 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-18T02:15:35.346 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:35.346 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:35.346 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:35.346 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:35.346 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:35.346 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:35.346 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:35.346 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:35.346 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:35.347 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:35.347 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:35.347 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:35.347 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:35.347 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:35.347 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:35.347 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:35.347 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:35.347 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:35.347 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:35.348 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:35.348 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:35.348 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:35.348 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:35.348 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:35.348 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:35.348 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:35.348 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:35.348 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:35.348 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:35.348 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:35.348 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:35.348 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:35.349 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:35.349 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:35.349 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:35.349 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:35.349 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:35.349 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:35.349 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:35.349 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:35.349 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:35.349 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:35.349 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:35.350 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:35.350 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:35.350 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:35.350 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:35.350 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:35.350 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:35.350 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:35.350 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:35.350 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:35.350 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:35.350 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:35.350 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:35.350 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:35.351 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:35 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:36.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:36.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:36.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:36.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:36.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:36.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:36.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[99735]: pgmap v269: 161 pgs: 40 active+undersized, 26 active+undersized+degraded, 95 active+clean; 585 KiB data, 199 MiB used, 715 GiB / 715 GiB avail; 802 B/s rd, 0 op/s; 96/726 objects degraded (13.223%) 2024-06-18T02:15:36.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:36.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:36.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:36.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:36.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:36.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:36.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:36.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:36.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:36.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:36.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:36.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:36.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:36.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[99735]: osdmap e160: 8 total, 8 up, 8 in 2024-06-18T02:15:36.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:36.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:36.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:36.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:36.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:36.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:36.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:36.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:36.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:36.192 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:36.192 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:36.192 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:36.192 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:36.192 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:36.192 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:36.192 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[113333]: pgmap v269: 161 pgs: 40 active+undersized, 26 active+undersized+degraded, 95 active+clean; 585 KiB data, 199 MiB used, 715 GiB / 715 GiB avail; 802 B/s rd, 0 op/s; 96/726 objects degraded (13.223%) 2024-06-18T02:15:36.192 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:36.192 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:36.192 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:36.192 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:36.192 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:36.193 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:36.193 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:36.193 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:36.193 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:36.193 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:36.193 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:36.193 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:36.193 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:36.193 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[113333]: osdmap e160: 8 total, 8 up, 8 in 2024-06-18T02:15:36.193 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:36.194 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:36.194 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:36.194 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:36.194 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:36.194 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:36.194 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:36.194 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:36.194 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:36.194 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:36.194 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:36.195 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:36.195 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:36.195 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:36.195 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:36.195 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:36.195 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:36.195 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:36.195 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:36.195 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:36.195 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:36.195 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:36.195 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:36.195 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:36.196 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:36.196 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:36.196 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:36.196 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:36.196 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:36.196 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:36.196 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:36.196 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:36.196 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:36.196 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:36.196 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:36.196 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:36.197 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:36.197 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:36.197 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:36.197 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:36.197 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:36.197 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:36.197 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:36.197 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:36.197 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:36.197 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:36.197 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:36.197 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:36.197 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:36.197 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:36.197 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:36.198 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:36.198 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:36.198 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:36.198 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:36.198 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:36.198 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:36.198 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:36.198 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:36.198 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:36.198 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:36 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:36.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:36 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:36.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:36 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:36.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:36 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:36.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:36 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:36.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:36 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:36.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:36 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:36.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:36 smithi130 ceph-mon[84407]: pgmap v269: 161 pgs: 40 active+undersized, 26 active+undersized+degraded, 95 active+clean; 585 KiB data, 199 MiB used, 715 GiB / 715 GiB avail; 802 B/s rd, 0 op/s; 96/726 objects degraded (13.223%) 2024-06-18T02:15:36.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:36 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:36.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:36 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:36.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:36.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:36.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:36.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:36.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:36 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:36.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:36 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:36.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:36.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:36.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:36.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:36.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:36 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:36.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:36 smithi130 ceph-mon[84407]: osdmap e160: 8 total, 8 up, 8 in 2024-06-18T02:15:36.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:36.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:36.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:36.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:36.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:36 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:36.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:36.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:36.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:36.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:36.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:36 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:36.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:36.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:36.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:36.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:36.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:36 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:36.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:36.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:36.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:36.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:36.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:36 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:36.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:36.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:36.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:36.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:36.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:36 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:36.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:36.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:36.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:36.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:36.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:36 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:36.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:36.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:36.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:36.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:36.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:36 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:37.014 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:37.014 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:37.014 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:37.014 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:37.015 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:37.015 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:37.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:37 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:37.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:37 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:37.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:37 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:37.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:37 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:37.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:37 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:37.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:37 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:37.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:37 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:37.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:37 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:37.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:37.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:37.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:37.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:37.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:37 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:37.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:37 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:37.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:37.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:37.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:37.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:37.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:37 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:37.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:37.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:37.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:37.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:37.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:37 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:37.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:37.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:37.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:37.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:37.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:37 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:37.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:37.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:37.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:37.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:37.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:37 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:37.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:37.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:37.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:37.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:37.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:37 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:37.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:37.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:37.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:37.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:37.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:37 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:37.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:37.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:37.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:37.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:37.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:37 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:37.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:37.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:37.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:37.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:37 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:37.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:37 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:37.386 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:37.386 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:37.386 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:37.387 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:37.387 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:37.387 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:37.387 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:37.387 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:37.387 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:37.387 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:37.387 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:37.387 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:37.387 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:37.387 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:37.387 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:37.387 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:37.387 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:37.388 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:37.388 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:37.388 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:37.388 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:37.388 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:37.388 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:37.388 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:37.388 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:37.388 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:37.388 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:37.388 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:37.388 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:37.388 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:37.389 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:37.389 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:37.389 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:37.389 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:37.389 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:37.389 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:37.389 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:37.389 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:37.390 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:37.390 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:37.390 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:37.390 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:37.390 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:37.390 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:37.390 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:37.390 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:37.390 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:37.390 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:37.390 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:37.390 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:37.390 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:37.390 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:37.391 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:37.391 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:37.391 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:37.391 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:37.391 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:37.391 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:37.391 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:37.391 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:37.391 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:37.391 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:37.391 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:37.391 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:37.391 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:37.391 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:37.392 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:37.392 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:37.392 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:37.392 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:37.392 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:37.392 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:37.392 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:37.392 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:37.392 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:37.392 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:37.393 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:37.393 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:37.393 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:37.393 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:37.393 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:37.394 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:37.394 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:37.394 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:37.394 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:37.394 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:37.394 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:37.394 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:37.394 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:37.394 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:37.394 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:37.394 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:37.394 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:37.395 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:37.395 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:37.395 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:37.395 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:37.395 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:37.395 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:37.395 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:37.395 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:37.395 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:37 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:38.039 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:38.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:38.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:38.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:38.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:38.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:38.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[113333]: pgmap v271: 161 pgs: 23 peering, 26 active+undersized, 17 active+undersized+degraded, 95 active+clean; 585 KiB data, 200 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 63/726 objects degraded (8.678%) 2024-06-18T02:15:38.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:38.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:38.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:38.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:38.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:38.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:38.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:38.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:38.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:38.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:38.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:38.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:38.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:38.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:38.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:38.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:38.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:38.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:38.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:38.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:38.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:38.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:38.042 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:38.042 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:38.043 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:38.043 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:38.043 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:38.043 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:38.043 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[99735]: pgmap v271: 161 pgs: 23 peering, 26 active+undersized, 17 active+undersized+degraded, 95 active+clean; 585 KiB data, 200 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 63/726 objects degraded (8.678%) 2024-06-18T02:15:38.043 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:38.043 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:38.043 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:38.043 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:38.043 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:38.043 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:38.043 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:38.044 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:38.044 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:38.044 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:38.044 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:38.044 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:38.044 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:38.044 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:38.045 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:38.045 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:38.045 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:38.045 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:38.045 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:38.045 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:38.045 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:38.045 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:38.045 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:38.046 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:38.046 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:38.046 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:38.046 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:38.046 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:38.046 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:38.046 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:38.046 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:38.046 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:38.047 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:38.050 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[113333]: Health check update: Degraded data redundancy: 63/726 objects degraded (8.678%), 17 pgs degraded (PG_DEGRADED) 2024-06-18T02:15:38.050 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:38.050 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:38.050 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:38.050 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:38.050 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:38.050 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:38.050 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:38.050 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:38.051 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:38.051 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:38.051 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:38.051 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:38.051 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:38.051 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:38.051 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:38.051 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:38.051 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:38.051 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:38.052 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:38.052 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[99735]: Health check update: Degraded data redundancy: 63/726 objects degraded (8.678%), 17 pgs degraded (PG_DEGRADED) 2024-06-18T02:15:38.052 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:38.052 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:38.052 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:38.052 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:38.052 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:38.052 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:38.052 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:38.052 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:38.052 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:38.052 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:38 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:38.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:15:37 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:15:37] "GET /metrics HTTP/1.1" 200 38425 "" "Prometheus/2.33.4" 2024-06-18T02:15:38.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:38 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:38.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:38 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:38.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:38 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:38.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:38 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:38.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:38 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:38.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:38 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:38.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:38 smithi130 ceph-mon[84407]: pgmap v271: 161 pgs: 23 peering, 26 active+undersized, 17 active+undersized+degraded, 95 active+clean; 585 KiB data, 200 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 63/726 objects degraded (8.678%) 2024-06-18T02:15:38.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:38 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:38.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:38 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:38.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:38.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:38.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:38.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:38.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:38 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:38.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:38.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:38.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:38.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:38.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:38 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:38.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:38.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:38.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:38.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:38.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:38 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:38.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:38.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:38.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:38.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:38.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:38 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:38.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:38.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:38.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:38.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:38.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:38 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:38.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:38.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:38.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:38.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:38.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:38 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:38.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:38 smithi130 ceph-mon[84407]: Health check update: Degraded data redundancy: 63/726 objects degraded (8.678%), 17 pgs degraded (PG_DEGRADED) 2024-06-18T02:15:38.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:38.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:38.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:38.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:38.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:38 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:38.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:38.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:38.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:38.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:38 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:38.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:38 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:39.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:39 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:39.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:39 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:39.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:39 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:39.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:39 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:39.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:39 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:39.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:39 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:39.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:39 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:39.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:39 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:39.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:39.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:39.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:39.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:39.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:39 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:39.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:39 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:39.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:39.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:39.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:39.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:39.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:39 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:39.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:39.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:39.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:39.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:39.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:39 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:39.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:39.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:39.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:39.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:39.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:39 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:39.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:39.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:39.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:39.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:39.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:39 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:39.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:39.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:39.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:39.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:39.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:39 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:39.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:39.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:39.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:39.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:39.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:39 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:39.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:39.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:39.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:39.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:39.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:39 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:39.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:39.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:39.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:39.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:39 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:39.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:39 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:39.298 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:39.298 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:39.298 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:39.299 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:39.299 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:39.299 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:39.299 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:39.299 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:39.299 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:39.299 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:39.299 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:39.299 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:39.332 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:39.333 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:39.333 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:39.333 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:39.333 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:39.333 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:39.333 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:39.333 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:39.333 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:39.333 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:39.333 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:39.333 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:39.333 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:39.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:39.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:39.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:39.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:39.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:39.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:39.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:39.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:39.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:39.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:39.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:39.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:39.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:39.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:39.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:39.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:39.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:39.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:39.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:39.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:39.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:39.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:39.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:39.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:39.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:39.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:39.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:39.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:39.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:39.336 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:39.336 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:39.336 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:39.336 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:39.336 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:39.336 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:39.336 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:39.337 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:39.337 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:39.337 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:39.337 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:39.337 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:39.337 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:39.337 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:39.337 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:39.337 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:39.337 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:39.337 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:39.337 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:39.337 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:39.337 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:39.338 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:39.338 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:39.338 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:39.338 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:39.338 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:39.338 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:39.338 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:39.338 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:39.338 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:39.338 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:39.338 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:39.338 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:39.338 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:39.338 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:39.339 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:39.339 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:39.339 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:39.339 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:39.339 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:39.339 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:39.339 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:39.339 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:39.339 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:39.339 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:39.339 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:39.339 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:39.339 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:39.339 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:39.340 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:39.340 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:39.340 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:39.340 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:39.340 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:39 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:40.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:15:40.198+0000 7f680f9b8640 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (7 PGs are or would become offline) 2024-06-18T02:15:40.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:40.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:40.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:40.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:40.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:40.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:40.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-mon[84407]: pgmap v272: 161 pgs: 23 peering, 138 active+clean; 585 KiB data, 204 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:15:40.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:40.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:40.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:40.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:40.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:40.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:40.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:40.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:40.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:40.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:40.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:40.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:40.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:40.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:40.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:40.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:40.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:40.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:40.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:40.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:40.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:40.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:40.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:40.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:40.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:40.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:40.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:40.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:40.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:40.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:40.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:40.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:40.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:40.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-mon[84407]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 63/726 objects degraded (8.678%), 17 pgs degraded) 2024-06-18T02:15:40.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-mon[84407]: Cluster is now healthy 2024-06-18T02:15:40.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:40.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:40.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:40.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:40.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:40.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:40.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:40.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:40.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:40.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:40.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:40.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:40.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:40.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:40.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:40 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:40.322 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:40.322 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:40.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:40.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:40.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:40.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:40.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[113333]: pgmap v272: 161 pgs: 23 peering, 138 active+clean; 585 KiB data, 204 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:15:40.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:40.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:40.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:40.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:40.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:40.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:40.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:40.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:40.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:40.324 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:40.324 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:40.324 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:40.324 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:40.324 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:40.324 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:40.324 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:40.324 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:40.324 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:40.324 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:40.324 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:40.324 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:40.324 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:40.325 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:40.325 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:40.325 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:40.325 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:40.325 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:40.325 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:40.325 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:40.325 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[99735]: pgmap v272: 161 pgs: 23 peering, 138 active+clean; 585 KiB data, 204 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:15:40.325 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:40.325 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:40.326 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:40.326 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:40.326 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:40.326 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:40.326 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:40.326 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:40.326 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:40.326 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:40.326 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:40.326 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:40.326 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:40.326 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:40.326 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:40.327 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:40.327 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:40.327 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:40.327 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:40.327 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:40.327 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:40.327 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:40.327 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:40.327 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:40.327 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:40.328 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:40.328 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:40.328 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:40.328 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:40.328 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:40.328 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:40.328 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:40.328 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:40.328 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:40.328 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[113333]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 63/726 objects degraded (8.678%), 17 pgs degraded) 2024-06-18T02:15:40.328 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[113333]: Cluster is now healthy 2024-06-18T02:15:40.328 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:40.328 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:40.329 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:40.329 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:40.329 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:40.329 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:40.329 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:40.329 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:40.329 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:40.329 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:40.329 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:40.329 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:40.329 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:40.329 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:40.329 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:40.330 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:40.330 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:40.330 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:40.330 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:40.330 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:40.330 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:40.330 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:40.330 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:40.330 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:40.330 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[99735]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 63/726 objects degraded (8.678%), 17 pgs degraded) 2024-06-18T02:15:40.330 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[99735]: Cluster is now healthy 2024-06-18T02:15:40.330 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:40.331 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:40.331 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:40.331 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:40.331 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:40.331 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:40.331 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:40.331 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:40.331 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:40.331 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:40.331 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:40.331 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:40.331 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:40.331 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:40.332 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:40 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:41.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:41 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:41.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:41 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:41.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:41 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:41.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:41 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:41.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:41 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:41.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:41 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:41.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:41 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:41.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:41 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:41.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:41.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:41.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:41.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:41.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:41 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:41.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:41 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:41.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:41 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:41.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:41 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:41.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:41 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:41.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:41.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:41.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:41.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:41.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-06-18T02:15:41.331 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:41 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:41.331 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:41 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:41.331 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:41 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:41.331 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:41 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:41.331 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:41 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:41.331 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:41 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:41.331 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:41 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:41.331 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:41 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:41.331 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:41.331 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:41.331 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:41.332 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:41.332 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:41 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:41.332 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:41 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:41.332 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:41 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:41.332 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:41 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:41.332 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:41 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:41.332 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:41.332 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:41.332 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:41.332 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:41.332 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-06-18T02:15:41.332 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:41 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:41.332 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:41 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:41.333 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:41 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:41.333 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:41 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:41.333 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:41 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:41.333 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:41 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:41.333 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:41 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:41.333 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:41 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:41.333 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:41.333 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:41.333 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:41.333 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:15:41.333 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:41 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:41.333 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:41 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:15:41.333 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:41 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:41.333 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:41 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:41.333 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:41 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:41.334 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:15:41.334 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:41.334 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:41.334 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:41.334 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-06-18T02:15:42.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:42 smithi130 ceph-mon[84407]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-06-18T02:15:42.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:42 smithi130 ceph-mon[84407]: Upgrade: unsafe to stop osd(s) at this time (7 PGs are or would become offline) 2024-06-18T02:15:42.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:42 smithi130 ceph-mon[84407]: pgmap v273: 161 pgs: 161 active+clean; 585 KiB data, 204 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:15:42.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:42 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:42.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:15:42.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:42 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:42.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:42 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:42.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:42 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:42.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:42 smithi007 ceph-mon[113333]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-06-18T02:15:42.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:42 smithi007 ceph-mon[113333]: Upgrade: unsafe to stop osd(s) at this time (7 PGs are or would become offline) 2024-06-18T02:15:42.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:42 smithi007 ceph-mon[113333]: pgmap v273: 161 pgs: 161 active+clean; 585 KiB data, 204 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:15:42.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:42 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:42.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:42 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:15:42.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:42 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:42.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:42 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:42.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:42 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:42.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:42 smithi007 ceph-mon[99735]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-06-18T02:15:42.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:42 smithi007 ceph-mon[99735]: Upgrade: unsafe to stop osd(s) at this time (7 PGs are or would become offline) 2024-06-18T02:15:42.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:42 smithi007 ceph-mon[99735]: pgmap v273: 161 pgs: 161 active+clean; 585 KiB data, 204 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:15:42.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:42.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:15:42.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:42.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:42.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:44.115 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:44 smithi007 ceph-mon[113333]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:15:44.115 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:44 smithi007 ceph-mon[113333]: pgmap v274: 161 pgs: 161 active+clean; 585 KiB data, 204 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:15:44.115 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:44 smithi007 ceph-mon[99735]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:15:44.115 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:44 smithi007 ceph-mon[99735]: pgmap v274: 161 pgs: 161 active+clean; 585 KiB data, 204 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:15:44.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:44 smithi130 ceph-mon[84407]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:15:44.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:44 smithi130 ceph-mon[84407]: pgmap v274: 161 pgs: 161 active+clean; 585 KiB data, 204 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:15:45.872 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:45 smithi007 ceph-mon[113333]: pgmap v275: 161 pgs: 161 active+clean; 585 KiB data, 204 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:15:45.873 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:45 smithi007 ceph-mon[99735]: pgmap v275: 161 pgs: 161 active+clean; 585 KiB data, 204 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:15:46.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:45 smithi130 ceph-mon[84407]: pgmap v275: 161 pgs: 161 active+clean; 585 KiB data, 204 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:15:47.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:47 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:47.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:47 smithi007 ceph-mon[113333]: pgmap v276: 161 pgs: 161 active+clean; 585 KiB data, 204 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:15:47.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:47 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:47.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:47 smithi007 ceph-mon[99735]: pgmap v276: 161 pgs: 161 active+clean; 585 KiB data, 204 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:15:47.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:47 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:47.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:47 smithi130 ceph-mon[84407]: pgmap v276: 161 pgs: 161 active+clean; 585 KiB data, 204 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:15:48.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:15:47 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:15:47] "GET /metrics HTTP/1.1" 200 38415 "" "Prometheus/2.33.4" 2024-06-18T02:15:50.181 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:49 smithi007 ceph-mon[99735]: pgmap v277: 161 pgs: 161 active+clean; 585 KiB data, 204 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:15:50.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:49 smithi007 ceph-mon[113333]: pgmap v277: 161 pgs: 161 active+clean; 585 KiB data, 204 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:15:50.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:49 smithi130 ceph-mon[84407]: pgmap v277: 161 pgs: 161 active+clean; 585 KiB data, 204 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:15:52.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:51 smithi007 ceph-mon[113333]: pgmap v278: 161 pgs: 161 active+clean; 585 KiB data, 204 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:15:52.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:51 smithi007 ceph-mon[99735]: pgmap v278: 161 pgs: 161 active+clean; 585 KiB data, 204 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:15:52.212 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:51 smithi130 ceph-mon[84407]: pgmap v278: 161 pgs: 161 active+clean; 585 KiB data, 204 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:15:52.627 INFO:teuthology.orchestra.run.smithi007.stdout:true 2024-06-18T02:15:53.307 INFO:teuthology.orchestra.run.smithi007.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-18T02:15:53.307 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi007 smithi007 running 11s ago 19m - - 2024-06-18T02:15:53.307 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi130 smithi130 running 19s ago 18m - - 2024-06-18T02:15:53.307 INFO:teuthology.orchestra.run.smithi007.stdout:alertmanager.a smithi007 *:9093,9094 running (8m) 11s ago 13m 23.7M - 0.23.0 ba2b418f427c 5994e8525c64 2024-06-18T02:15:53.307 INFO:teuthology.orchestra.run.smithi007.stdout:grafana.a smithi130 *:3000 running (8m) 19s ago 13m 49.9M - 8.3.5 dad864ee21e9 70ba81d97c8e 2024-06-18T02:15:53.308 INFO:teuthology.orchestra.run.smithi007.stdout:iscsi.foo.smithi007.xvdrwd smithi007 running (6m) 11s ago 12m 61.8M - 3.5 e1d6a67b021e 94121ad2702c 2024-06-18T02:15:53.308 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.x smithi130 *:8443,9283,8765 running (7m) 19s ago 18m 531M - 19.0.0-3124-g3781e3a5 af93c036e016 01017e37bdbe 2024-06-18T02:15:53.308 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.y smithi007 *:8443,9283,8765 running (6m) 11s ago 20m 443M - 19.0.0-3124-g3781e3a5 af93c036e016 2141e131e896 2024-06-18T02:15:53.308 INFO:teuthology.orchestra.run.smithi007.stdout:mon.a smithi007 running (3m) 11s ago 20m 58.4M 2048M 19.0.0-3124-g3781e3a5 af93c036e016 7bbe646cd5b7 2024-06-18T02:15:53.308 INFO:teuthology.orchestra.run.smithi007.stdout:mon.b smithi130 running (5m) 19s ago 18m 55.0M 2048M 19.0.0-3124-g3781e3a5 af93c036e016 baacf2add994 2024-06-18T02:15:53.308 INFO:teuthology.orchestra.run.smithi007.stdout:mon.c smithi007 running (5m) 11s ago 18m 59.2M 2048M 19.0.0-3124-g3781e3a5 af93c036e016 39418356156e 2024-06-18T02:15:53.308 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.a smithi007 *:9100 running (8m) 11s ago 14m 17.9M - 1.3.1 1dbe0e931976 8128e558f099 2024-06-18T02:15:53.308 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.b smithi130 *:9100 running (8m) 19s ago 14m 16.3M - 1.3.1 1dbe0e931976 bab93b43cf16 2024-06-18T02:15:53.308 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0 smithi007 running (3m) 11s ago 17m 51.7M 4096M 19.0.0-3124-g3781e3a5 af93c036e016 07c7f4afd49a 2024-06-18T02:15:53.308 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1 smithi007 running (2m) 11s ago 17m 46.8M 4096M 19.0.0-3124-g3781e3a5 af93c036e016 e8d184614e94 2024-06-18T02:15:53.308 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2 smithi007 running (87s) 11s ago 17m 43.0M 4096M 19.0.0-3124-g3781e3a5 af93c036e016 7d9a05b4bfa5 2024-06-18T02:15:53.308 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3 smithi007 running (24s) 11s ago 16m 50.1M 4096M 19.0.0-3124-g3781e3a5 af93c036e016 7e879cda3b51 2024-06-18T02:15:53.309 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4 smithi130 running (16m) 19s ago 16m 65.3M 4096M 17.2.0 e1d6a67b021e c428dccffdf0 2024-06-18T02:15:53.309 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5 smithi130 running (15m) 19s ago 15m 63.7M 4096M 17.2.0 e1d6a67b021e f645d7f12378 2024-06-18T02:15:53.309 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6 smithi130 running (15m) 19s ago 15m 58.2M 4096M 17.2.0 e1d6a67b021e c7af86c14959 2024-06-18T02:15:53.309 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7 smithi130 running (15m) 19s ago 15m 63.9M 4096M 17.2.0 e1d6a67b021e 3688af8b2c46 2024-06-18T02:15:53.309 INFO:teuthology.orchestra.run.smithi007.stdout:prometheus.a smithi130 *:9095 running (7m) 19s ago 14m 75.8M - 2.33.4 514e6a882f6e e905fb2eb4a6 2024-06-18T02:15:53.309 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi007.dvbvbk smithi007 *:8000 running (12m) 11s ago 12m 78.2M - 17.2.0 e1d6a67b021e 1344b55b763c 2024-06-18T02:15:53.309 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi130.aakmof smithi130 *:8000 running (12m) 19s ago 12m 75.8M - 17.2.0 e1d6a67b021e e257e3230c6c 2024-06-18T02:15:53.309 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi007.hgrnmk smithi007 *:80 running (12m) 11s ago 12m 76.0M - 17.2.0 e1d6a67b021e 2173947bc4d6 2024-06-18T02:15:53.309 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi130.wwebfk smithi130 *:80 running (12m) 19s ago 12m 77.8M - 17.2.0 e1d6a67b021e 8662706b2231 2024-06-18T02:15:53.719 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:15:53.720 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": { 2024-06-18T02:15:53.720 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 3 2024-06-18T02:15:53.720 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:15:53.720 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": { 2024-06-18T02:15:53.720 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 2 2024-06-18T02:15:53.720 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:15:53.720 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": { 2024-06-18T02:15:53.720 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4, 2024-06-18T02:15:53.720 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 4 2024-06-18T02:15:53.720 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:15:53.720 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw": { 2024-06-18T02:15:53.720 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-06-18T02:15:53.721 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:15:53.721 INFO:teuthology.orchestra.run.smithi007.stdout: "overall": { 2024-06-18T02:15:53.721 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8, 2024-06-18T02:15:53.721 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 9 2024-06-18T02:15:53.721 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-06-18T02:15:53.721 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:15:54.067 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:15:54.067 INFO:teuthology.orchestra.run.smithi007.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00", 2024-06-18T02:15:54.067 INFO:teuthology.orchestra.run.smithi007.stdout: "in_progress": true, 2024-06-18T02:15:54.067 INFO:teuthology.orchestra.run.smithi007.stdout: "which": "Upgrading all daemon types on all hosts", 2024-06-18T02:15:54.067 INFO:teuthology.orchestra.run.smithi007.stdout: "services_complete": [ 2024-06-18T02:15:54.067 INFO:teuthology.orchestra.run.smithi007.stdout: "mon", 2024-06-18T02:15:54.067 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr" 2024-06-18T02:15:54.067 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-06-18T02:15:54.068 INFO:teuthology.orchestra.run.smithi007.stdout: "progress": "9/23 daemons upgraded", 2024-06-18T02:15:54.068 INFO:teuthology.orchestra.run.smithi007.stdout: "message": "Currently upgrading osd daemons", 2024-06-18T02:15:54.068 INFO:teuthology.orchestra.run.smithi007.stdout: "is_paused": false 2024-06-18T02:15:54.068 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:15:54.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:53 smithi007 ceph-mon[113333]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:15:54.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:53 smithi007 ceph-mon[113333]: from='client.94401 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:15:54.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:53 smithi007 ceph-mon[113333]: pgmap v279: 161 pgs: 161 active+clean; 585 KiB data, 204 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:15:54.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:53 smithi007 ceph-mon[113333]: from='client.54451 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:15:54.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:53 smithi007 ceph-mon[113333]: from='client.? 172.21.15.7:0/4187488638' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:54.069 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:53 smithi007 ceph-mon[99735]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:15:54.069 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:53 smithi007 ceph-mon[99735]: from='client.94401 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:15:54.069 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:53 smithi007 ceph-mon[99735]: pgmap v279: 161 pgs: 161 active+clean; 585 KiB data, 204 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:15:54.069 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:53 smithi007 ceph-mon[99735]: from='client.54451 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:15:54.069 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:53 smithi007 ceph-mon[99735]: from='client.? 172.21.15.7:0/4187488638' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:54.089 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:53 smithi130 ceph-mon[84407]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:15:54.089 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:53 smithi130 ceph-mon[84407]: from='client.94401 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:15:54.089 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:53 smithi130 ceph-mon[84407]: pgmap v279: 161 pgs: 161 active+clean; 585 KiB data, 204 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:15:54.089 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:53 smithi130 ceph-mon[84407]: from='client.54451 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:15:54.089 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:53 smithi130 ceph-mon[84407]: from='client.? 172.21.15.7:0/4187488638' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:15:54.480 INFO:teuthology.orchestra.run.smithi007.stdout:HEALTH_OK 2024-06-18T02:15:55.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:54 smithi130 ceph-mon[84407]: from='client.54457 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:15:55.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:54 smithi130 ceph-mon[84407]: from='client.94425 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:15:55.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:54 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:55.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:54 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:55.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:54 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:55.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:54 smithi130 ceph-mon[84407]: from='client.? 172.21.15.7:0/704483085' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:15:55.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:54 smithi007 ceph-mon[113333]: from='client.54457 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:15:55.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:54 smithi007 ceph-mon[113333]: from='client.94425 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:15:55.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:54 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:55.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:54 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:55.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:54 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:55.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:54 smithi007 ceph-mon[113333]: from='client.? 172.21.15.7:0/704483085' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:15:55.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:54 smithi007 ceph-mon[99735]: from='client.54457 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:15:55.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:54 smithi007 ceph-mon[99735]: from='client.94425 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:15:55.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:54 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:55.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:54 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:55.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:54 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:55.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:54 smithi007 ceph-mon[99735]: from='client.? 172.21.15.7:0/704483085' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:15:56.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:55 smithi007 ceph-mon[99735]: pgmap v280: 161 pgs: 161 active+clean; 585 KiB data, 204 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:15:56.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-06-18T02:15:56.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:55 smithi007 ceph-mon[113333]: pgmap v280: 161 pgs: 161 active+clean; 585 KiB data, 204 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:15:56.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-06-18T02:15:56.188 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:55 smithi130 ceph-mon[84407]: pgmap v280: 161 pgs: 161 active+clean; 585 KiB data, 204 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:15:56.189 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-06-18T02:15:57.116 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:56 smithi130 ceph-mon[84407]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-06-18T02:15:57.116 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:56 smithi130 ceph-mon[84407]: Upgrade: osd.4 is safe to restart 2024-06-18T02:15:57.116 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:15:57.116 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:56 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:57.116 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-06-18T02:15:57.116 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:57.181 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:56 smithi007 ceph-mon[99735]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-06-18T02:15:57.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:56 smithi007 ceph-mon[99735]: Upgrade: osd.4 is safe to restart 2024-06-18T02:15:57.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:15:57.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:56 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:57.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-06-18T02:15:57.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:57.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:56 smithi007 ceph-mon[113333]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-06-18T02:15:57.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:56 smithi007 ceph-mon[113333]: Upgrade: osd.4 is safe to restart 2024-06-18T02:15:57.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:15:57.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:56 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:15:57.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-06-18T02:15:57.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:15:58.112 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:57 smithi130 ceph-mon[84407]: Upgrade: Updating osd.4 2024-06-18T02:15:58.113 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:57 smithi130 ceph-mon[84407]: Deploying daemon osd.4 on smithi130 2024-06-18T02:15:58.113 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:57 smithi130 ceph-mon[84407]: pgmap v281: 161 pgs: 161 active+clean; 585 KiB data, 204 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:15:58.113 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:15:57 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:15:57] "GET /metrics HTTP/1.1" 200 38421 "" "Prometheus/2.33.4" 2024-06-18T02:15:58.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:57 smithi007 ceph-mon[113333]: Upgrade: Updating osd.4 2024-06-18T02:15:58.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:57 smithi007 ceph-mon[113333]: Deploying daemon osd.4 on smithi130 2024-06-18T02:15:58.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:57 smithi007 ceph-mon[113333]: pgmap v281: 161 pgs: 161 active+clean; 585 KiB data, 204 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:15:58.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:57 smithi007 ceph-mon[99735]: Upgrade: Updating osd.4 2024-06-18T02:15:58.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:57 smithi007 ceph-mon[99735]: Deploying daemon osd.4 on smithi130 2024-06-18T02:15:58.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:57 smithi007 ceph-mon[99735]: pgmap v281: 161 pgs: 161 active+clean; 585 KiB data, 204 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:15:59.543 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:15:59 smithi130 systemd[1]: Stopping Ceph osd.4 for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:16:00.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:59 smithi130 ceph-mon[84407]: pgmap v282: 161 pgs: 161 active+clean; 585 KiB data, 204 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:16:00.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:15:59 smithi130 ceph-mon[84407]: osd.4 marked itself down and dead 2024-06-18T02:16:00.044 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:15:59 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4[30805]: 2024-06-18T02:15:59.698+0000 7f063eba8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-18T02:16:00.044 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:15:59 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4[30805]: 2024-06-18T02:15:59.698+0000 7f063eba8700 -1 osd.4 160 *** Got signal Terminated *** 2024-06-18T02:16:00.044 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:15:59 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4[30805]: 2024-06-18T02:15:59.698+0000 7f063eba8700 -1 osd.4 160 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-18T02:16:00.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:59 smithi007 ceph-mon[113333]: pgmap v282: 161 pgs: 161 active+clean; 585 KiB data, 204 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:16:00.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:15:59 smithi007 ceph-mon[113333]: osd.4 marked itself down and dead 2024-06-18T02:16:00.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:59 smithi007 ceph-mon[99735]: pgmap v282: 161 pgs: 161 active+clean; 585 KiB data, 204 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:16:00.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:15:59 smithi007 ceph-mon[99735]: osd.4 marked itself down and dead 2024-06-18T02:16:00.666 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:00 smithi130 podman[121380]: 2024-06-18 02:16:00.355655543 +0000 UTC m=+0.736227774 container died c428dccffdf0b4bfff9614ee0d21e9c6ad9aba660e3bb77bacd809e67d423a97 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4, architecture=x86_64, GIT_REPO=https://github.com/ceph/ceph-container.git, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.license_terms=https://centos.org/legal/licensing-policy/, distribution-scope=public, io.openshift.tags=base centos centos-stream, vcs-type=git, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, GIT_CLEAN=True, release=754, build-date=2022-05-03T08:36:31.336870, ceph=True, io.k8s.display-name=CentOS Stream 8, io.openshift.expose-services=, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=-17.2.0, RELEASE=HEAD, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, name=centos-stream, io.buildah.version=1.19.8, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, com.redhat.component=centos-stream-container, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_BRANCH=HEAD, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, vendor=Red Hat, Inc., version=8) 2024-06-18T02:16:00.990 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:00 smithi130 ceph-mon[84407]: Health check failed: 1 osds down (OSD_DOWN) 2024-06-18T02:16:00.990 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:00 smithi130 ceph-mon[84407]: osdmap e161: 8 total, 7 up, 8 in 2024-06-18T02:16:00.991 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:00 smithi130 podman[121380]: 2024-06-18 02:16:00.757087513 +0000 UTC m=+1.137659742 container cleanup c428dccffdf0b4bfff9614ee0d21e9c6ad9aba660e3bb77bacd809e67d423a97 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4, io.k8s.display-name=CentOS Stream 8, architecture=x86_64, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, ceph=True, maintainer=Guillaume Abrioux , release=754, GIT_REPO=https://github.com/ceph/ceph-container.git, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, vcs-type=git, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, version=8, com.redhat.component=centos-stream-container, vendor=Red Hat, Inc., io.openshift.expose-services=, RELEASE=HEAD, distribution-scope=public, io.buildah.version=1.19.8, io.openshift.tags=base centos centos-stream, build-date=2022-05-03T08:36:31.336870, GIT_CLEAN=True, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=-17.2.0, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, name=centos-stream) 2024-06-18T02:16:00.991 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:00 smithi130 bash[121380]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4 2024-06-18T02:16:01.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:00 smithi007 ceph-mon[113333]: Health check failed: 1 osds down (OSD_DOWN) 2024-06-18T02:16:01.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:00 smithi007 ceph-mon[113333]: osdmap e161: 8 total, 7 up, 8 in 2024-06-18T02:16:01.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:00 smithi007 ceph-mon[99735]: Health check failed: 1 osds down (OSD_DOWN) 2024-06-18T02:16:01.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:00 smithi007 ceph-mon[99735]: osdmap e161: 8 total, 7 up, 8 in 2024-06-18T02:16:01.293 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:00 smithi130 podman[121397]: 2024-06-18 02:16:00.99194437 +0000 UTC m=+0.636574252 container remove c428dccffdf0b4bfff9614ee0d21e9c6ad9aba660e3bb77bacd809e67d423a97 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4, CEPH_POINT_RELEASE=-17.2.0, name=centos-stream, vcs-type=git, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, build-date=2022-05-03T08:36:31.336870, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vendor=Red Hat, Inc., GIT_REPO=https://github.com/ceph/ceph-container.git, version=8, ceph=True, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_CLEAN=True, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, architecture=x86_64, io.k8s.display-name=CentOS Stream 8, GIT_BRANCH=HEAD, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, RELEASE=HEAD, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.openshift.tags=base centos centos-stream, maintainer=Guillaume Abrioux , com.redhat.component=centos-stream-container, io.buildah.version=1.19.8, release=754, distribution-scope=public, io.openshift.expose-services=) 2024-06-18T02:16:01.611 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:01 smithi130 podman[121486]: 2024-06-18 02:16:01.222596957 +0000 UTC m=+0.017445924 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:16:01.611 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:01 smithi130 podman[121486]: 2024-06-18 02:16:01.359929552 +0000 UTC m=+0.154778512 container create 328a970437cbacb2ffd663126cf8de133afdb61db84425c3397a6b5ae413ae3d (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, io.buildah.version=1.36.0, RELEASE=squid-3781e3a, org.label-schema.build-date=20240612, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-06-18T02:16:01.869 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:01 smithi130 podman[121486]: 2024-06-18 02:16:01.612326648 +0000 UTC m=+0.407175619 container init 328a970437cbacb2ffd663126cf8de133afdb61db84425c3397a6b5ae413ae3d (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.build-date=20240612, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-3781e3a) 2024-06-18T02:16:01.870 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:01 smithi130 podman[121486]: 2024-06-18 02:16:01.615809783 +0000 UTC m=+0.410658749 container start 328a970437cbacb2ffd663126cf8de133afdb61db84425c3397a6b5ae413ae3d (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4-deactivate, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, maintainer=Guillaume Abrioux , RELEASE=squid-3781e3a, org.label-schema.build-date=20240612, org.label-schema.name=CentOS Stream 9 Base Image) 2024-06-18T02:16:01.870 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:01 smithi130 podman[121486]: 2024-06-18 02:16:01.687220814 +0000 UTC m=+0.482069782 container attach 328a970437cbacb2ffd663126cf8de133afdb61db84425c3397a6b5ae413ae3d (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240612, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, RELEASE=squid-3781e3a, org.label-schema.license=GPLv2) 2024-06-18T02:16:02.140 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:01 smithi130 ceph-mon[84407]: pgmap v284: 161 pgs: 26 peering, 14 stale+active+clean, 121 active+clean; 585 KiB data, 204 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:16:02.140 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:01 smithi130 ceph-mon[84407]: Health check failed: Reduced data availability: 4 pgs inactive, 8 pgs peering (PG_AVAILABILITY) 2024-06-18T02:16:02.140 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:01 smithi130 ceph-mon[84407]: osdmap e162: 8 total, 7 up, 8 in 2024-06-18T02:16:02.140 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:01 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:02.140 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:01 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:02.140 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:01 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:02.140 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:01 smithi130 podman[121486]: 2024-06-18 02:16:01.871852303 +0000 UTC m=+0.666701269 container died 328a970437cbacb2ffd663126cf8de133afdb61db84425c3397a6b5ae413ae3d (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240612, RELEASE=squid-3781e3a) 2024-06-18T02:16:02.181 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:01 smithi007 ceph-mon[99735]: pgmap v284: 161 pgs: 26 peering, 14 stale+active+clean, 121 active+clean; 585 KiB data, 204 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:16:02.181 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:01 smithi007 ceph-mon[99735]: Health check failed: Reduced data availability: 4 pgs inactive, 8 pgs peering (PG_AVAILABILITY) 2024-06-18T02:16:02.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:01 smithi007 ceph-mon[99735]: osdmap e162: 8 total, 7 up, 8 in 2024-06-18T02:16:02.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:01 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:02.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:01 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:02.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:01 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:02.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:01 smithi007 ceph-mon[113333]: pgmap v284: 161 pgs: 26 peering, 14 stale+active+clean, 121 active+clean; 585 KiB data, 204 MiB used, 715 GiB / 715 GiB avail 2024-06-18T02:16:02.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:01 smithi007 ceph-mon[113333]: Health check failed: Reduced data availability: 4 pgs inactive, 8 pgs peering (PG_AVAILABILITY) 2024-06-18T02:16:02.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:01 smithi007 ceph-mon[113333]: osdmap e162: 8 total, 7 up, 8 in 2024-06-18T02:16:02.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:01 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:02.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:01 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:02.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:01 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:02.793 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:02 smithi130 podman[121508]: 2024-06-18 02:16:02.457471396 +0000 UTC m=+0.578995488 container remove 328a970437cbacb2ffd663126cf8de133afdb61db84425c3397a6b5ae413ae3d (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, RELEASE=squid-3781e3a, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240612, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-06-18T02:16:02.793 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:02 smithi130 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.4.service: Deactivated successfully. 2024-06-18T02:16:02.794 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:02 smithi130 systemd[1]: Stopped Ceph osd.4 for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:16:02.794 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:02 smithi130 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.4.service: Consumed 12.093s CPU time. 2024-06-18T02:16:02.794 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:02 smithi130 systemd[1]: Starting Ceph osd.4 for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:16:03.207 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:02 smithi007 ceph-mon[113333]: Health check failed: Degraded data redundancy: 64/726 objects degraded (8.815%), 13 pgs degraded (PG_DEGRADED) 2024-06-18T02:16:03.207 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:02 smithi007 ceph-mon[99735]: Health check failed: Degraded data redundancy: 64/726 objects degraded (8.815%), 13 pgs degraded (PG_DEGRADED) 2024-06-18T02:16:03.235 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:02 smithi130 ceph-mon[84407]: Health check failed: Degraded data redundancy: 64/726 objects degraded (8.815%), 13 pgs degraded (PG_DEGRADED) 2024-06-18T02:16:03.235 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:02 smithi130 podman[121607]: 2024-06-18 02:16:02.819935435 +0000 UTC m=+0.017060784 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:16:03.235 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:02 smithi130 podman[121607]: 2024-06-18 02:16:02.933492698 +0000 UTC m=+0.130618032 container create 7c908ccc1a256358e073dd7b4d0c9d8280dfded988906e754b81c2ecc7fd5c07 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4-activate, org.label-schema.build-date=20240612, RELEASE=squid-3781e3a, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True) 2024-06-18T02:16:03.235 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:03 smithi130 podman[121607]: 2024-06-18 02:16:03.161248317 +0000 UTC m=+0.358373663 container init 7c908ccc1a256358e073dd7b4d0c9d8280dfded988906e754b81c2ecc7fd5c07 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4-activate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240612, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-3781e3a, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=) 2024-06-18T02:16:03.235 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:03 smithi130 podman[121607]: 2024-06-18 02:16:03.164815189 +0000 UTC m=+0.361940525 container start 7c908ccc1a256358e073dd7b4d0c9d8280dfded988906e754b81c2ecc7fd5c07 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4-activate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240612, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.36.0, RELEASE=squid-3781e3a, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-18T02:16:03.531 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:03 smithi130 podman[121607]: 2024-06-18 02:16:03.235924858 +0000 UTC m=+0.433050195 container attach 7c908ccc1a256358e073dd7b4d0c9d8280dfded988906e754b81c2ecc7fd5c07 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4-activate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240612, CEPH_POINT_RELEASE=, RELEASE=squid-3781e3a, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47) 2024-06-18T02:16:03.793 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:03 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4-activate[121621]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-06-18T02:16:03.793 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:03 smithi130 bash[121607]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-06-18T02:16:03.794 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:03 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4-activate[121621]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-06-18T02:16:03.794 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:03 smithi130 bash[121607]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-06-18T02:16:03.794 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:03 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4-activate[121621]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-06-18T02:16:03.794 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:03 smithi130 bash[121607]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-06-18T02:16:03.794 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:03 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4-activate[121621]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-06-18T02:16:03.794 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:03 smithi130 bash[121607]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-06-18T02:16:03.794 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:03 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4-activate[121621]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-4/block 2024-06-18T02:16:03.794 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:03 smithi130 bash[121607]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-4/block 2024-06-18T02:16:03.794 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:03 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4-activate[121621]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-06-18T02:16:03.794 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:03 smithi130 bash[121607]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-06-18T02:16:03.794 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:03 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4-activate[121621]: --> ceph-volume raw activate successful for osd ID: 4 2024-06-18T02:16:03.794 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:03 smithi130 bash[121607]: --> ceph-volume raw activate successful for osd ID: 4 2024-06-18T02:16:03.795 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:03 smithi130 podman[121607]: 2024-06-18 02:16:03.586339702 +0000 UTC m=+0.783465038 container died 7c908ccc1a256358e073dd7b4d0c9d8280dfded988906e754b81c2ecc7fd5c07 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240612, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-3781e3a, org.label-schema.schema-version=1.0) 2024-06-18T02:16:04.166 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:03 smithi130 ceph-mon[84407]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:16:04.166 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:03 smithi130 ceph-mon[84407]: pgmap v286: 161 pgs: 19 active+undersized, 26 peering, 5 stale+active+clean, 13 active+undersized+degraded, 98 active+clean; 585 KiB data, 205 MiB used, 715 GiB / 715 GiB avail; 64/726 objects degraded (8.815%) 2024-06-18T02:16:04.225 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:03 smithi007 ceph-mon[113333]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:16:04.225 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:03 smithi007 ceph-mon[113333]: pgmap v286: 161 pgs: 19 active+undersized, 26 peering, 5 stale+active+clean, 13 active+undersized+degraded, 98 active+clean; 585 KiB data, 205 MiB used, 715 GiB / 715 GiB avail; 64/726 objects degraded (8.815%) 2024-06-18T02:16:04.225 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:03 smithi007 ceph-mon[99735]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:16:04.225 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:03 smithi007 ceph-mon[99735]: pgmap v286: 161 pgs: 19 active+undersized, 26 peering, 5 stale+active+clean, 13 active+undersized+degraded, 98 active+clean; 585 KiB data, 205 MiB used, 715 GiB / 715 GiB avail; 64/726 objects degraded (8.815%) 2024-06-18T02:16:04.519 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:04 smithi130 podman[121735]: 2024-06-18 02:16:04.306661236 +0000 UTC m=+0.714561304 container remove 7c908ccc1a256358e073dd7b4d0c9d8280dfded988906e754b81c2ecc7fd5c07 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4-activate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240612, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, RELEASE=squid-3781e3a, org.label-schema.license=GPLv2) 2024-06-18T02:16:04.770 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:04 smithi130 podman[121798]: 2024-06-18 02:16:04.424012156 +0000 UTC m=+0.018256943 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:16:04.771 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:04 smithi130 podman[121798]: 2024-06-18 02:16:04.532561661 +0000 UTC m=+0.126806448 container create 5faedfcb14a8d78f15df9fc25171264b26d4917007bb9557ccf0461d369335af (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240612, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, maintainer=Guillaume Abrioux , RELEASE=squid-3781e3a, ceph=True, CEPH_POINT_RELEASE=) 2024-06-18T02:16:04.771 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:04 smithi130 podman[121798]: 2024-06-18 02:16:04.768800212 +0000 UTC m=+0.363045007 container init 5faedfcb14a8d78f15df9fc25171264b26d4917007bb9557ccf0461d369335af (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240612, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.36.0, RELEASE=squid-3781e3a, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-18T02:16:04.771 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:04 smithi130 podman[121798]: 2024-06-18 02:16:04.77206194 +0000 UTC m=+0.366306727 container start 5faedfcb14a8d78f15df9fc25171264b26d4917007bb9557ccf0461d369335af (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240612, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-3781e3a, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, ceph=True) 2024-06-18T02:16:05.043 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:04 smithi130 ceph-osd[121817]: -- 172.21.15.130:0/3309152936 <== mon.2 v2:172.21.15.130:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557da57d1a40 con 0x557da57afc00 2024-06-18T02:16:05.043 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:04 smithi130 bash[121798]: 5faedfcb14a8d78f15df9fc25171264b26d4917007bb9557ccf0461d369335af 2024-06-18T02:16:05.043 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:04 smithi130 systemd[1]: Started Ceph osd.4 for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:16:05.793 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:05 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4[121813]: 2024-06-18T02:16:05.306+0000 7efc2a972640 -1 Falling back to public interface 2024-06-18T02:16:06.181 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:05 smithi130 ceph-mon[84407]: pgmap v287: 161 pgs: 27 active+undersized, 26 peering, 14 active+undersized+degraded, 94 active+clean; 585 KiB data, 205 MiB used, 715 GiB / 715 GiB avail; 69/726 objects degraded (9.504%) 2024-06-18T02:16:06.181 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:05 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:06.181 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:05 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:06.181 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:06.181 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:06.181 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:05 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:06.182 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:05 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:06.182 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:06.182 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:06.182 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:06.182 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:06.182 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:05 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:06.182 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:05 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:06.182 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:06.182 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:06.182 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:06.182 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:06.182 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:05 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:06.182 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:06.183 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:06.183 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:06.183 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:06.183 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:05 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:06.183 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:06.183 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:06.183 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:06.183 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:06.183 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:05 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:06.183 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:06.183 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:06.183 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:06.183 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:06.183 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:05 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:06.183 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:06.184 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:06.184 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:06.184 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:06.184 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:05 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:06.184 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:06.184 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:06.184 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:06.184 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:06.184 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:05 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:06.184 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:06.184 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:06.184 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:06.184 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:06.184 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:05 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:06.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[113333]: pgmap v287: 161 pgs: 27 active+undersized, 26 peering, 14 active+undersized+degraded, 94 active+clean; 585 KiB data, 205 MiB used, 715 GiB / 715 GiB avail; 69/726 objects degraded (9.504%) 2024-06-18T02:16:06.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:06.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:06.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:06.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:06.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:06.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:06.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:06.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:06.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:06.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:06.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:06.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:06.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:06.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:06.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:06.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:06.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:06.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:06.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:06.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:06.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:06.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:06.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:06.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:06.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:06.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:06.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:06.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:06.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[99735]: pgmap v287: 161 pgs: 27 active+undersized, 26 peering, 14 active+undersized+degraded, 94 active+clean; 585 KiB data, 205 MiB used, 715 GiB / 715 GiB avail; 69/726 objects degraded (9.504%) 2024-06-18T02:16:06.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:06.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:06.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:06.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:06.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:06.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:06.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:06.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:06.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:06.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:06.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:06.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:06.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:06.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:06.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:06.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:06.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:06.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:06.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:06.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:06.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:06.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:06.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:06.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:06.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:06.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:06.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:06.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:06.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:06.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:06.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:06.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:06.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:06.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:06.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:06.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:06.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:06.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:06.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:06.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:06.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:06.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:06.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:06.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:06.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:06.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:06.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:06.191 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:06.191 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:06.191 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:06.191 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:06.191 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:06.191 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:06.191 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:06.191 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:06.191 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:06.191 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:06.192 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:06.192 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:06.192 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:06.192 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:06.192 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:06.192 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:06.192 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:06.192 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:06.192 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:05 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:07.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:07.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:07.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:07.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:07.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:07.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:07.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:07.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:07.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:07.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:07.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:07.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:07.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:07.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:07.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:07.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:07.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:07.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:07.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:07.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:07.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:07.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:07.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:07.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:07.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:07.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:07.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:07.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:07.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:07.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:07.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:07.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:07.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:07.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:07.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:07.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:07.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:07.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:07.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:07.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:07.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:07.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:07.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:07.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:07.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:07.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:07.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:07.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:07.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:07.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:07.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:07.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:07.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:07.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:07.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:07.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:07.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:07.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:07.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:07.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:07.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:07.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:07.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:07.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:07.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:07.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:07.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:07.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:07.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:07.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:07.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:07.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:07.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:07.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:07.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:07.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:07.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:07.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:07.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:07.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:07.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:07.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:07.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:07.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:07.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:07.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:07.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:07.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:07.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:07.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:07.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:07.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:07.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:07.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:07.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:07.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:07.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:07.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:07.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:07.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:07.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:07.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:07.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:07.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:07.203 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:06 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:07.204 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:06 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:07.204 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:06 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:07.204 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:06 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:07.204 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:06 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:07.204 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:06 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:07.204 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:06 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:07.204 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:07.204 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:07.204 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:07.204 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:07.204 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:06 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:07.204 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:06 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:07.204 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:07.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:07.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:07.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:07.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:06 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:07.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:07.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:07.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:07.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:07.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:06 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:07.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:07.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:07.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:07.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:07.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:06 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:07.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:07.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:07.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:07.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:07.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:06 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:07.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:07.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:07.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:07.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:07.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:06 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:07.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:07.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:07.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:07.207 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:07.207 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:06 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:07.207 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:07.207 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:07.207 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:07.207 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:07.207 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:06 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:07.207 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:07.207 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:07.207 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:07.207 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:08.084 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:16:07 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:16:07] "GET /metrics HTTP/1.1" 200 38421 "" "Prometheus/2.33.4" 2024-06-18T02:16:08.084 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:08 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4[121813]: 2024-06-18T02:16:08.032+0000 7efc2a972640 -1 osd.4 0 read_superblock omap replica is missing. 2024-06-18T02:16:08.084 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:07 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:08.085 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:07 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:08.085 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:07 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:08.085 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:07 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:08.085 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:07 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:08.085 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:07 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:08.085 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:07 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:08.085 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:07 smithi130 ceph-mon[84407]: pgmap v288: 161 pgs: 41 active+undersized, 26 active+undersized+degraded, 94 active+clean; 585 KiB data, 205 MiB used, 715 GiB / 715 GiB avail; 125/726 objects degraded (17.218%) 2024-06-18T02:16:08.085 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:07 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:08.085 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:07 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:08.085 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:08.085 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:08.086 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:08.086 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:08.086 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:07 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:08.086 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:07 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:08.086 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:08.086 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:08.086 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:08.086 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:08.086 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:07 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:08.086 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:08.086 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:08.087 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:08.087 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:08.087 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:07 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:08.087 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:08.087 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:08.087 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:08.087 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:08.087 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:07 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:08.087 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:08.087 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:08.087 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:08.087 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:08.087 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:07 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:08.088 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:08.088 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:08.088 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:08.088 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:08.088 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:07 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:08.088 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:07 smithi130 ceph-mon[84407]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs inactive, 8 pgs peering) 2024-06-18T02:16:08.088 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:08.088 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:08.088 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:08.088 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:08.088 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:07 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:08.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:08.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:08.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:08.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:08.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:08.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:08.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:08.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[113333]: pgmap v288: 161 pgs: 41 active+undersized, 26 active+undersized+degraded, 94 active+clean; 585 KiB data, 205 MiB used, 715 GiB / 715 GiB avail; 125/726 objects degraded (17.218%) 2024-06-18T02:16:08.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:08.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:08.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:08.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:08.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:08.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:08.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:08.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:08.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:08.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:08.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:08.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:08.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:08.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:08.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:08.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:08.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:08.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:08.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:08.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:08.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:08.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:08.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:08.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:08.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:08.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:08.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:08.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:08.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:08.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:08.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:08.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:08.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:08.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[113333]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs inactive, 8 pgs peering) 2024-06-18T02:16:08.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:08.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:08.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:08.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:08.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:08.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:08.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:08.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:08.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:08.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:08.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:08.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:08.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[99735]: pgmap v288: 161 pgs: 41 active+undersized, 26 active+undersized+degraded, 94 active+clean; 585 KiB data, 205 MiB used, 715 GiB / 715 GiB avail; 125/726 objects degraded (17.218%) 2024-06-18T02:16:08.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:08.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:08.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:08.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:08.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:08.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:08.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:08.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:08.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:08.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:08.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:08.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:08.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:08.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:08.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:08.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:08.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:08.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:08.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:08.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:08.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:08.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:08.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:08.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:08.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:08.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:08.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:08.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:08.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:08.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:08.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:08.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:08.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:08.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[99735]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs inactive, 8 pgs peering) 2024-06-18T02:16:08.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:08.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:08.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:08.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:08.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:07 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:08.343 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:08 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4[121813]: 2024-06-18T02:16:08.084+0000 7efc2a972640 -1 osd.4 160 log_to_monitors true 2024-06-18T02:16:09.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:09.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:09.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:09.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:09.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:09.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:09.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:09.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:09.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:09.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:09.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:09.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:09.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[113333]: from='osd.4 [v2:172.21.15.130:6800/2286727221,v1:172.21.15.130:6801/2286727221]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-18T02:16:09.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[113333]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-18T02:16:09.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:09.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:09.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:09.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:09.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:09.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:09.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:09.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:09.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:09.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:09.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:09.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:09.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:09.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:09.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:09.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:09.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:09.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:09.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:09.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:09.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:09.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:09.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:09.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:09.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:09.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:09.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:09.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[99735]: from='osd.4 [v2:172.21.15.130:6800/2286727221,v1:172.21.15.130:6801/2286727221]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-18T02:16:09.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[99735]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-18T02:16:09.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:09.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:09.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:09.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:09.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:09.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:09.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:09.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:09.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:09.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:09.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:09.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:09.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:09.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:09.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:09.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:09.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:09.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:09.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:09.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:09.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:09.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:09.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:09.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:09.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:09.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:09.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:09.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:09.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:09.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:09.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:09.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:09.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:09.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:09.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:09.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:09.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:09.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:09.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:09.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:09.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:09.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:09.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:09.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:09.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:09.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:09.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:09.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:09.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:09.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:09.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:09.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:09.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:09.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:09.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:09.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:09.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:09.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:09.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:09.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:09.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:09.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:09.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:09.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:09.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:08 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:09.191 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4[121813]: 2024-06-18T02:16:09.039+0000 7efc2271d640 -1 osd.4 160 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-18T02:16:09.191 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:08 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:09.192 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:08 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:09.192 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:08 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:09.192 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:08 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:09.192 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:08 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:09.192 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:08 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:09.192 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:09.192 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:09.192 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:09.192 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:09.192 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:08 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:09.192 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:08 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:09.192 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:08 smithi130 ceph-mon[84407]: from='osd.4 [v2:172.21.15.130:6800/2286727221,v1:172.21.15.130:6801/2286727221]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-18T02:16:09.193 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:08 smithi130 ceph-mon[84407]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-18T02:16:09.193 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:09.193 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:09.193 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:09.193 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:09.193 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:08 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:09.193 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:09.193 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:09.193 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:09.193 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:09.193 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:08 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:09.193 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:09.193 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:09.193 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:09.194 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:09.194 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:08 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:09.194 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:09.194 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:09.194 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:09.194 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:09.194 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:08 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:09.194 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:09.194 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:09.194 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:09.194 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:09.194 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:08 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:09.195 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:09.195 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:09.195 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:09.195 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:09.195 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:08 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:09.195 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:09.195 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:09.195 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:09.195 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:09.195 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:08 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:09.195 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:09.195 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:09.195 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:09.195 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:09.195 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:08 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:10.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:09 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:10.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:09 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:10.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:09 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:10.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:09 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:10.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:09 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:10.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:09 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:10.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:09 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:10.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:09 smithi130 ceph-mon[84407]: pgmap v289: 161 pgs: 41 active+undersized, 26 active+undersized+degraded, 94 active+clean; 585 KiB data, 205 MiB used, 715 GiB / 715 GiB avail; 125/726 objects degraded (17.218%) 2024-06-18T02:16:10.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:09 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:10.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:09 smithi130 ceph-mon[84407]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-06-18T02:16:10.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:09 smithi130 ceph-mon[84407]: osdmap e163: 8 total, 7 up, 8 in 2024-06-18T02:16:10.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:09 smithi130 ceph-mon[84407]: from='osd.4 [v2:172.21.15.130:6800/2286727221,v1:172.21.15.130:6801/2286727221]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:16:10.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:09 smithi130 ceph-mon[84407]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:16:10.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:10.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:10.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:10.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:10.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:09 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:10.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:09 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:10.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:10.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:10.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:10.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:10.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:09 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:10.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:10.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:10.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:10.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:10.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:09 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:10.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:10.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:10.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:10.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:10.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:09 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:10.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:10.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:10.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:10.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:10.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:09 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:10.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:09 smithi130 ceph-mon[84407]: Health check update: Degraded data redundancy: 125/726 objects degraded (17.218%), 26 pgs degraded (PG_DEGRADED) 2024-06-18T02:16:10.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:10.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:10.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:10.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:10.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:09 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:10.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:10.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:10.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:10.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:10.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:09 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:10.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:10.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:10.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:10.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:10.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:09 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:10.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:10.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:10.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:10.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:10.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:10.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:10.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:10.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[113333]: pgmap v289: 161 pgs: 41 active+undersized, 26 active+undersized+degraded, 94 active+clean; 585 KiB data, 205 MiB used, 715 GiB / 715 GiB avail; 125/726 objects degraded (17.218%) 2024-06-18T02:16:10.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:10.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[113333]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-06-18T02:16:10.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[113333]: osdmap e163: 8 total, 7 up, 8 in 2024-06-18T02:16:10.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[113333]: from='osd.4 [v2:172.21.15.130:6800/2286727221,v1:172.21.15.130:6801/2286727221]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:16:10.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[113333]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:16:10.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:10.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:10.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:10.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:10.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:10.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:10.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:10.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:10.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:10.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:10.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:10.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:10.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:10.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:10.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:10.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:10.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:10.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:10.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:10.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:10.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:10.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:10.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:10.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[99735]: pgmap v289: 161 pgs: 41 active+undersized, 26 active+undersized+degraded, 94 active+clean; 585 KiB data, 205 MiB used, 715 GiB / 715 GiB avail; 125/726 objects degraded (17.218%) 2024-06-18T02:16:10.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:10.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[99735]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-06-18T02:16:10.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[99735]: osdmap e163: 8 total, 7 up, 8 in 2024-06-18T02:16:10.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[99735]: from='osd.4 [v2:172.21.15.130:6800/2286727221,v1:172.21.15.130:6801/2286727221]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:16:10.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[99735]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:16:10.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:10.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:10.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:10.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:10.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:10.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:10.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:10.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:10.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:10.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:10.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:10.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:10.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:10.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:10.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:10.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:10.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:10.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:10.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:10.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:10.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:10.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:10.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:10.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:10.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:10.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:10.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[113333]: Health check update: Degraded data redundancy: 125/726 objects degraded (17.218%), 26 pgs degraded (PG_DEGRADED) 2024-06-18T02:16:10.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:10.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:10.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:10.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:10.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:10.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:10.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:10.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:10.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:10.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:10.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:10.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:10.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:10.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:10.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:10.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:10.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:10.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:10.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:10.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:10.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:10.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:10.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:10.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:10.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:10.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[99735]: Health check update: Degraded data redundancy: 125/726 objects degraded (17.218%), 26 pgs degraded (PG_DEGRADED) 2024-06-18T02:16:10.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:10.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:10.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:10.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:10.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:10.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:10.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:10.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:10.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:10.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:10.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:10.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:10.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:10.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:10.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:09 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:10.972 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:10.973 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:10.973 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:10.973 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:10.973 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:10.973 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:10.973 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:10.973 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[113333]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-06-18T02:16:10.973 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[113333]: osd.4 [v2:172.21.15.130:6800/2286727221,v1:172.21.15.130:6801/2286727221] boot 2024-06-18T02:16:10.973 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[113333]: osdmap e164: 8 total, 8 up, 8 in 2024-06-18T02:16:10.973 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-18T02:16:10.973 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:10.973 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:10.974 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:10.974 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:10.974 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:10.974 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:10.974 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:10.974 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:10.974 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:10.974 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:10.975 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:10.975 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:10.975 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:10.975 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:10.975 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:10.975 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:10.975 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[99735]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-06-18T02:16:10.975 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[99735]: osd.4 [v2:172.21.15.130:6800/2286727221,v1:172.21.15.130:6801/2286727221] boot 2024-06-18T02:16:10.975 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[99735]: osdmap e164: 8 total, 8 up, 8 in 2024-06-18T02:16:10.975 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-18T02:16:10.975 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:10.975 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:10.975 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:10.976 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:10.976 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:10.976 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:10.976 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:10.976 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:10.976 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:10.976 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:10.976 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:10.976 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:10.976 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:10.976 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:10.976 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:10.976 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:10.977 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:10.977 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:10.977 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:10.977 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:10.977 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:10.977 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:10.977 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:10.977 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:10.977 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:10.977 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:10.977 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:10.977 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:10.977 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:10.978 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:10.978 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:10.978 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:10.978 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:10.978 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:10.978 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:10.978 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:10.978 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:10.978 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:10.978 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:10.978 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:10.978 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:11.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:10 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:11.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:10 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:11.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:10 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:11.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:10 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:11.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:10 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:11.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:10 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:11.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:10 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:11.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:10 smithi130 ceph-mon[84407]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-06-18T02:16:11.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:10 smithi130 ceph-mon[84407]: osd.4 [v2:172.21.15.130:6800/2286727221,v1:172.21.15.130:6801/2286727221] boot 2024-06-18T02:16:11.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:10 smithi130 ceph-mon[84407]: osdmap e164: 8 total, 8 up, 8 in 2024-06-18T02:16:11.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-18T02:16:11.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:11.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:11.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:11.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:11.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:10 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:11.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:10 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:11.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:11.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:11.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:11.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:11.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:10 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:11.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:11.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:11.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:11.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:11.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:10 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:11.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:11.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:11.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:11.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:11.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:10 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:11.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:11.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:11.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:11.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:11.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:10 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:11.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:11.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:11.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:11.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:11.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:10 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:11.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:11.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:11.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:11.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:11.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:10 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:11.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:11.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:11.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:11.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:11.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:10 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:11.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:11.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:11.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:11.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:11.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:11.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:11.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:11.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:11.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:11.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:11.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:11.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:11.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:11.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:11.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:11.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:11.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:11.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:11.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:11.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:11.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:11.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:11.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:11.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:11.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:11.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:11.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:11.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:11.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:11.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:11.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:11.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:10 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:12.252 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:12.253 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:12.253 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:12.253 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:12.253 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:12.253 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:12.253 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[113333]: pgmap v292: 161 pgs: 11 peering, 32 active+undersized, 24 active+undersized+degraded, 94 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 113/726 objects degraded (15.565%) 2024-06-18T02:16:12.253 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:12.254 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[113333]: osdmap e165: 8 total, 8 up, 8 in 2024-06-18T02:16:12.254 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:12.254 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:12.254 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:12.254 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:12.254 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:12.254 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:12.254 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:12.254 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:12.255 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:12.255 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:12.255 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:12.255 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:12.255 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:16:12.255 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:12.255 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:12.255 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:12.255 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:12.256 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:12.256 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:12.256 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:12.256 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:12.256 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:12.256 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:12.256 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:12.257 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:12.257 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:12.257 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:12.257 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[99735]: pgmap v292: 161 pgs: 11 peering, 32 active+undersized, 24 active+undersized+degraded, 94 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 113/726 objects degraded (15.565%) 2024-06-18T02:16:12.257 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:12.257 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[99735]: osdmap e165: 8 total, 8 up, 8 in 2024-06-18T02:16:12.257 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:12.257 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:12.257 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:12.257 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:12.258 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:12.258 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:12.258 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:12.258 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:12.258 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:12.258 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:12.258 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:12.258 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:12.259 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:16:12.259 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:12.259 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:12.259 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:12.259 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:12.259 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:12.259 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:12.259 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:12.259 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:12.259 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:12.260 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:12.260 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:12.260 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:12.260 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:12.260 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:12.261 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:12.261 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:12.261 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:12.261 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:12.261 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:12.261 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:12.261 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:12.262 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:12.262 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:12.262 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:12.262 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:12.262 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:12.262 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:12.262 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:12.262 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:12.262 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:12.263 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:12.263 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:12.263 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:12.263 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:12.263 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:12.263 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:12.263 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:12.264 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:12.264 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:12.264 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:12.264 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:12.264 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:12.264 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:12.264 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:12.264 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:12.264 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:12.265 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:12.265 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:12.265 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:12.265 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:12.265 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:12.265 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:12.265 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:12.265 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:11 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:12.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:11 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:12.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:11 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:12.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:11 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:12.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:11 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:12.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:11 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:12.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:11 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:12.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:11 smithi130 ceph-mon[84407]: pgmap v292: 161 pgs: 11 peering, 32 active+undersized, 24 active+undersized+degraded, 94 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 113/726 objects degraded (15.565%) 2024-06-18T02:16:12.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:11 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:12.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:11 smithi130 ceph-mon[84407]: osdmap e165: 8 total, 8 up, 8 in 2024-06-18T02:16:12.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:12.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:12.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:12.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:12.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:11 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:12.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:11 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:12.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:12.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:12.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:12.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:12.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:11 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:12.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:11 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:12.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:16:12.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:12.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:12.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:12.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:12.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:11 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:12.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:11 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:12.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:12.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:12.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:12.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:12.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:11 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:12.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:12.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:12.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:12.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:12.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:11 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:12.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:12.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:12.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:12.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:12.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:11 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:12.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:12.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:12.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:12.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:12.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:11 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:12.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:12.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:12.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:12.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:12.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:11 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:13.134 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:12 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:13.134 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:12 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:13.134 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:12 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:13.134 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:12 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:13.134 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:12 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:13.134 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:12 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:13.135 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:12 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:13.135 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:13.135 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:13.135 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:13.135 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:13.135 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:12 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:13.135 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:12 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:13.135 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:13.135 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:13.135 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:13.135 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:13.135 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:12 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:13.135 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:13.136 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:13.136 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:13.136 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:13.136 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:12 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:13.136 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:13.136 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:13.136 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:13.136 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:13.136 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:12 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:13.136 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:13.136 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:13.136 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:13.136 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:13.136 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:12 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:13.137 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:13.137 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:13.137 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:13.137 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:13.137 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:12 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:13.137 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:13.137 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:13.137 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:13.137 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:13.137 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:12 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:13.137 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:13.137 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:13.137 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:13.138 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:13.138 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:12 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:13.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:13.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:13.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:13.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:13.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:13.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:13.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:13.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:13.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:13.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:13.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:13.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:13.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:13.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:13.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:13.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:13.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:13.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:13.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:13.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:13.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:13.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:13.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:13.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:13.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:13.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:13.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:13.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:13.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:13.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:13.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:13.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:13.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:13.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:13.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:13.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:13.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:13.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:13.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:13.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:13.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:13.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:13.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:13.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:13.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:13.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:13.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:13.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:13.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:13.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:13.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:13.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:13.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:13.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:13.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:13.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:13.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:13.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:13.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:13.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:13.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:13.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:13.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:13.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:13.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:13.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:13.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:13.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:13.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:13.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:13.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:13.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:13.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:13.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:13.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:13.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:13.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:13.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:13.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:13.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:13.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:13.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:13.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:13.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:13.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:13.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:13.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:13.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:13.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:13.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:13.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:13.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:13.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:13.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:13.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:13.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:12 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:14.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:13 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:14.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:13 smithi130 ceph-mon[84407]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:16:14.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:13 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:14.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:13 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:14.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:13 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:14.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:13 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:14.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:13 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:14.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:13 smithi130 ceph-mon[84407]: pgmap v294: 161 pgs: 11 peering, 19 active+undersized, 14 active+undersized+degraded, 117 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 58/726 objects degraded (7.989%) 2024-06-18T02:16:14.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:13 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:14.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:14.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:14.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:14.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:14.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:13 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:14.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:13 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:14.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:14.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:14.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:14.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:14.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:13 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:14.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:13 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:14.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:14.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:14.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:14.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:14.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:13 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:14.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:14.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:14.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:14.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:14.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:13 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:14.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:14.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:14.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:14.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:14.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:13 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:14.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:14.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:14.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:14.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:14.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:13 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:14.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:14.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:14.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:14.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:14.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:13 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:14.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:14.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:14.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:14.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:14.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:13 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:14.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:14.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:14.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:14.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:14.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:13 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:14.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:14.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[113333]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:16:14.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:14.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:14.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:14.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:14.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:14.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[113333]: pgmap v294: 161 pgs: 11 peering, 19 active+undersized, 14 active+undersized+degraded, 117 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 58/726 objects degraded (7.989%) 2024-06-18T02:16:14.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:14.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:14.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:14.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:14.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:14.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:14.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:14.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:14.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:14.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:14.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:14.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:14.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:14.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:14.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:14.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:14.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:14.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:14.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:14.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:14.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:14.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:14.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[99735]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:16:14.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:14.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:14.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:14.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:14.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:14.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[99735]: pgmap v294: 161 pgs: 11 peering, 19 active+undersized, 14 active+undersized+degraded, 117 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 58/726 objects degraded (7.989%) 2024-06-18T02:16:14.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:14.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:14.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:14.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:14.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:14.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:14.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:14.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:14.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:14.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:14.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:14.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:14.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:14.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:14.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:14.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:14.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:14.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:14.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:14.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:14.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:14.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:14.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:14.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:14.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:14.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:14.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:14.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:14.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:14.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:14.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:14.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:14.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:14.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:14.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:14.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:14.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:14.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:14.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:14.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:14.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:14.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:14.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:14.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:14.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:14.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:14.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:14.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:14.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:14.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:14.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:14.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:14.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:14.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:14.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:14.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:14.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:14.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:14.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:14.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:14.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:14.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:14.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:14.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:14.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:14.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:14.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:14.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:14.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:14.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:14.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:14.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:14.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:14.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:14.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:13 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:14.641 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:16:14 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:16:14.384+0000 7f680f9b8640 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-06-18T02:16:15.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:14 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:15.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:14 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:15.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:14 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:15.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:14 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:15.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:14 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:15.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:14 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:15.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:14 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:15.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:15.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:15.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:15.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:15.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:14 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:15.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:14 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:15.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:15.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:15.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:15.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:15.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:14 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:15.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:15.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:15.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:15.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:15.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:14 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:15.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:14 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:15.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:14 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:15.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:15.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:15.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:14 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:15.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:15.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:15.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-06-18T02:16:15.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:14 smithi130 ceph-mon[84407]: Health check update: Degraded data redundancy: 58/726 objects degraded (7.989%), 14 pgs degraded (PG_DEGRADED) 2024-06-18T02:16:15.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:15.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:15.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:15.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:15.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:15.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:15.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:15.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:15.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:15.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:15.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:15.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:15.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:15.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:15.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:15.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:15.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:15.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:15.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:15.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:15.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:15.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:15.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:15.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:15.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:15.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:15.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:15.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:15.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:15.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:15.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-06-18T02:16:15.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[113333]: Health check update: Degraded data redundancy: 58/726 objects degraded (7.989%), 14 pgs degraded (PG_DEGRADED) 2024-06-18T02:16:15.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:15.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:15.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:15.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:15.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:15.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:15.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:15.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:15.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:15.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:15.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:15.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:15.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:15.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:15.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:15.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:15.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:15.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:15.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:15.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:15.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:15.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:15.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:15.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:15.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:15.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:15.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:15.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:15.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:15.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:15.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-06-18T02:16:15.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:14 smithi007 ceph-mon[99735]: Health check update: Degraded data redundancy: 58/726 objects degraded (7.989%), 14 pgs degraded (PG_DEGRADED) 2024-06-18T02:16:16.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:15 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:16.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:15 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:16.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:15 smithi007 ceph-mon[113333]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-06-18T02:16:16.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:15 smithi007 ceph-mon[113333]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-06-18T02:16:16.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:15 smithi007 ceph-mon[113333]: pgmap v295: 161 pgs: 11 peering, 3 active+undersized, 4 active+undersized+degraded, 143 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 18/726 objects degraded (2.479%) 2024-06-18T02:16:16.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:15 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:16.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:15 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:16.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:15 smithi007 ceph-mon[99735]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-06-18T02:16:16.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:15 smithi007 ceph-mon[99735]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-06-18T02:16:16.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:15 smithi007 ceph-mon[99735]: pgmap v295: 161 pgs: 11 peering, 3 active+undersized, 4 active+undersized+degraded, 143 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 18/726 objects degraded (2.479%) 2024-06-18T02:16:16.214 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:15 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:16.214 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:15 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:16.214 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:15 smithi130 ceph-mon[84407]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-06-18T02:16:16.214 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:15 smithi130 ceph-mon[84407]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-06-18T02:16:16.214 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:15 smithi130 ceph-mon[84407]: pgmap v295: 161 pgs: 11 peering, 3 active+undersized, 4 active+undersized+degraded, 143 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 18/726 objects degraded (2.479%) 2024-06-18T02:16:17.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:17 smithi130 ceph-mon[84407]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 18/726 objects degraded (2.479%), 4 pgs degraded) 2024-06-18T02:16:17.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:17 smithi130 ceph-mon[84407]: Cluster is now healthy 2024-06-18T02:16:17.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:17 smithi007 ceph-mon[113333]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 18/726 objects degraded (2.479%), 4 pgs degraded) 2024-06-18T02:16:17.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:17 smithi007 ceph-mon[113333]: Cluster is now healthy 2024-06-18T02:16:17.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:17 smithi007 ceph-mon[99735]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 18/726 objects degraded (2.479%), 4 pgs degraded) 2024-06-18T02:16:17.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:17 smithi007 ceph-mon[99735]: Cluster is now healthy 2024-06-18T02:16:18.093 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:18 smithi130 ceph-mon[84407]: pgmap v296: 161 pgs: 161 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 650 B/s rd, 0 op/s 2024-06-18T02:16:18.093 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:16:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:16:17] "GET /metrics HTTP/1.1" 200 38291 "" "Prometheus/2.33.4" 2024-06-18T02:16:18.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:18 smithi007 ceph-mon[113333]: pgmap v296: 161 pgs: 161 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 650 B/s rd, 0 op/s 2024-06-18T02:16:18.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:18 smithi007 ceph-mon[99735]: pgmap v296: 161 pgs: 161 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 650 B/s rd, 0 op/s 2024-06-18T02:16:20.066 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:20 smithi130 ceph-mon[84407]: pgmap v297: 161 pgs: 161 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-06-18T02:16:20.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:20 smithi007 ceph-mon[113333]: pgmap v297: 161 pgs: 161 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-06-18T02:16:20.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:20 smithi007 ceph-mon[99735]: pgmap v297: 161 pgs: 161 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-06-18T02:16:21.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:21 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:21.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:21 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:21.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:21 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:21.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:21 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:21.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:21 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:21.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:21 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:21.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:21 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:21.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:21 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:21.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:21 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:21.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:21 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:21.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:21 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:21.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:21 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:21.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:21 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:21.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:21 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:21.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:21 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:21.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:21 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:21.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:21 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:21.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:21 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:22.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:22 smithi007 ceph-mon[113333]: pgmap v298: 161 pgs: 161 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-06-18T02:16:22.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:22 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:22.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:22 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:22.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:22 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:22.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:22 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:22.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:22 smithi007 ceph-mon[99735]: pgmap v298: 161 pgs: 161 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-06-18T02:16:22.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:22 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:22.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:22 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:22.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:22 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:22.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:22 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:22.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:22 smithi130 ceph-mon[84407]: pgmap v298: 161 pgs: 161 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-06-18T02:16:22.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:22 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:22.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:22 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:22.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:22 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:22.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:22 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:24.301 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:24 smithi007 ceph-mon[113333]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:16:24.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:24 smithi007 ceph-mon[113333]: pgmap v299: 161 pgs: 161 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 862 B/s rd, 0 op/s 2024-06-18T02:16:24.302 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:24 smithi007 ceph-mon[99735]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:16:24.302 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:24 smithi007 ceph-mon[99735]: pgmap v299: 161 pgs: 161 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 862 B/s rd, 0 op/s 2024-06-18T02:16:24.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:24 smithi130 ceph-mon[84407]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:16:24.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:24 smithi130 ceph-mon[84407]: pgmap v299: 161 pgs: 161 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 862 B/s rd, 0 op/s 2024-06-18T02:16:24.853 INFO:teuthology.orchestra.run.smithi007.stdout:true 2024-06-18T02:16:25.545 INFO:teuthology.orchestra.run.smithi007.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-18T02:16:25.545 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi007 smithi007 running 3s ago 19m - - 2024-06-18T02:16:25.545 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi130 smithi130 running 5s ago 19m - - 2024-06-18T02:16:25.545 INFO:teuthology.orchestra.run.smithi007.stdout:alertmanager.a smithi007 *:9093,9094 running (9m) 3s ago 14m 23.8M - 0.23.0 ba2b418f427c 5994e8525c64 2024-06-18T02:16:25.546 INFO:teuthology.orchestra.run.smithi007.stdout:grafana.a smithi130 *:3000 running (8m) 5s ago 14m 49.4M - 8.3.5 dad864ee21e9 70ba81d97c8e 2024-06-18T02:16:25.546 INFO:teuthology.orchestra.run.smithi007.stdout:iscsi.foo.smithi007.xvdrwd smithi007 running (7m) 3s ago 12m 63.9M - 3.5 e1d6a67b021e 94121ad2702c 2024-06-18T02:16:25.546 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.x smithi130 *:8443,9283,8765 running (8m) 5s ago 18m 533M - 19.0.0-3124-g3781e3a5 af93c036e016 01017e37bdbe 2024-06-18T02:16:25.546 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.y smithi007 *:8443,9283,8765 running (6m) 3s ago 20m 444M - 19.0.0-3124-g3781e3a5 af93c036e016 2141e131e896 2024-06-18T02:16:25.546 INFO:teuthology.orchestra.run.smithi007.stdout:mon.a smithi007 running (4m) 3s ago 20m 59.3M 2048M 19.0.0-3124-g3781e3a5 af93c036e016 7bbe646cd5b7 2024-06-18T02:16:25.546 INFO:teuthology.orchestra.run.smithi007.stdout:mon.b smithi130 running (5m) 5s ago 19m 56.8M 2048M 19.0.0-3124-g3781e3a5 af93c036e016 baacf2add994 2024-06-18T02:16:25.546 INFO:teuthology.orchestra.run.smithi007.stdout:mon.c smithi007 running (5m) 3s ago 19m 59.6M 2048M 19.0.0-3124-g3781e3a5 af93c036e016 39418356156e 2024-06-18T02:16:25.546 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.a smithi007 *:9100 running (9m) 3s ago 14m 17.8M - 1.3.1 1dbe0e931976 8128e558f099 2024-06-18T02:16:25.546 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.b smithi130 *:9100 running (9m) 5s ago 14m 16.4M - 1.3.1 1dbe0e931976 bab93b43cf16 2024-06-18T02:16:25.546 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0 smithi007 running (3m) 3s ago 18m 52.7M 4096M 19.0.0-3124-g3781e3a5 af93c036e016 07c7f4afd49a 2024-06-18T02:16:25.546 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1 smithi007 running (2m) 3s ago 18m 48.5M 4096M 19.0.0-3124-g3781e3a5 af93c036e016 e8d184614e94 2024-06-18T02:16:25.546 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2 smithi007 running (2m) 3s ago 17m 44.5M 4096M 19.0.0-3124-g3781e3a5 af93c036e016 7d9a05b4bfa5 2024-06-18T02:16:25.547 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3 smithi007 running (57s) 3s ago 17m 52.2M 4096M 19.0.0-3124-g3781e3a5 af93c036e016 7e879cda3b51 2024-06-18T02:16:25.547 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4 smithi130 running (21s) 5s ago 16m 47.8M 4096M 19.0.0-3124-g3781e3a5 af93c036e016 5faedfcb14a8 2024-06-18T02:16:25.547 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5 smithi130 running (16m) 5s ago 16m 64.5M 4096M 17.2.0 e1d6a67b021e f645d7f12378 2024-06-18T02:16:25.547 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6 smithi130 running (16m) 5s ago 16m 59.4M 4096M 17.2.0 e1d6a67b021e c7af86c14959 2024-06-18T02:16:25.547 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7 smithi130 running (15m) 5s ago 15m 64.3M 4096M 17.2.0 e1d6a67b021e 3688af8b2c46 2024-06-18T02:16:25.547 INFO:teuthology.orchestra.run.smithi007.stdout:prometheus.a smithi130 *:9095 running (7m) 5s ago 15m 75.9M - 2.33.4 514e6a882f6e e905fb2eb4a6 2024-06-18T02:16:25.547 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi007.dvbvbk smithi007 *:8000 running (13m) 3s ago 13m 78.4M - 17.2.0 e1d6a67b021e 1344b55b763c 2024-06-18T02:16:25.547 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi130.aakmof smithi130 *:8000 running (13m) 5s ago 13m 76.2M - 17.2.0 e1d6a67b021e e257e3230c6c 2024-06-18T02:16:25.547 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi007.hgrnmk smithi007 *:80 running (13m) 3s ago 13m 76.2M - 17.2.0 e1d6a67b021e 2173947bc4d6 2024-06-18T02:16:25.547 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi130.wwebfk smithi130 *:80 running (13m) 5s ago 12m 78.1M - 17.2.0 e1d6a67b021e 8662706b2231 2024-06-18T02:16:25.966 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:16:25.967 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": { 2024-06-18T02:16:25.967 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 3 2024-06-18T02:16:25.967 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:16:25.967 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": { 2024-06-18T02:16:25.967 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 2 2024-06-18T02:16:25.967 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:16:25.967 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": { 2024-06-18T02:16:25.967 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3, 2024-06-18T02:16:25.967 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 5 2024-06-18T02:16:25.967 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:16:25.967 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw": { 2024-06-18T02:16:25.968 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-06-18T02:16:25.968 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:16:25.968 INFO:teuthology.orchestra.run.smithi007.stdout: "overall": { 2024-06-18T02:16:25.968 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 7, 2024-06-18T02:16:25.968 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 10 2024-06-18T02:16:25.968 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-06-18T02:16:25.968 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:16:26.315 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:16:26.315 INFO:teuthology.orchestra.run.smithi007.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00", 2024-06-18T02:16:26.315 INFO:teuthology.orchestra.run.smithi007.stdout: "in_progress": true, 2024-06-18T02:16:26.315 INFO:teuthology.orchestra.run.smithi007.stdout: "which": "Upgrading all daemon types on all hosts", 2024-06-18T02:16:26.315 INFO:teuthology.orchestra.run.smithi007.stdout: "services_complete": [ 2024-06-18T02:16:26.315 INFO:teuthology.orchestra.run.smithi007.stdout: "mon", 2024-06-18T02:16:26.315 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr" 2024-06-18T02:16:26.315 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-06-18T02:16:26.316 INFO:teuthology.orchestra.run.smithi007.stdout: "progress": "10/23 daemons upgraded", 2024-06-18T02:16:26.316 INFO:teuthology.orchestra.run.smithi007.stdout: "message": "Currently upgrading osd daemons", 2024-06-18T02:16:26.316 INFO:teuthology.orchestra.run.smithi007.stdout: "is_paused": false 2024-06-18T02:16:26.316 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:16:26.316 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:26 smithi007 ceph-mon[113333]: from='client.94443 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:16:26.316 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:26 smithi007 ceph-mon[113333]: pgmap v300: 161 pgs: 161 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:16:26.316 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:26 smithi007 ceph-mon[113333]: from='client.? 172.21.15.7:0/3157349793' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:26.317 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:26 smithi007 ceph-mon[99735]: from='client.94443 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:16:26.317 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:26 smithi007 ceph-mon[99735]: pgmap v300: 161 pgs: 161 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:16:26.317 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:26 smithi007 ceph-mon[99735]: from='client.? 172.21.15.7:0/3157349793' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:26.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:26 smithi130 ceph-mon[84407]: from='client.94443 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:16:26.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:26 smithi130 ceph-mon[84407]: pgmap v300: 161 pgs: 161 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:16:26.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:26 smithi130 ceph-mon[84407]: from='client.? 172.21.15.7:0/3157349793' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:26.725 INFO:teuthology.orchestra.run.smithi007.stdout:HEALTH_OK 2024-06-18T02:16:27.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:27 smithi007 ceph-mon[113333]: from='client.94449 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:16:27.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:27 smithi007 ceph-mon[113333]: from='client.54496 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:16:27.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:27 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:27.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:16:27.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:27 smithi007 ceph-mon[113333]: from='client.? 172.21.15.7:0/1529012585' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:16:27.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:27 smithi007 ceph-mon[99735]: from='client.94449 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:16:27.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:27 smithi007 ceph-mon[99735]: from='client.54496 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:16:27.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:27 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:27.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:16:27.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:27 smithi007 ceph-mon[99735]: from='client.? 172.21.15.7:0/1529012585' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:16:27.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:27 smithi130 ceph-mon[84407]: from='client.94449 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:16:27.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:27 smithi130 ceph-mon[84407]: from='client.54496 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:16:27.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:27 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:27.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:16:27.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:27 smithi130 ceph-mon[84407]: from='client.? 172.21.15.7:0/1529012585' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:16:28.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:28 smithi130 ceph-mon[84407]: from='client.54508 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:16:28.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:28 smithi130 ceph-mon[84407]: pgmap v301: 161 pgs: 161 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:16:28.294 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:16:27 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:16:27] "GET /metrics HTTP/1.1" 200 38431 "" "Prometheus/2.33.4" 2024-06-18T02:16:28.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:28 smithi007 ceph-mon[113333]: from='client.54508 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:16:28.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:28 smithi007 ceph-mon[113333]: pgmap v301: 161 pgs: 161 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:16:28.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:28 smithi007 ceph-mon[99735]: from='client.54508 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:16:28.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:28 smithi007 ceph-mon[99735]: pgmap v301: 161 pgs: 161 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:16:30.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:30 smithi130 ceph-mon[84407]: pgmap v302: 161 pgs: 161 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:16:30.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-06-18T02:16:30.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:30 smithi007 ceph-mon[113333]: pgmap v302: 161 pgs: 161 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:16:30.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-06-18T02:16:30.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:30 smithi007 ceph-mon[99735]: pgmap v302: 161 pgs: 161 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:16:30.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-06-18T02:16:31.356 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:31 smithi130 ceph-mon[84407]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-06-18T02:16:31.357 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:31 smithi130 ceph-mon[84407]: Upgrade: osd.4 is safe to restart 2024-06-18T02:16:31.357 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-06-18T02:16:31.357 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:31.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:31 smithi007 ceph-mon[113333]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-06-18T02:16:31.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:31 smithi007 ceph-mon[113333]: Upgrade: osd.4 is safe to restart 2024-06-18T02:16:31.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-06-18T02:16:31.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:31.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:31 smithi007 ceph-mon[99735]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-06-18T02:16:31.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:31 smithi007 ceph-mon[99735]: Upgrade: osd.4 is safe to restart 2024-06-18T02:16:31.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-06-18T02:16:31.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:32.222 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:32 smithi130 ceph-mon[84407]: Upgrade: Updating osd.4 2024-06-18T02:16:32.222 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:32 smithi130 ceph-mon[84407]: pgmap v303: 161 pgs: 161 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:16:32.223 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:32 smithi130 ceph-mon[84407]: Deploying daemon osd.4 on smithi130 2024-06-18T02:16:32.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:32 smithi007 ceph-mon[113333]: Upgrade: Updating osd.4 2024-06-18T02:16:32.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:32 smithi007 ceph-mon[113333]: pgmap v303: 161 pgs: 161 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:16:32.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:32 smithi007 ceph-mon[113333]: Deploying daemon osd.4 on smithi130 2024-06-18T02:16:32.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:32 smithi007 ceph-mon[99735]: Upgrade: Updating osd.4 2024-06-18T02:16:32.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:32 smithi007 ceph-mon[99735]: pgmap v303: 161 pgs: 161 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:16:32.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:32 smithi007 ceph-mon[99735]: Deploying daemon osd.4 on smithi130 2024-06-18T02:16:34.043 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:33 smithi130 systemd[1]: Stopping Ceph osd.4 for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:16:34.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:34 smithi007 ceph-mon[113333]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:16:34.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:34 smithi007 ceph-mon[113333]: pgmap v304: 161 pgs: 161 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:16:34.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:34 smithi007 ceph-mon[99735]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:16:34.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:34 smithi007 ceph-mon[99735]: pgmap v304: 161 pgs: 161 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:16:34.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:34 smithi130 ceph-mon[84407]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:16:34.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:34 smithi130 ceph-mon[84407]: pgmap v304: 161 pgs: 161 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:16:34.544 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:34 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4[121813]: 2024-06-18T02:16:34.151+0000 7efc2790a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-18T02:16:34.544 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:34 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4[121813]: 2024-06-18T02:16:34.151+0000 7efc2790a640 -1 osd.4 165 *** Got signal Terminated *** 2024-06-18T02:16:34.544 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:34 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4[121813]: 2024-06-18T02:16:34.151+0000 7efc2790a640 -1 osd.4 165 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-18T02:16:35.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:35 smithi130 ceph-mon[84407]: osd.4 marked itself down and dead 2024-06-18T02:16:35.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:35 smithi007 ceph-mon[113333]: osd.4 marked itself down and dead 2024-06-18T02:16:35.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:35 smithi007 ceph-mon[99735]: osd.4 marked itself down and dead 2024-06-18T02:16:35.794 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:35 smithi130 podman[126333]: 2024-06-18 02:16:35.575338716 +0000 UTC m=+1.524628312 container died 5faedfcb14a8d78f15df9fc25171264b26d4917007bb9557ccf0461d369335af (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-3781e3a, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240612, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-18T02:16:36.228 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:36 smithi130 ceph-mon[84407]: pgmap v305: 161 pgs: 161 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:16:36.228 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:36 smithi130 ceph-mon[84407]: Health check failed: 1 osds down (OSD_DOWN) 2024-06-18T02:16:36.228 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:36 smithi130 ceph-mon[84407]: osdmap e166: 8 total, 7 up, 8 in 2024-06-18T02:16:36.228 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:35 smithi130 podman[126333]: 2024-06-18 02:16:35.935391471 +0000 UTC m=+1.884681067 container cleanup 5faedfcb14a8d78f15df9fc25171264b26d4917007bb9557ccf0461d369335af (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4, org.label-schema.build-date=20240612, CEPH_POINT_RELEASE=, RELEASE=squid-3781e3a, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-06-18T02:16:36.228 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:35 smithi130 bash[126333]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4 2024-06-18T02:16:36.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:36 smithi007 ceph-mon[113333]: pgmap v305: 161 pgs: 161 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:16:36.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:36 smithi007 ceph-mon[113333]: Health check failed: 1 osds down (OSD_DOWN) 2024-06-18T02:16:36.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:36 smithi007 ceph-mon[113333]: osdmap e166: 8 total, 7 up, 8 in 2024-06-18T02:16:36.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:36 smithi007 ceph-mon[99735]: pgmap v305: 161 pgs: 161 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:16:36.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:36 smithi007 ceph-mon[99735]: Health check failed: 1 osds down (OSD_DOWN) 2024-06-18T02:16:36.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:36 smithi007 ceph-mon[99735]: osdmap e166: 8 total, 7 up, 8 in 2024-06-18T02:16:36.543 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:36 smithi130 podman[126482]: 2024-06-18 02:16:36.228650988 +0000 UTC m=+0.646257486 container remove 5faedfcb14a8d78f15df9fc25171264b26d4917007bb9557ccf0461d369335af (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3781e3a, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240612, org.label-schema.vendor=CentOS, ceph=True) 2024-06-18T02:16:37.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:37 smithi130 ceph-mon[84407]: osdmap e167: 8 total, 7 up, 8 in 2024-06-18T02:16:37.333 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:37 smithi007 ceph-mon[113333]: osdmap e167: 8 total, 7 up, 8 in 2024-06-18T02:16:37.333 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:37 smithi007 ceph-mon[99735]: osdmap e167: 8 total, 7 up, 8 in 2024-06-18T02:16:37.456 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:37 smithi130 podman[126625]: 2024-06-18 02:16:37.109878148 +0000 UTC m=+0.647247701 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:16:37.456 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:37 smithi130 podman[126625]: 2024-06-18 02:16:37.225101764 +0000 UTC m=+0.762471346 container create 8e51f5b005b306649cbea62bcab3e666c4d3035884baccdf5cf6a64205e46f24 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240612, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-3781e3a, org.label-schema.vendor=CentOS, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-06-18T02:16:37.730 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:37 smithi130 podman[126625]: 2024-06-18 02:16:37.460796462 +0000 UTC m=+0.998166011 container init 8e51f5b005b306649cbea62bcab3e666c4d3035884baccdf5cf6a64205e46f24 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4-deactivate, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240612, org.label-schema.vendor=CentOS, RELEASE=squid-3781e3a, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-06-18T02:16:37.730 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:37 smithi130 podman[126625]: 2024-06-18 02:16:37.464114785 +0000 UTC m=+1.001484326 container start 8e51f5b005b306649cbea62bcab3e666c4d3035884baccdf5cf6a64205e46f24 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-3781e3a, org.label-schema.build-date=20240612, org.label-schema.license=GPLv2, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-06-18T02:16:37.730 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:37 smithi130 podman[126625]: 2024-06-18 02:16:37.544159094 +0000 UTC m=+1.081528650 container attach 8e51f5b005b306649cbea62bcab3e666c4d3035884baccdf5cf6a64205e46f24 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, RELEASE=squid-3781e3a, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240612, io.buildah.version=1.36.0) 2024-06-18T02:16:38.043 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:16:37 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:16:37] "GET /metrics HTTP/1.1" 200 38431 "" "Prometheus/2.33.4" 2024-06-18T02:16:38.044 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:37 smithi130 podman[126625]: 2024-06-18 02:16:37.765258018 +0000 UTC m=+1.302627563 container died 8e51f5b005b306649cbea62bcab3e666c4d3035884baccdf5cf6a64205e46f24 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4-deactivate, ceph=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-3781e3a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240612, org.label-schema.schema-version=1.0) 2024-06-18T02:16:38.351 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:38 smithi007 ceph-mon[113333]: pgmap v308: 161 pgs: 7 peering, 22 stale+active+clean, 132 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-06-18T02:16:38.351 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:38 smithi007 ceph-mon[99735]: pgmap v308: 161 pgs: 7 peering, 22 stale+active+clean, 132 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-06-18T02:16:38.458 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:38 smithi130 ceph-mon[84407]: pgmap v308: 161 pgs: 7 peering, 22 stale+active+clean, 132 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-06-18T02:16:39.031 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:38 smithi130 podman[126720]: 2024-06-18 02:16:38.777407298 +0000 UTC m=+1.039526163 container remove 8e51f5b005b306649cbea62bcab3e666c4d3035884baccdf5cf6a64205e46f24 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, RELEASE=squid-3781e3a, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240612, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47) 2024-06-18T02:16:39.031 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:38 smithi130 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.4.service: Deactivated successfully. 2024-06-18T02:16:39.031 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:38 smithi130 systemd[1]: Stopped Ceph osd.4 for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:16:39.031 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:38 smithi130 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.4.service: Consumed 2.021s CPU time. 2024-06-18T02:16:39.293 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:39 smithi130 systemd[1]: Starting Ceph osd.4 for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:16:39.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:39 smithi130 ceph-mon[84407]: pgmap v309: 161 pgs: 27 active+undersized, 7 peering, 8 stale+active+clean, 14 active+undersized+degraded, 105 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 69/726 objects degraded (9.504%) 2024-06-18T02:16:39.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:39 smithi130 ceph-mon[84407]: Health check failed: Degraded data redundancy: 69/726 objects degraded (9.504%), 14 pgs degraded (PG_DEGRADED) 2024-06-18T02:16:39.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:39 smithi007 ceph-mon[113333]: pgmap v309: 161 pgs: 27 active+undersized, 7 peering, 8 stale+active+clean, 14 active+undersized+degraded, 105 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 69/726 objects degraded (9.504%) 2024-06-18T02:16:39.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:39 smithi007 ceph-mon[113333]: Health check failed: Degraded data redundancy: 69/726 objects degraded (9.504%), 14 pgs degraded (PG_DEGRADED) 2024-06-18T02:16:39.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:39 smithi007 ceph-mon[99735]: pgmap v309: 161 pgs: 27 active+undersized, 7 peering, 8 stale+active+clean, 14 active+undersized+degraded, 105 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 69/726 objects degraded (9.504%) 2024-06-18T02:16:39.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:39 smithi007 ceph-mon[99735]: Health check failed: Degraded data redundancy: 69/726 objects degraded (9.504%), 14 pgs degraded (PG_DEGRADED) 2024-06-18T02:16:40.628 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:40 smithi130 podman[126952]: 2024-06-18 02:16:40.220528738 +0000 UTC m=+0.018866312 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:16:40.629 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:40 smithi130 podman[126952]: 2024-06-18 02:16:40.31869271 +0000 UTC m=+0.117030273 container create f820374e1c3db13c70f4df27df59b87bf1cd48cd34206261ab7a9d706b42928a (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-3781e3a, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240612, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.36.0, GIT_BRANCH=HEAD) 2024-06-18T02:16:40.629 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:40 smithi130 podman[126952]: 2024-06-18 02:16:40.54688484 +0000 UTC m=+0.345222419 container init f820374e1c3db13c70f4df27df59b87bf1cd48cd34206261ab7a9d706b42928a (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4-activate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, ceph=True, RELEASE=squid-3781e3a, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240612) 2024-06-18T02:16:40.629 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:40 smithi130 podman[126952]: 2024-06-18 02:16:40.550613595 +0000 UTC m=+0.348951164 container start f820374e1c3db13c70f4df27df59b87bf1cd48cd34206261ab7a9d706b42928a (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4-activate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, ceph=True, org.label-schema.build-date=20240612, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-3781e3a, org.label-schema.license=GPLv2) 2024-06-18T02:16:40.629 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:40 smithi130 podman[126952]: 2024-06-18 02:16:40.629941458 +0000 UTC m=+0.428279024 container attach f820374e1c3db13c70f4df27df59b87bf1cd48cd34206261ab7a9d706b42928a (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4-activate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, RELEASE=squid-3781e3a, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, ceph=True, org.label-schema.build-date=20240612, CEPH_POINT_RELEASE=) 2024-06-18T02:16:41.285 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:40 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4-activate[127009]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-06-18T02:16:41.285 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:40 smithi130 bash[126952]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-06-18T02:16:41.286 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:40 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4-activate[127009]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-06-18T02:16:41.286 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:40 smithi130 bash[126952]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-06-18T02:16:41.286 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:40 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4-activate[127009]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-06-18T02:16:41.286 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:40 smithi130 bash[126952]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-06-18T02:16:41.286 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:40 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4-activate[127009]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-06-18T02:16:41.286 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:40 smithi130 bash[126952]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-06-18T02:16:41.286 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:40 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4-activate[127009]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-4/block 2024-06-18T02:16:41.286 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:40 smithi130 bash[126952]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-4/block 2024-06-18T02:16:41.286 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:40 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4-activate[127009]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-06-18T02:16:41.286 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:40 smithi130 bash[126952]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-06-18T02:16:41.286 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:40 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4-activate[127009]: --> ceph-volume raw activate successful for osd ID: 4 2024-06-18T02:16:41.286 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:40 smithi130 bash[126952]: --> ceph-volume raw activate successful for osd ID: 4 2024-06-18T02:16:41.286 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:40 smithi130 podman[126952]: 2024-06-18 02:16:40.974448468 +0000 UTC m=+0.772786032 container died f820374e1c3db13c70f4df27df59b87bf1cd48cd34206261ab7a9d706b42928a (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4-activate, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240612, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-3781e3a, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47) 2024-06-18T02:16:41.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:41 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:41.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:41 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:41.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:41 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:41.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:41 smithi130 ceph-mon[84407]: pgmap v310: 161 pgs: 41 active+undersized, 26 active+undersized+degraded, 94 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 125/726 objects degraded (17.218%) 2024-06-18T02:16:41.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:41 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:41.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:16:41.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:41 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:41.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:41 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:41.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:41 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:41.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:41 smithi007 ceph-mon[113333]: pgmap v310: 161 pgs: 41 active+undersized, 26 active+undersized+degraded, 94 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 125/726 objects degraded (17.218%) 2024-06-18T02:16:41.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:41 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:41.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:16:41.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:41 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:41.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:41 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:41.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:41 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:41.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:41 smithi007 ceph-mon[99735]: pgmap v310: 161 pgs: 41 active+undersized, 26 active+undersized+degraded, 94 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 125/726 objects degraded (17.218%) 2024-06-18T02:16:41.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:41 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:41.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:16:42.043 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:41 smithi130 podman[127194]: 2024-06-18 02:16:41.652923066 +0000 UTC m=+0.673824144 container remove f820374e1c3db13c70f4df27df59b87bf1cd48cd34206261ab7a9d706b42928a (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4-activate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-3781e3a, ceph=True, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240612, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-06-18T02:16:42.543 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:42 smithi130 podman[127293]: 2024-06-18 02:16:42.280392148 +0000 UTC m=+0.199481003 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:16:42.543 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:42 smithi130 podman[127293]: 2024-06-18 02:16:42.52464986 +0000 UTC m=+0.443738700 container create 24f46c456c319796a9a9e912a7bf09c4a969dcf642ab43c87e152255ad63668d (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-3781e3a, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.36.0, org.label-schema.build-date=20240612, maintainer=Guillaume Abrioux , GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-18T02:16:43.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:42 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:43.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:42 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:43.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:42 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:43.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:42 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:43.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:42 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:43.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:42 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:43.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:43.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:43.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:43.480 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:43 smithi130 podman[127293]: 2024-06-18 02:16:43.10443692 +0000 UTC m=+1.023525772 container init 24f46c456c319796a9a9e912a7bf09c4a969dcf642ab43c87e152255ad63668d (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240612, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-3781e3a, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-06-18T02:16:43.480 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:43 smithi130 podman[127293]: 2024-06-18 02:16:43.107944372 +0000 UTC m=+1.027033210 container start 24f46c456c319796a9a9e912a7bf09c4a969dcf642ab43c87e152255ad63668d (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-3781e3a, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, ceph=True, io.buildah.version=1.36.0, org.label-schema.build-date=20240612, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-06-18T02:16:43.480 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:43 smithi130 ceph-osd[127372]: -- 172.21.15.130:0/1169969893 <== mon.2 v2:172.21.15.130:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f9ef76da40 con 0x55f9f052c000 2024-06-18T02:16:43.480 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:43 smithi130 bash[127293]: 24f46c456c319796a9a9e912a7bf09c4a969dcf642ab43c87e152255ad63668d 2024-06-18T02:16:43.480 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:43 smithi130 systemd[1]: Started Ceph osd.4 for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:16:43.780 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:43 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4[127338]: 2024-06-18T02:16:43.649+0000 7f8e869af640 -1 Falling back to public interface 2024-06-18T02:16:44.035 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:43 smithi007 ceph-mon[113333]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:16:44.035 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:43 smithi007 ceph-mon[113333]: pgmap v311: 161 pgs: 41 active+undersized, 26 active+undersized+degraded, 94 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 125/726 objects degraded (17.218%) 2024-06-18T02:16:44.036 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:43 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:44.036 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:43 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:44.036 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:43 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:44.036 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:43 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:44.036 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:43 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:44.036 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:43 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:44.036 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:43 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:44.036 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:43 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:44.036 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:43 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:44.036 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:43 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:44.036 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:43 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:44.036 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:43 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:44.036 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:43 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:44.036 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:43 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:44.037 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:43 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:44.037 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:43 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:44.037 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:43 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:44.037 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:43 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:44.037 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:43 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:44.037 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:43 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:44.037 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:43 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:44.037 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:43 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:44.037 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:43 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:44.037 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:43 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:44.037 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:43 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:44.037 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:43 smithi007 ceph-mon[99735]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:16:44.037 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:43 smithi007 ceph-mon[99735]: pgmap v311: 161 pgs: 41 active+undersized, 26 active+undersized+degraded, 94 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 125/726 objects degraded (17.218%) 2024-06-18T02:16:44.038 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:43 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:44.038 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:43 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:44.038 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:44.038 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:44.038 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:43 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:44.038 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:44.038 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:44.038 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:44.038 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:44.038 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:43 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:44.038 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:44.038 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:44.038 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:44.039 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:44.039 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:43 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:44.039 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:44.039 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:44.039 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:44.039 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:44.039 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:43 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:44.039 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:44.039 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:44.039 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:44.039 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:43 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:44.039 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:43 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:44.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:43 smithi130 ceph-mon[84407]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:16:44.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:43 smithi130 ceph-mon[84407]: pgmap v311: 161 pgs: 41 active+undersized, 26 active+undersized+degraded, 94 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 125/726 objects degraded (17.218%) 2024-06-18T02:16:44.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:43 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:44.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:43 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:44.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:44.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:44.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:43 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:44.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:44.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:44.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:44.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:44.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:43 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:44.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:44.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:44.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:44.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:44.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:43 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:44.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:44.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:44.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:44.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:44.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:43 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:44.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:44.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:44.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:44.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:43 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:44.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:43 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:44.724 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:16:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:16:44.377+0000 7f680f9b8640 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (13 PGs are or would become offline) 2024-06-18T02:16:45.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:44 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:45.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:44 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:45.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:44 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:45.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:44 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:45.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:44 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:45.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:45.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:45.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:45.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:45.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:44 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:45.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:44 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:45.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:45.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:45.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:45.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:45.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:44 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:45.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:44 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:45.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:45.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:45.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:45.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:45.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:44 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:45.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:45.045 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:45.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:45.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:45.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:44 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:45.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:44 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:45.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:44 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:45.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:44 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:45.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:45.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:45.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:45.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:45.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:44 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-06-18T02:16:45.046 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:44 smithi130 ceph-mon[84407]: Health check update: Degraded data redundancy: 125/726 objects degraded (17.218%), 26 pgs degraded (PG_DEGRADED) 2024-06-18T02:16:45.164 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:45.165 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:45.165 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:45.165 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:45.165 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:45.165 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:45.165 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:45.165 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:45.165 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:45.165 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:45.165 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:45.165 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:45.165 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:45.165 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:45.165 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:45.166 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:45.166 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:45.166 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:45.166 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:45.166 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:45.166 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:45.166 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:45.166 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:45.166 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:45.166 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:45.166 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:45.166 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:45.166 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:45.167 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:45.167 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:45.167 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:45.167 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:45.167 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:45.167 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:45.167 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-06-18T02:16:45.167 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[113333]: Health check update: Degraded data redundancy: 125/726 objects degraded (17.218%), 26 pgs degraded (PG_DEGRADED) 2024-06-18T02:16:45.167 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:45.167 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:45.168 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:45.168 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:45.168 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:45.168 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:45.168 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:45.168 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:45.168 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:45.168 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:45.168 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:45.168 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:45.168 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:45.168 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:45.168 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:45.168 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:45.169 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:45.169 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:45.169 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:45.169 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:45.169 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:45.169 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:45.169 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:45.169 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:45.169 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:16:45.169 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:16:45.169 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:45.169 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:45.169 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:45.169 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:45.170 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:16:45.170 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:45.170 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:45.170 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:45.170 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-06-18T02:16:45.170 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:44 smithi007 ceph-mon[99735]: Health check update: Degraded data redundancy: 125/726 objects degraded (17.218%), 26 pgs degraded (PG_DEGRADED) 2024-06-18T02:16:46.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:45 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:46.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:45 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:46.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:45 smithi130 ceph-mon[84407]: pgmap v312: 161 pgs: 41 active+undersized, 26 active+undersized+degraded, 94 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 125/726 objects degraded (17.218%) 2024-06-18T02:16:46.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:45 smithi130 ceph-mon[84407]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-06-18T02:16:46.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:45 smithi130 ceph-mon[84407]: Upgrade: unsafe to stop osd(s) at this time (13 PGs are or would become offline) 2024-06-18T02:16:46.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:45 smithi130 ceph-mon[84407]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-06-18T02:16:46.135 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:45 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:46.135 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:45 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:46.135 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:45 smithi007 ceph-mon[113333]: pgmap v312: 161 pgs: 41 active+undersized, 26 active+undersized+degraded, 94 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 125/726 objects degraded (17.218%) 2024-06-18T02:16:46.136 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:45 smithi007 ceph-mon[113333]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-06-18T02:16:46.136 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:45 smithi007 ceph-mon[113333]: Upgrade: unsafe to stop osd(s) at this time (13 PGs are or would become offline) 2024-06-18T02:16:46.136 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:45 smithi007 ceph-mon[113333]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-06-18T02:16:46.136 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:45 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:46.136 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:45 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:16:46.136 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:45 smithi007 ceph-mon[99735]: pgmap v312: 161 pgs: 41 active+undersized, 26 active+undersized+degraded, 94 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 125/726 objects degraded (17.218%) 2024-06-18T02:16:46.136 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:45 smithi007 ceph-mon[99735]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-06-18T02:16:46.136 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:45 smithi007 ceph-mon[99735]: Upgrade: unsafe to stop osd(s) at this time (13 PGs are or would become offline) 2024-06-18T02:16:46.136 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:45 smithi007 ceph-mon[99735]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-06-18T02:16:46.626 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:46 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4[127338]: 2024-06-18T02:16:46.415+0000 7f8e869af640 -1 osd.4 165 log_to_monitors true 2024-06-18T02:16:47.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:46 smithi130 ceph-mon[84407]: from='osd.4 [v2:172.21.15.130:6800/2583741146,v1:172.21.15.130:6801/2583741146]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-18T02:16:47.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:46 smithi130 ceph-mon[84407]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-18T02:16:47.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:46 smithi007 ceph-mon[99735]: from='osd.4 [v2:172.21.15.130:6800/2583741146,v1:172.21.15.130:6801/2583741146]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-18T02:16:47.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:46 smithi007 ceph-mon[99735]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-18T02:16:47.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:46 smithi007 ceph-mon[113333]: from='osd.4 [v2:172.21.15.130:6800/2583741146,v1:172.21.15.130:6801/2583741146]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-18T02:16:47.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:46 smithi007 ceph-mon[113333]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-18T02:16:47.536 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:16:47 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4[127338]: 2024-06-18T02:16:47.234+0000 7f8e7a752640 -1 osd.4 165 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-18T02:16:48.043 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:16:47 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:16:47] "GET /metrics HTTP/1.1" 200 38439 "" "Prometheus/2.33.4" 2024-06-18T02:16:48.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:47 smithi130 ceph-mon[84407]: pgmap v313: 161 pgs: 41 active+undersized, 26 active+undersized+degraded, 94 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 996 B/s rd, 0 op/s; 125/726 objects degraded (17.218%) 2024-06-18T02:16:48.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:47 smithi130 ceph-mon[84407]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-06-18T02:16:48.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:47 smithi130 ceph-mon[84407]: osdmap e168: 8 total, 7 up, 8 in 2024-06-18T02:16:48.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:47 smithi130 ceph-mon[84407]: from='osd.4 [v2:172.21.15.130:6800/2583741146,v1:172.21.15.130:6801/2583741146]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:16:48.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:47 smithi130 ceph-mon[84407]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:16:48.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:47 smithi130 ceph-mon[84407]: from='osd.4 ' entity='osd.4' 2024-06-18T02:16:48.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:47 smithi007 ceph-mon[99735]: pgmap v313: 161 pgs: 41 active+undersized, 26 active+undersized+degraded, 94 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 996 B/s rd, 0 op/s; 125/726 objects degraded (17.218%) 2024-06-18T02:16:48.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:47 smithi007 ceph-mon[99735]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-06-18T02:16:48.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:47 smithi007 ceph-mon[99735]: osdmap e168: 8 total, 7 up, 8 in 2024-06-18T02:16:48.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:47 smithi007 ceph-mon[99735]: from='osd.4 [v2:172.21.15.130:6800/2583741146,v1:172.21.15.130:6801/2583741146]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:16:48.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:47 smithi007 ceph-mon[99735]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:16:48.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:47 smithi007 ceph-mon[99735]: from='osd.4 ' entity='osd.4' 2024-06-18T02:16:48.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:47 smithi007 ceph-mon[113333]: pgmap v313: 161 pgs: 41 active+undersized, 26 active+undersized+degraded, 94 active+clean; 585 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 996 B/s rd, 0 op/s; 125/726 objects degraded (17.218%) 2024-06-18T02:16:48.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:47 smithi007 ceph-mon[113333]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-06-18T02:16:48.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:47 smithi007 ceph-mon[113333]: osdmap e168: 8 total, 7 up, 8 in 2024-06-18T02:16:48.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:47 smithi007 ceph-mon[113333]: from='osd.4 [v2:172.21.15.130:6800/2583741146,v1:172.21.15.130:6801/2583741146]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:16:48.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:47 smithi007 ceph-mon[113333]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:16:48.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:47 smithi007 ceph-mon[113333]: from='osd.4 ' entity='osd.4' 2024-06-18T02:16:48.837 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:48 smithi130 ceph-mon[84407]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-06-18T02:16:48.837 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:48 smithi130 ceph-mon[84407]: osd.4 [v2:172.21.15.130:6800/2583741146,v1:172.21.15.130:6801/2583741146] boot 2024-06-18T02:16:48.838 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:48 smithi130 ceph-mon[84407]: osdmap e169: 8 total, 8 up, 8 in 2024-06-18T02:16:48.838 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-18T02:16:49.181 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:48 smithi007 ceph-mon[99735]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-06-18T02:16:49.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:48 smithi007 ceph-mon[99735]: osd.4 [v2:172.21.15.130:6800/2583741146,v1:172.21.15.130:6801/2583741146] boot 2024-06-18T02:16:49.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:48 smithi007 ceph-mon[99735]: osdmap e169: 8 total, 8 up, 8 in 2024-06-18T02:16:49.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-18T02:16:49.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:48 smithi007 ceph-mon[113333]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-06-18T02:16:49.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:48 smithi007 ceph-mon[113333]: osd.4 [v2:172.21.15.130:6800/2583741146,v1:172.21.15.130:6801/2583741146] boot 2024-06-18T02:16:49.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:48 smithi007 ceph-mon[113333]: osdmap e169: 8 total, 8 up, 8 in 2024-06-18T02:16:49.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-18T02:16:49.935 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:49 smithi130 ceph-mon[84407]: pgmap v316: 161 pgs: 41 active+undersized, 26 active+undersized+degraded, 94 active+clean; 585 KiB data, 216 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s; 125/726 objects degraded (17.218%) 2024-06-18T02:16:49.935 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:49 smithi130 ceph-mon[84407]: osdmap e170: 8 total, 8 up, 8 in 2024-06-18T02:16:50.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:49 smithi007 ceph-mon[113333]: pgmap v316: 161 pgs: 41 active+undersized, 26 active+undersized+degraded, 94 active+clean; 585 KiB data, 216 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s; 125/726 objects degraded (17.218%) 2024-06-18T02:16:50.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:49 smithi007 ceph-mon[113333]: osdmap e170: 8 total, 8 up, 8 in 2024-06-18T02:16:50.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:49 smithi007 ceph-mon[99735]: pgmap v316: 161 pgs: 41 active+undersized, 26 active+undersized+degraded, 94 active+clean; 585 KiB data, 216 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s; 125/726 objects degraded (17.218%) 2024-06-18T02:16:50.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:49 smithi007 ceph-mon[99735]: osdmap e170: 8 total, 8 up, 8 in 2024-06-18T02:16:51.142 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:50 smithi130 ceph-mon[84407]: Health check update: Degraded data redundancy: 95/726 objects degraded (13.085%), 20 pgs degraded (PG_DEGRADED) 2024-06-18T02:16:51.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:50 smithi007 ceph-mon[113333]: Health check update: Degraded data redundancy: 95/726 objects degraded (13.085%), 20 pgs degraded (PG_DEGRADED) 2024-06-18T02:16:51.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:50 smithi007 ceph-mon[99735]: Health check update: Degraded data redundancy: 95/726 objects degraded (13.085%), 20 pgs degraded (PG_DEGRADED) 2024-06-18T02:16:52.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:51 smithi007 ceph-mon[113333]: pgmap v318: 161 pgs: 29 active+undersized, 20 active+undersized+degraded, 112 active+clean; 585 KiB data, 216 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 95/726 objects degraded (13.085%) 2024-06-18T02:16:52.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:51 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:52.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:51 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:52.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:51 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:52.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:51 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:52.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:51 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:52.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:51 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:52.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:51 smithi007 ceph-mon[99735]: pgmap v318: 161 pgs: 29 active+undersized, 20 active+undersized+degraded, 112 active+clean; 585 KiB data, 216 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 95/726 objects degraded (13.085%) 2024-06-18T02:16:52.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:51 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:52.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:51 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:52.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:51 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:52.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:51 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:52.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:51 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:52.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:51 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:52.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:51 smithi130 ceph-mon[84407]: pgmap v318: 161 pgs: 29 active+undersized, 20 active+undersized+degraded, 112 active+clean; 585 KiB data, 216 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 95/726 objects degraded (13.085%) 2024-06-18T02:16:52.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:51 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:52.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:51 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:52.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:51 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:52.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:51 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:52.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:51 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:52.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:51 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:53.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:52 smithi007 ceph-mon[113333]: pgmap v319: 161 pgs: 29 active+undersized, 20 active+undersized+degraded, 112 active+clean; 585 KiB data, 216 MiB used, 715 GiB / 715 GiB avail; 980 B/s rd, 0 op/s; 95/726 objects degraded (13.085%) 2024-06-18T02:16:53.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:52 smithi007 ceph-mon[113333]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-06-18T02:16:53.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:52 smithi007 ceph-mon[99735]: pgmap v319: 161 pgs: 29 active+undersized, 20 active+undersized+degraded, 112 active+clean; 585 KiB data, 216 MiB used, 715 GiB / 715 GiB avail; 980 B/s rd, 0 op/s; 95/726 objects degraded (13.085%) 2024-06-18T02:16:53.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:52 smithi007 ceph-mon[99735]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-06-18T02:16:53.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:52 smithi130 ceph-mon[84407]: pgmap v319: 161 pgs: 29 active+undersized, 20 active+undersized+degraded, 112 active+clean; 585 KiB data, 216 MiB used, 715 GiB / 715 GiB avail; 980 B/s rd, 0 op/s; 95/726 objects degraded (13.085%) 2024-06-18T02:16:53.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:52 smithi130 ceph-mon[84407]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-06-18T02:16:54.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:53 smithi007 ceph-mon[113333]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:16:54.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:53 smithi007 ceph-mon[99735]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:16:54.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:53 smithi130 ceph-mon[84407]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:16:55.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:54 smithi007 ceph-mon[113333]: pgmap v320: 161 pgs: 161 active+clean; 585 KiB data, 220 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-06-18T02:16:55.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:54 smithi007 ceph-mon[113333]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 95/726 objects degraded (13.085%), 20 pgs degraded) 2024-06-18T02:16:55.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:54 smithi007 ceph-mon[113333]: Cluster is now healthy 2024-06-18T02:16:55.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:54 smithi007 ceph-mon[99735]: pgmap v320: 161 pgs: 161 active+clean; 585 KiB data, 220 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-06-18T02:16:55.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:54 smithi007 ceph-mon[99735]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 95/726 objects degraded (13.085%), 20 pgs degraded) 2024-06-18T02:16:55.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:54 smithi007 ceph-mon[99735]: Cluster is now healthy 2024-06-18T02:16:55.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:54 smithi130 ceph-mon[84407]: pgmap v320: 161 pgs: 161 active+clean; 585 KiB data, 220 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-06-18T02:16:55.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:54 smithi130 ceph-mon[84407]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 95/726 objects degraded (13.085%), 20 pgs degraded) 2024-06-18T02:16:55.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:54 smithi130 ceph-mon[84407]: Cluster is now healthy 2024-06-18T02:16:57.104 INFO:teuthology.orchestra.run.smithi007.stdout:true 2024-06-18T02:16:57.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:56 smithi007 ceph-mon[113333]: pgmap v321: 161 pgs: 161 active+clean; 585 KiB data, 220 MiB used, 715 GiB / 715 GiB avail; 696 B/s rd, 0 op/s 2024-06-18T02:16:57.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:56 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:57.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:16:57.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:56 smithi007 ceph-mon[99735]: pgmap v321: 161 pgs: 161 active+clean; 585 KiB data, 220 MiB used, 715 GiB / 715 GiB avail; 696 B/s rd, 0 op/s 2024-06-18T02:16:57.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:56 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:57.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:16:57.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:56 smithi130 ceph-mon[84407]: pgmap v321: 161 pgs: 161 active+clean; 585 KiB data, 220 MiB used, 715 GiB / 715 GiB avail; 696 B/s rd, 0 op/s 2024-06-18T02:16:57.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:56 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:16:57.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:16:57.783 INFO:teuthology.orchestra.run.smithi007.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-18T02:16:57.783 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi007 smithi007 running 16s ago 20m - - 2024-06-18T02:16:57.783 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi130 smithi130 running 5s ago 19m - - 2024-06-18T02:16:57.784 INFO:teuthology.orchestra.run.smithi007.stdout:alertmanager.a smithi007 *:9093,9094 running (9m) 16s ago 14m 23.9M - 0.23.0 ba2b418f427c 5994e8525c64 2024-06-18T02:16:57.784 INFO:teuthology.orchestra.run.smithi007.stdout:grafana.a smithi130 *:3000 running (9m) 5s ago 14m 49.5M - 8.3.5 dad864ee21e9 70ba81d97c8e 2024-06-18T02:16:57.784 INFO:teuthology.orchestra.run.smithi007.stdout:iscsi.foo.smithi007.xvdrwd smithi007 running (7m) 16s ago 13m 64.0M - 3.5 e1d6a67b021e 94121ad2702c 2024-06-18T02:16:57.784 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.x smithi130 *:8443,9283,8765 running (8m) 5s ago 19m 533M - 19.0.0-3124-g3781e3a5 af93c036e016 01017e37bdbe 2024-06-18T02:16:57.784 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.y smithi007 *:8443,9283,8765 running (7m) 16s ago 21m 444M - 19.0.0-3124-g3781e3a5 af93c036e016 2141e131e896 2024-06-18T02:16:57.784 INFO:teuthology.orchestra.run.smithi007.stdout:mon.a smithi007 running (5m) 16s ago 21m 60.4M 2048M 19.0.0-3124-g3781e3a5 af93c036e016 7bbe646cd5b7 2024-06-18T02:16:57.784 INFO:teuthology.orchestra.run.smithi007.stdout:mon.b smithi130 running (6m) 5s ago 19m 57.0M 2048M 19.0.0-3124-g3781e3a5 af93c036e016 baacf2add994 2024-06-18T02:16:57.784 INFO:teuthology.orchestra.run.smithi007.stdout:mon.c smithi007 running (6m) 16s ago 19m 60.6M 2048M 19.0.0-3124-g3781e3a5 af93c036e016 39418356156e 2024-06-18T02:16:57.784 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.a smithi007 *:9100 running (10m) 16s ago 15m 17.3M - 1.3.1 1dbe0e931976 8128e558f099 2024-06-18T02:16:57.784 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.b smithi130 *:9100 running (9m) 5s ago 15m 19.5M - 1.3.1 1dbe0e931976 bab93b43cf16 2024-06-18T02:16:57.784 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0 smithi007 running (4m) 16s ago 19m 53.4M 4096M 19.0.0-3124-g3781e3a5 af93c036e016 07c7f4afd49a 2024-06-18T02:16:57.784 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1 smithi007 running (3m) 16s ago 18m 49.8M 4096M 19.0.0-3124-g3781e3a5 af93c036e016 e8d184614e94 2024-06-18T02:16:57.784 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2 smithi007 running (2m) 16s ago 18m 45.2M 4096M 19.0.0-3124-g3781e3a5 af93c036e016 7d9a05b4bfa5 2024-06-18T02:16:57.785 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3 smithi007 running (89s) 16s ago 17m 51.7M 4096M 19.0.0-3124-g3781e3a5 af93c036e016 7e879cda3b51 2024-06-18T02:16:57.785 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4 smithi130 running (15s) 5s ago 17m 51.4M 4096M 19.0.0-3124-g3781e3a5 af93c036e016 24f46c456c31 2024-06-18T02:16:57.785 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5 smithi130 running (17m) 5s ago 17m 65.4M 4096M 17.2.0 e1d6a67b021e f645d7f12378 2024-06-18T02:16:57.785 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6 smithi130 running (16m) 5s ago 16m 60.0M 4096M 17.2.0 e1d6a67b021e c7af86c14959 2024-06-18T02:16:57.785 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7 smithi130 running (16m) 5s ago 16m 65.4M 4096M 17.2.0 e1d6a67b021e 3688af8b2c46 2024-06-18T02:16:57.785 INFO:teuthology.orchestra.run.smithi007.stdout:prometheus.a smithi130 *:9095 running (8m) 5s ago 15m 75.9M - 2.33.4 514e6a882f6e e905fb2eb4a6 2024-06-18T02:16:57.785 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi007.dvbvbk smithi007 *:8000 running (13m) 16s ago 13m 78.5M - 17.2.0 e1d6a67b021e 1344b55b763c 2024-06-18T02:16:57.785 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi130.aakmof smithi130 *:8000 running (13m) 5s ago 13m 76.3M - 17.2.0 e1d6a67b021e e257e3230c6c 2024-06-18T02:16:57.785 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi007.hgrnmk smithi007 *:80 running (13m) 16s ago 13m 76.3M - 17.2.0 e1d6a67b021e 2173947bc4d6 2024-06-18T02:16:57.785 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi130.wwebfk smithi130 *:80 running (13m) 5s ago 13m 78.2M - 17.2.0 e1d6a67b021e 8662706b2231 2024-06-18T02:16:58.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:57 smithi007 ceph-mon[113333]: from='client.54523 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:16:58.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:57 smithi007 ceph-mon[99735]: from='client.54523 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:16:58.198 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:16:58.198 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": { 2024-06-18T02:16:58.198 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 3 2024-06-18T02:16:58.198 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:16:58.198 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": { 2024-06-18T02:16:58.198 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 2 2024-06-18T02:16:58.198 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:16:58.198 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": { 2024-06-18T02:16:58.198 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3, 2024-06-18T02:16:58.198 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 5 2024-06-18T02:16:58.198 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:16:58.198 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw": { 2024-06-18T02:16:58.199 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-06-18T02:16:58.199 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:16:58.199 INFO:teuthology.orchestra.run.smithi007.stdout: "overall": { 2024-06-18T02:16:58.199 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 7, 2024-06-18T02:16:58.199 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 10 2024-06-18T02:16:58.199 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-06-18T02:16:58.199 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:16:58.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:57 smithi130 ceph-mon[84407]: from='client.54523 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:16:58.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:16:57 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:16:57] "GET /metrics HTTP/1.1" 200 38433 "" "Prometheus/2.33.4" 2024-06-18T02:16:58.543 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:16:58.544 INFO:teuthology.orchestra.run.smithi007.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00", 2024-06-18T02:16:58.544 INFO:teuthology.orchestra.run.smithi007.stdout: "in_progress": true, 2024-06-18T02:16:58.544 INFO:teuthology.orchestra.run.smithi007.stdout: "which": "Upgrading all daemon types on all hosts", 2024-06-18T02:16:58.544 INFO:teuthology.orchestra.run.smithi007.stdout: "services_complete": [ 2024-06-18T02:16:58.544 INFO:teuthology.orchestra.run.smithi007.stdout: "mon", 2024-06-18T02:16:58.544 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr" 2024-06-18T02:16:58.544 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-06-18T02:16:58.544 INFO:teuthology.orchestra.run.smithi007.stdout: "progress": "10/23 daemons upgraded", 2024-06-18T02:16:58.544 INFO:teuthology.orchestra.run.smithi007.stdout: "message": "Currently upgrading osd daemons", 2024-06-18T02:16:58.544 INFO:teuthology.orchestra.run.smithi007.stdout: "is_paused": false 2024-06-18T02:16:58.544 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:16:58.972 INFO:teuthology.orchestra.run.smithi007.stdout:HEALTH_OK 2024-06-18T02:16:59.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:58 smithi130 ceph-mon[84407]: from='client.54529 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:16:59.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:58 smithi130 ceph-mon[84407]: pgmap v322: 161 pgs: 161 active+clean; 585 KiB data, 220 MiB used, 715 GiB / 715 GiB avail; 555 B/s rd, 0 op/s 2024-06-18T02:16:59.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:58 smithi130 ceph-mon[84407]: from='client.94494 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:16:59.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:58 smithi130 ceph-mon[84407]: from='client.? 172.21.15.7:0/57691445' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:59.181 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:58 smithi007 ceph-mon[99735]: from='client.54529 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:16:59.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:58 smithi007 ceph-mon[99735]: pgmap v322: 161 pgs: 161 active+clean; 585 KiB data, 220 MiB used, 715 GiB / 715 GiB avail; 555 B/s rd, 0 op/s 2024-06-18T02:16:59.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:58 smithi007 ceph-mon[99735]: from='client.94494 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:16:59.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:58 smithi007 ceph-mon[99735]: from='client.? 172.21.15.7:0/57691445' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:16:59.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:58 smithi007 ceph-mon[113333]: from='client.54529 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:16:59.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:58 smithi007 ceph-mon[113333]: pgmap v322: 161 pgs: 161 active+clean; 585 KiB data, 220 MiB used, 715 GiB / 715 GiB avail; 555 B/s rd, 0 op/s 2024-06-18T02:16:59.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:58 smithi007 ceph-mon[113333]: from='client.94494 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:16:59.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:58 smithi007 ceph-mon[113333]: from='client.? 172.21.15.7:0/57691445' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:00.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:59 smithi130 ceph-mon[84407]: from='client.94506 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:17:00.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:59 smithi130 ceph-mon[84407]: from='client.? 172.21.15.7:0/2708568962' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:17:00.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:16:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-06-18T02:17:00.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:59 smithi007 ceph-mon[99735]: from='client.94506 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:17:00.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:59 smithi007 ceph-mon[99735]: from='client.? 172.21.15.7:0/2708568962' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:17:00.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:16:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-06-18T02:17:00.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:59 smithi007 ceph-mon[113333]: from='client.94506 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:17:00.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:59 smithi007 ceph-mon[113333]: from='client.? 172.21.15.7:0/2708568962' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:17:00.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:16:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-06-18T02:17:01.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:00 smithi130 ceph-mon[84407]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-06-18T02:17:01.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:00 smithi130 ceph-mon[84407]: Upgrade: osd.5 is safe to restart 2024-06-18T02:17:01.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:00 smithi130 ceph-mon[84407]: pgmap v323: 161 pgs: 161 active+clean; 585 KiB data, 220 MiB used, 715 GiB / 715 GiB avail; 989 B/s rd, 0 op/s 2024-06-18T02:17:01.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:00 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:01.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-06-18T02:17:01.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:01.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:00 smithi007 ceph-mon[113333]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-06-18T02:17:01.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:00 smithi007 ceph-mon[113333]: Upgrade: osd.5 is safe to restart 2024-06-18T02:17:01.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:00 smithi007 ceph-mon[113333]: pgmap v323: 161 pgs: 161 active+clean; 585 KiB data, 220 MiB used, 715 GiB / 715 GiB avail; 989 B/s rd, 0 op/s 2024-06-18T02:17:01.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:00 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:01.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-06-18T02:17:01.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:01.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:00 smithi007 ceph-mon[99735]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-06-18T02:17:01.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:00 smithi007 ceph-mon[99735]: Upgrade: osd.5 is safe to restart 2024-06-18T02:17:01.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:00 smithi007 ceph-mon[99735]: pgmap v323: 161 pgs: 161 active+clean; 585 KiB data, 220 MiB used, 715 GiB / 715 GiB avail; 989 B/s rd, 0 op/s 2024-06-18T02:17:01.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:00 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:01.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-06-18T02:17:01.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:02.098 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:01 smithi130 ceph-mon[84407]: Upgrade: Updating osd.5 2024-06-18T02:17:02.098 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:01 smithi130 ceph-mon[84407]: Deploying daemon osd.5 on smithi130 2024-06-18T02:17:02.098 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:01 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:02.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:01 smithi007 ceph-mon[113333]: Upgrade: Updating osd.5 2024-06-18T02:17:02.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:01 smithi007 ceph-mon[113333]: Deploying daemon osd.5 on smithi130 2024-06-18T02:17:02.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:01 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:02.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:01 smithi007 ceph-mon[99735]: Upgrade: Updating osd.5 2024-06-18T02:17:02.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:01 smithi007 ceph-mon[99735]: Deploying daemon osd.5 on smithi130 2024-06-18T02:17:02.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:01 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:03.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:02 smithi130 ceph-mon[84407]: pgmap v324: 161 pgs: 161 active+clean; 585 KiB data, 220 MiB used, 715 GiB / 715 GiB avail; 912 B/s rd, 0 op/s 2024-06-18T02:17:03.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:02 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:03.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:02 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:03.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:02 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:03.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:02 smithi007 ceph-mon[113333]: pgmap v324: 161 pgs: 161 active+clean; 585 KiB data, 220 MiB used, 715 GiB / 715 GiB avail; 912 B/s rd, 0 op/s 2024-06-18T02:17:03.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:02 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:03.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:02 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:03.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:02 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:03.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:02 smithi007 ceph-mon[99735]: pgmap v324: 161 pgs: 161 active+clean; 585 KiB data, 220 MiB used, 715 GiB / 715 GiB avail; 912 B/s rd, 0 op/s 2024-06-18T02:17:03.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:02 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:03.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:02 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:03.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:02 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:04.140 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:03 smithi130 ceph-mon[84407]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:17:04.141 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:17:03 smithi130 systemd[1]: Stopping Ceph osd.5 for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:17:04.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:03 smithi007 ceph-mon[113333]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:17:04.181 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:03 smithi007 ceph-mon[99735]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:17:04.543 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:17:04 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5[33677]: 2024-06-18T02:17:04.180+0000 7ff071cd7700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-18T02:17:04.543 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:17:04 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5[33677]: 2024-06-18T02:17:04.180+0000 7ff071cd7700 -1 osd.5 170 *** Got signal Terminated *** 2024-06-18T02:17:04.543 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:17:04 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5[33677]: 2024-06-18T02:17:04.180+0000 7ff071cd7700 -1 osd.5 170 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-18T02:17:04.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:04 smithi007 ceph-mon[113333]: pgmap v325: 161 pgs: 161 active+clean; 585 KiB data, 220 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:17:04.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:04 smithi007 ceph-mon[113333]: osd.5 marked itself down and dead 2024-06-18T02:17:04.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:04 smithi007 ceph-mon[99735]: pgmap v325: 161 pgs: 161 active+clean; 585 KiB data, 220 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:17:04.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:04 smithi007 ceph-mon[99735]: osd.5 marked itself down and dead 2024-06-18T02:17:05.232 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:04 smithi130 ceph-mon[84407]: pgmap v325: 161 pgs: 161 active+clean; 585 KiB data, 220 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:17:05.232 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:04 smithi130 ceph-mon[84407]: osd.5 marked itself down and dead 2024-06-18T02:17:05.919 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:17:05 smithi130 podman[129510]: 2024-06-18 02:17:05.664040782 +0000 UTC m=+1.599002006 container died f645d7f123781caafa18e1089f9d9dda14569e7648d998a9d41dcaf520ebb268 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5, maintainer=Guillaume Abrioux , ceph=True, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, GIT_BRANCH=HEAD, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, name=centos-stream, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, vcs-type=git, distribution-scope=public, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.buildah.version=1.19.8, io.k8s.display-name=CentOS Stream 8, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vendor=Red Hat, Inc., RELEASE=HEAD, build-date=2022-05-03T08:36:31.336870, GIT_CLEAN=True, version=8, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.openshift.tags=base centos centos-stream, CEPH_POINT_RELEASE=-17.2.0, release=754, io.openshift.expose-services=, architecture=x86_64, GIT_REPO=https://github.com/ceph/ceph-container.git, com.redhat.component=centos-stream-container) 2024-06-18T02:17:06.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:05 smithi007 ceph-mon[113333]: Health check failed: 1 osds down (OSD_DOWN) 2024-06-18T02:17:06.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:05 smithi007 ceph-mon[113333]: osdmap e171: 8 total, 7 up, 8 in 2024-06-18T02:17:06.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:05 smithi007 ceph-mon[99735]: Health check failed: 1 osds down (OSD_DOWN) 2024-06-18T02:17:06.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:05 smithi007 ceph-mon[99735]: osdmap e171: 8 total, 7 up, 8 in 2024-06-18T02:17:06.241 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:05 smithi130 ceph-mon[84407]: Health check failed: 1 osds down (OSD_DOWN) 2024-06-18T02:17:06.242 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:05 smithi130 ceph-mon[84407]: osdmap e171: 8 total, 7 up, 8 in 2024-06-18T02:17:06.242 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:17:06 smithi130 podman[129510]: 2024-06-18 02:17:06.041393117 +0000 UTC m=+1.976354343 container cleanup f645d7f123781caafa18e1089f9d9dda14569e7648d998a9d41dcaf520ebb268 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.buildah.version=1.19.8, release=754, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.component=centos-stream-container, vendor=Red Hat, Inc., com.redhat.license_terms=https://centos.org/legal/licensing-policy/, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, vcs-type=git, CEPH_POINT_RELEASE=-17.2.0, io.openshift.expose-services=, distribution-scope=public, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_CLEAN=True, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, ceph=True, io.openshift.tags=base centos centos-stream, maintainer=Guillaume Abrioux , name=centos-stream, GIT_BRANCH=HEAD, RELEASE=HEAD, io.k8s.display-name=CentOS Stream 8, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, build-date=2022-05-03T08:36:31.336870, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, architecture=x86_64, version=8) 2024-06-18T02:17:06.243 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:17:06 smithi130 bash[129510]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5 2024-06-18T02:17:06.543 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:17:06 smithi130 podman[129569]: 2024-06-18 02:17:06.242803425 +0000 UTC m=+0.811592049 container remove f645d7f123781caafa18e1089f9d9dda14569e7648d998a9d41dcaf520ebb268 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5, GIT_BRANCH=HEAD, com.redhat.component=centos-stream-container, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, architecture=x86_64, version=8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, distribution-scope=public, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, maintainer=Guillaume Abrioux , RELEASE=HEAD, vendor=Red Hat, Inc., GIT_CLEAN=True, io.k8s.display-name=CentOS Stream 8, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.19.8, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, release=754, io.openshift.tags=base centos centos-stream, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, ceph=True, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vcs-type=git, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.openshift.expose-services=, build-date=2022-05-03T08:36:31.336870, name=centos-stream, CEPH_POINT_RELEASE=-17.2.0) 2024-06-18T02:17:07.005 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:06 smithi130 ceph-mon[84407]: pgmap v327: 161 pgs: 24 peering, 14 stale+active+clean, 123 active+clean; 585 KiB data, 220 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-06-18T02:17:07.005 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:06 smithi130 ceph-mon[84407]: Health check failed: Reduced data availability: 7 pgs inactive, 7 pgs peering (PG_AVAILABILITY) 2024-06-18T02:17:07.005 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:06 smithi130 ceph-mon[84407]: osdmap e172: 8 total, 7 up, 8 in 2024-06-18T02:17:07.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:06 smithi007 ceph-mon[113333]: pgmap v327: 161 pgs: 24 peering, 14 stale+active+clean, 123 active+clean; 585 KiB data, 220 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-06-18T02:17:07.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:06 smithi007 ceph-mon[113333]: Health check failed: Reduced data availability: 7 pgs inactive, 7 pgs peering (PG_AVAILABILITY) 2024-06-18T02:17:07.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:06 smithi007 ceph-mon[113333]: osdmap e172: 8 total, 7 up, 8 in 2024-06-18T02:17:07.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:06 smithi007 ceph-mon[99735]: pgmap v327: 161 pgs: 24 peering, 14 stale+active+clean, 123 active+clean; 585 KiB data, 220 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-06-18T02:17:07.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:06 smithi007 ceph-mon[99735]: Health check failed: Reduced data availability: 7 pgs inactive, 7 pgs peering (PG_AVAILABILITY) 2024-06-18T02:17:07.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:06 smithi007 ceph-mon[99735]: osdmap e172: 8 total, 7 up, 8 in 2024-06-18T02:17:07.289 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:17:07 smithi130 podman[129722]: 2024-06-18 02:17:06.910009629 +0000 UTC m=+0.018404844 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:17:07.290 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:17:07 smithi130 podman[129722]: 2024-06-18 02:17:07.057361623 +0000 UTC m=+0.165756835 container create cd59bad7c560dc02e90107fc30ce704261031d066de5fb1463c4cfe1d37bdfa9 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.36.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-3781e3a, org.label-schema.license=GPLv2, org.label-schema.build-date=20240612, CEPH_POINT_RELEASE=, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47) 2024-06-18T02:17:07.543 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:17:07 smithi130 podman[129722]: 2024-06-18 02:17:07.29068776 +0000 UTC m=+0.399082972 container init cd59bad7c560dc02e90107fc30ce704261031d066de5fb1463c4cfe1d37bdfa9 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240612, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-3781e3a, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-06-18T02:17:07.544 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:17:07 smithi130 podman[129722]: 2024-06-18 02:17:07.294248396 +0000 UTC m=+0.402643610 container start cd59bad7c560dc02e90107fc30ce704261031d066de5fb1463c4cfe1d37bdfa9 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, RELEASE=squid-3781e3a, ceph=True, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240612, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-06-18T02:17:07.544 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:17:07 smithi130 podman[129722]: 2024-06-18 02:17:07.357573588 +0000 UTC m=+0.465968811 container attach cd59bad7c560dc02e90107fc30ce704261031d066de5fb1463c4cfe1d37bdfa9 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, RELEASE=squid-3781e3a, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.build-date=20240612, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-06-18T02:17:07.972 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:17:07 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:17:07] "GET /metrics HTTP/1.1" 200 38433 "" "Prometheus/2.33.4" 2024-06-18T02:17:07.973 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:17:07 smithi130 podman[129722]: 2024-06-18 02:17:07.588337568 +0000 UTC m=+0.696732780 container died cd59bad7c560dc02e90107fc30ce704261031d066de5fb1463c4cfe1d37bdfa9 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-3781e3a, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.36.0, org.label-schema.build-date=20240612, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-06-18T02:17:08.227 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:07 smithi130 ceph-mon[84407]: Health check failed: Degraded data redundancy: 36/726 objects degraded (4.959%), 11 pgs degraded (PG_DEGRADED) 2024-06-18T02:17:08.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:07 smithi007 ceph-mon[113333]: Health check failed: Degraded data redundancy: 36/726 objects degraded (4.959%), 11 pgs degraded (PG_DEGRADED) 2024-06-18T02:17:08.431 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:07 smithi007 ceph-mon[99735]: Health check failed: Degraded data redundancy: 36/726 objects degraded (4.959%), 11 pgs degraded (PG_DEGRADED) 2024-06-18T02:17:08.545 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:17:08 smithi130 podman[129819]: 2024-06-18 02:17:08.228484012 +0000 UTC m=+0.632843659 container remove cd59bad7c560dc02e90107fc30ce704261031d066de5fb1463c4cfe1d37bdfa9 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5-deactivate, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240612, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, RELEASE=squid-3781e3a) 2024-06-18T02:17:08.546 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:17:08 smithi130 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.5.service: Deactivated successfully. 2024-06-18T02:17:08.546 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:17:08 smithi130 systemd[1]: Stopped Ceph osd.5 for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:17:08.546 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:17:08 smithi130 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.5.service: Consumed 12.150s CPU time. 2024-06-18T02:17:08.546 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:17:08 smithi130 systemd[1]: Starting Ceph osd.5 for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:17:09.225 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:08 smithi130 ceph-mon[84407]: pgmap v329: 161 pgs: 14 active+undersized, 24 peering, 4 stale+active+clean, 11 active+undersized+degraded, 108 active+clean; 585 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 36/726 objects degraded (4.959%) 2024-06-18T02:17:09.226 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:17:09 smithi130 podman[130027]: 2024-06-18 02:17:09.216716005 +0000 UTC m=+0.106683947 container create 716e3aae3639daf67215402294e6ca30d2eaa664d6f596ba44167407bb8598aa (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5-activate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240612, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, RELEASE=squid-3781e3a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True) 2024-06-18T02:17:09.226 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:17:09 smithi130 podman[130027]: 2024-06-18 02:17:09.130340891 +0000 UTC m=+0.020308766 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:17:09.390 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:08 smithi007 ceph-mon[113333]: pgmap v329: 161 pgs: 14 active+undersized, 24 peering, 4 stale+active+clean, 11 active+undersized+degraded, 108 active+clean; 585 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 36/726 objects degraded (4.959%) 2024-06-18T02:17:09.390 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:08 smithi007 ceph-mon[99735]: pgmap v329: 161 pgs: 14 active+undersized, 24 peering, 4 stale+active+clean, 11 active+undersized+degraded, 108 active+clean; 585 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 36/726 objects degraded (4.959%) 2024-06-18T02:17:09.543 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:17:09 smithi130 podman[130027]: 2024-06-18 02:17:09.469599516 +0000 UTC m=+0.359567383 container init 716e3aae3639daf67215402294e6ca30d2eaa664d6f596ba44167407bb8598aa (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5-activate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.build-date=20240612, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-3781e3a) 2024-06-18T02:17:09.543 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:17:09 smithi130 podman[130027]: 2024-06-18 02:17:09.472903777 +0000 UTC m=+0.362871645 container start 716e3aae3639daf67215402294e6ca30d2eaa664d6f596ba44167407bb8598aa (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5-activate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240612, io.buildah.version=1.36.0, ceph=True, GIT_CLEAN=True, RELEASE=squid-3781e3a, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-06-18T02:17:09.850 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:17:09 smithi130 podman[130027]: 2024-06-18 02:17:09.577843337 +0000 UTC m=+0.467811213 container attach 716e3aae3639daf67215402294e6ca30d2eaa664d6f596ba44167407bb8598aa (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5-activate, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, ceph=True, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-3781e3a, org.label-schema.build-date=20240612, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-06-18T02:17:10.180 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:17:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5-activate[130048]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-06-18T02:17:10.180 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:17:09 smithi130 bash[130027]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-06-18T02:17:10.180 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:17:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5-activate[130048]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-06-18T02:17:10.180 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:17:09 smithi130 bash[130027]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-06-18T02:17:10.180 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:17:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5-activate[130048]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-06-18T02:17:10.180 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:17:09 smithi130 bash[130027]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-06-18T02:17:10.180 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:17:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5-activate[130048]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-06-18T02:17:10.181 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:17:09 smithi130 bash[130027]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-06-18T02:17:10.181 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:17:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5-activate[130048]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-5/block 2024-06-18T02:17:10.181 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:17:09 smithi130 bash[130027]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-5/block 2024-06-18T02:17:10.181 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:17:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5-activate[130048]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-06-18T02:17:10.181 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:17:09 smithi130 bash[130027]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-06-18T02:17:10.181 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:17:09 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5-activate[130048]: --> ceph-volume raw activate successful for osd ID: 5 2024-06-18T02:17:10.181 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:17:09 smithi130 bash[130027]: --> ceph-volume raw activate successful for osd ID: 5 2024-06-18T02:17:10.793 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:17:10 smithi130 podman[130027]: 2024-06-18 02:17:10.534007295 +0000 UTC m=+1.423975173 container died 716e3aae3639daf67215402294e6ca30d2eaa664d6f596ba44167407bb8598aa (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5-activate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-3781e3a, org.label-schema.build-date=20240612, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-06-18T02:17:11.209 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:10 smithi130 ceph-mon[84407]: pgmap v330: 161 pgs: 18 active+undersized, 24 peering, 16 active+undersized+degraded, 103 active+clean; 585 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 57/726 objects degraded (7.851%) 2024-06-18T02:17:11.431 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:10 smithi007 ceph-mon[99735]: pgmap v330: 161 pgs: 18 active+undersized, 24 peering, 16 active+undersized+degraded, 103 active+clean; 585 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 57/726 objects degraded (7.851%) 2024-06-18T02:17:11.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:10 smithi007 ceph-mon[113333]: pgmap v330: 161 pgs: 18 active+undersized, 24 peering, 16 active+undersized+degraded, 103 active+clean; 585 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 57/726 objects degraded (7.851%) 2024-06-18T02:17:11.469 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:17:11 smithi130 podman[130222]: 2024-06-18 02:17:11.211071761 +0000 UTC m=+1.295517585 container remove 716e3aae3639daf67215402294e6ca30d2eaa664d6f596ba44167407bb8598aa (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5-activate, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-3781e3a, org.label-schema.build-date=20240612, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-18T02:17:11.470 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:17:11 smithi130 podman[130350]: 2024-06-18 02:17:11.341048927 +0000 UTC m=+0.022296121 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:17:11.470 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:17:11 smithi130 podman[130350]: 2024-06-18 02:17:11.470900205 +0000 UTC m=+0.152147390 container create 210471d14700a1bd8a42c7c7102c0b3330fe54b3a3553d265d54914a221b767b (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5, maintainer=Guillaume Abrioux , RELEASE=squid-3781e3a, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240612) 2024-06-18T02:17:12.519 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:12 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:12.519 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:17:12.519 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:12 smithi130 ceph-mon[84407]: pgmap v331: 161 pgs: 37 active+undersized, 21 active+undersized+degraded, 103 active+clean; 585 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 80/726 objects degraded (11.019%) 2024-06-18T02:17:12.519 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:12 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:12.519 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:12 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:12.519 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:12 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:12.519 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:17:12 smithi130 podman[130350]: 2024-06-18 02:17:12.335670973 +0000 UTC m=+1.016918169 container init 210471d14700a1bd8a42c7c7102c0b3330fe54b3a3553d265d54914a221b767b (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240612, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, RELEASE=squid-3781e3a, org.label-schema.name=CentOS Stream 9 Base Image) 2024-06-18T02:17:12.519 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:17:12 smithi130 podman[130350]: 2024-06-18 02:17:12.339283113 +0000 UTC m=+1.020530301 container start 210471d14700a1bd8a42c7c7102c0b3330fe54b3a3553d265d54914a221b767b (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240612, GIT_CLEAN=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-3781e3a, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-06-18T02:17:12.519 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:17:12 smithi130 ceph-osd[130481]: -- 172.21.15.130:0/950921875 <== mon.2 v2:172.21.15.130:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fd5f4d5a40 con 0x55fd5f4b3c00 2024-06-18T02:17:12.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:12 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:12.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:17:12.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:12 smithi007 ceph-mon[113333]: pgmap v331: 161 pgs: 37 active+undersized, 21 active+undersized+degraded, 103 active+clean; 585 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 80/726 objects degraded (11.019%) 2024-06-18T02:17:12.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:12 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:12.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:12 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:12.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:12 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:12.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:12 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:12.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:17:12.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:12 smithi007 ceph-mon[99735]: pgmap v331: 161 pgs: 37 active+undersized, 21 active+undersized+degraded, 103 active+clean; 585 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 80/726 objects degraded (11.019%) 2024-06-18T02:17:12.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:12 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:12.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:12 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:12.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:12 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:12.793 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:17:12 smithi130 bash[130350]: 210471d14700a1bd8a42c7c7102c0b3330fe54b3a3553d265d54914a221b767b 2024-06-18T02:17:12.794 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:17:12 smithi130 systemd[1]: Started Ceph osd.5 for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:17:13.148 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:17:12 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5[130377]: 2024-06-18T02:17:12.875+0000 7f62e0314640 -1 Falling back to public interface 2024-06-18T02:17:13.492 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:13 smithi130 ceph-mon[84407]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 7 pgs inactive, 7 pgs peering) 2024-06-18T02:17:13.492 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:13 smithi130 ceph-mon[84407]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:17:13.492 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:13 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:13.492 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:13 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:13.492 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:13 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:13.492 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:13 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:13.492 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:13.493 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:13.493 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:13 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:13.493 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:13 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:13.493 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:13.493 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:13.493 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:13.493 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:13 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:13.493 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:13 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:13.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:13 smithi007 ceph-mon[113333]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 7 pgs inactive, 7 pgs peering) 2024-06-18T02:17:13.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:13 smithi007 ceph-mon[113333]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:17:13.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:13 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:13.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:13 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:13.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:13 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:13.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:13 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:13.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:13.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:13.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:13 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:13.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:13 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:13.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:13.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:13.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:13.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:13 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:13.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:13 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:13.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:13 smithi007 ceph-mon[99735]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 7 pgs inactive, 7 pgs peering) 2024-06-18T02:17:13.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:13 smithi007 ceph-mon[99735]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:17:13.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:13 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:13.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:13 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:13.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:13 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:13.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:13 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:13.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:13.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:13.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:13 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:13.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:13 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:13.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:13.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:13.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:13.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:13 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:13.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:13 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:14.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:14 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:14.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:14.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:14.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:14.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:14.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:14 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:14.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:14 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:14.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:14.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:14.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:14.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:14.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:14 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:14.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:14 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:14.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:14.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:14.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:14.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:14.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:14 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:14.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:14 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:14.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:14 smithi130 ceph-mon[84407]: pgmap v332: 161 pgs: 37 active+undersized, 21 active+undersized+degraded, 103 active+clean; 585 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 80/726 objects degraded (11.019%) 2024-06-18T02:17:14.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:14.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:14.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:14.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:14.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:14 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:14.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:14 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:14.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:14.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:14.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:14.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:14.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:14 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:14.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:14 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:14.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:14.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:14.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:14.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:14.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:14 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:14.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:14 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:14.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:14.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:14.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:14.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:14.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:14 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:14.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:14 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:14.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:14.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:14.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:14.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:14.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:14 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:14.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:14.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:14.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:14.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:14.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:14.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:14.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:14.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:14.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:14.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:14.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:14.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:14.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:14.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:14.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:14.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:14.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:14.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:14.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:14.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[113333]: pgmap v332: 161 pgs: 37 active+undersized, 21 active+undersized+degraded, 103 active+clean; 585 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 80/726 objects degraded (11.019%) 2024-06-18T02:17:14.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:14.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:14.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:14.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:14.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:14.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:14.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:14.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:14.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:14.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:14.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:14.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:14.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:14.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:14.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:14.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:14.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:14.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:14.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:14.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:14.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:14.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:14.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:14.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:14.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:14.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:14.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:14.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:14.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[99735]: pgmap v332: 161 pgs: 37 active+undersized, 21 active+undersized+degraded, 103 active+clean; 585 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 80/726 objects degraded (11.019%) 2024-06-18T02:17:14.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:14.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:14.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:14.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:14.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:14.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:14.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:14.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:14.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:14.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:14.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:14.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:14.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:14.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:14.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:14.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:14.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:14.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:14.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:14.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:14.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:14.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:14.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:14.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:14.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:14.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:14.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:14.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:14.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:14.691 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:14.691 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:14.691 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:14.691 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:14.691 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:14.691 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:14.691 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:14.691 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:14.691 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:14.691 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:14.691 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:14.691 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:14.692 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:14.692 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:14.692 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:14.692 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:14.692 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:14.692 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:14.692 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:14.692 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:14 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:15.125 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:17:14 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:17:14.872+0000 7f680f9b8640 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (20 PGs are or would become offline) 2024-06-18T02:17:15.420 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:15 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:15.420 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:15.420 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:15.420 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:15.420 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:15.420 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:15 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:15.420 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:15 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:15.421 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:15.421 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:15.421 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:15.421 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:15.421 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:15 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:15.421 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:15 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:15.421 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:15.421 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:15.421 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:15.421 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:15.421 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:15 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:15.421 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:15 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:15.421 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:15 smithi130 ceph-mon[84407]: Health check update: Degraded data redundancy: 80/726 objects degraded (11.019%), 21 pgs degraded (PG_DEGRADED) 2024-06-18T02:17:15.421 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:15.422 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:15.422 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:15.422 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:15.422 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:15 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:15.422 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:15 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:15.422 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:15.422 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:15.422 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:15.422 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:15.422 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:15 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:15.422 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:15 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:15.422 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:15 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:15.422 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:15 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:15.423 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:15 smithi130 ceph-mon[84407]: pgmap v333: 161 pgs: 37 active+undersized, 21 active+undersized+degraded, 103 active+clean; 585 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 80/726 objects degraded (11.019%) 2024-06-18T02:17:15.423 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:15 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:15.423 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:15.423 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:15.423 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:15.423 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:15.423 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:15 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-06-18T02:17:15.423 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:15 smithi130 ceph-mon[84407]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-06-18T02:17:15.423 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:15 smithi130 ceph-mon[84407]: Upgrade: unsafe to stop osd(s) at this time (20 PGs are or would become offline) 2024-06-18T02:17:15.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:15.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:15.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:15.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:15.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:15.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:15.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:15.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:15.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:15.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:15.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:15.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:15.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:15.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:15.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:15.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:15.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:15.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:15.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:15.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[113333]: Health check update: Degraded data redundancy: 80/726 objects degraded (11.019%), 21 pgs degraded (PG_DEGRADED) 2024-06-18T02:17:15.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:15.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:15.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:15.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:15.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:15.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:15.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:15.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:15.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:15.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:15.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:15.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:15.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:15.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:15.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:15.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:15.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:15.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:15.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:15.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:15.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:15.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:15.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:15.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:15.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:15.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:15.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:15.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:15.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[99735]: Health check update: Degraded data redundancy: 80/726 objects degraded (11.019%), 21 pgs degraded (PG_DEGRADED) 2024-06-18T02:17:15.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:15.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:15.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:15.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:15.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:15.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:15.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:15.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:15.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:15.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:15.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:15.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:15.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:15.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:15.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[113333]: pgmap v333: 161 pgs: 37 active+undersized, 21 active+undersized+degraded, 103 active+clean; 585 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 80/726 objects degraded (11.019%) 2024-06-18T02:17:15.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:15.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:15.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:15.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:15.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:15.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-06-18T02:17:15.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[113333]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-06-18T02:17:15.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[113333]: Upgrade: unsafe to stop osd(s) at this time (20 PGs are or would become offline) 2024-06-18T02:17:15.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:15.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:15.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:15.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:15.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:15.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[99735]: pgmap v333: 161 pgs: 37 active+undersized, 21 active+undersized+degraded, 103 active+clean; 585 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 80/726 objects degraded (11.019%) 2024-06-18T02:17:15.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:15.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:15.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:15.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:15.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:15.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-06-18T02:17:15.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[99735]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-06-18T02:17:15.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:15 smithi007 ceph-mon[99735]: Upgrade: unsafe to stop osd(s) at this time (20 PGs are or would become offline) 2024-06-18T02:17:15.794 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:17:15 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5[130377]: 2024-06-18T02:17:15.620+0000 7f62e0314640 -1 osd.5 0 read_superblock omap replica is missing. 2024-06-18T02:17:15.794 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:17:15 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5[130377]: 2024-06-18T02:17:15.648+0000 7f62e0314640 -1 osd.5 170 log_to_monitors true 2024-06-18T02:17:16.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:16 smithi130 ceph-mon[84407]: from='osd.5 [v2:172.21.15.130:6808/1019763000,v1:172.21.15.130:6809/1019763000]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-18T02:17:16.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:16 smithi130 ceph-mon[84407]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-18T02:17:16.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:16 smithi130 ceph-mon[84407]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-06-18T02:17:16.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:16 smithi007 ceph-mon[113333]: from='osd.5 [v2:172.21.15.130:6808/1019763000,v1:172.21.15.130:6809/1019763000]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-18T02:17:16.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:16 smithi007 ceph-mon[113333]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-18T02:17:16.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:16 smithi007 ceph-mon[113333]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-06-18T02:17:16.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:16 smithi007 ceph-mon[99735]: from='osd.5 [v2:172.21.15.130:6808/1019763000,v1:172.21.15.130:6809/1019763000]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-18T02:17:16.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:16 smithi007 ceph-mon[99735]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-18T02:17:16.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:16 smithi007 ceph-mon[99735]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-06-18T02:17:17.043 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:17:16 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5[130377]: 2024-06-18T02:17:16.702+0000 7f62d40b7640 -1 osd.5 170 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-18T02:17:17.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:17 smithi130 ceph-mon[84407]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-06-18T02:17:17.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:17 smithi130 ceph-mon[84407]: osdmap e173: 8 total, 7 up, 8 in 2024-06-18T02:17:17.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:17 smithi130 ceph-mon[84407]: from='osd.5 [v2:172.21.15.130:6808/1019763000,v1:172.21.15.130:6809/1019763000]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:17:17.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:17 smithi130 ceph-mon[84407]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:17:17.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:17 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:17.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:17 smithi130 ceph-mon[84407]: from='osd.5 ' entity='osd.5' 2024-06-18T02:17:17.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:17 smithi130 ceph-mon[84407]: pgmap v335: 161 pgs: 37 active+undersized, 21 active+undersized+degraded, 103 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 80/726 objects degraded (11.019%) 2024-06-18T02:17:17.583 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:17 smithi007 ceph-mon[99735]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-06-18T02:17:17.583 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:17 smithi007 ceph-mon[99735]: osdmap e173: 8 total, 7 up, 8 in 2024-06-18T02:17:17.584 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:17 smithi007 ceph-mon[99735]: from='osd.5 [v2:172.21.15.130:6808/1019763000,v1:172.21.15.130:6809/1019763000]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:17:17.584 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:17 smithi007 ceph-mon[99735]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:17:17.584 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:17 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:17.584 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:17 smithi007 ceph-mon[99735]: from='osd.5 ' entity='osd.5' 2024-06-18T02:17:17.584 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:17 smithi007 ceph-mon[99735]: pgmap v335: 161 pgs: 37 active+undersized, 21 active+undersized+degraded, 103 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 80/726 objects degraded (11.019%) 2024-06-18T02:17:17.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:17 smithi007 ceph-mon[113333]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-06-18T02:17:17.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:17 smithi007 ceph-mon[113333]: osdmap e173: 8 total, 7 up, 8 in 2024-06-18T02:17:17.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:17 smithi007 ceph-mon[113333]: from='osd.5 [v2:172.21.15.130:6808/1019763000,v1:172.21.15.130:6809/1019763000]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:17:17.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:17 smithi007 ceph-mon[113333]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:17:17.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:17 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:17.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:17 smithi007 ceph-mon[113333]: from='osd.5 ' entity='osd.5' 2024-06-18T02:17:17.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:17 smithi007 ceph-mon[113333]: pgmap v335: 161 pgs: 37 active+undersized, 21 active+undersized+degraded, 103 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 80/726 objects degraded (11.019%) 2024-06-18T02:17:18.043 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:17:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:17:17] "GET /metrics HTTP/1.1" 200 38500 "" "Prometheus/2.33.4" 2024-06-18T02:17:18.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:18 smithi130 ceph-mon[84407]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-06-18T02:17:18.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:18 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-18T02:17:18.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:18 smithi130 ceph-mon[84407]: osd.5 [v2:172.21.15.130:6808/1019763000,v1:172.21.15.130:6809/1019763000] boot 2024-06-18T02:17:18.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:18 smithi130 ceph-mon[84407]: osdmap e174: 8 total, 8 up, 8 in 2024-06-18T02:17:18.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:18 smithi007 ceph-mon[113333]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-06-18T02:17:18.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:18 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-18T02:17:18.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:18 smithi007 ceph-mon[113333]: osd.5 [v2:172.21.15.130:6808/1019763000,v1:172.21.15.130:6809/1019763000] boot 2024-06-18T02:17:18.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:18 smithi007 ceph-mon[113333]: osdmap e174: 8 total, 8 up, 8 in 2024-06-18T02:17:18.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:18 smithi007 ceph-mon[99735]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-06-18T02:17:18.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:18 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-18T02:17:18.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:18 smithi007 ceph-mon[99735]: osd.5 [v2:172.21.15.130:6808/1019763000,v1:172.21.15.130:6809/1019763000] boot 2024-06-18T02:17:18.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:18 smithi007 ceph-mon[99735]: osdmap e174: 8 total, 8 up, 8 in 2024-06-18T02:17:19.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:19 smithi007 ceph-mon[113333]: osdmap e175: 8 total, 8 up, 8 in 2024-06-18T02:17:19.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:19 smithi007 ceph-mon[113333]: pgmap v338: 161 pgs: 5 peering, 34 active+undersized, 19 active+undersized+degraded, 103 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 775 B/s rd, 0 op/s; 73/726 objects degraded (10.055%) 2024-06-18T02:17:19.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:19 smithi007 ceph-mon[99735]: osdmap e175: 8 total, 8 up, 8 in 2024-06-18T02:17:19.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:19 smithi007 ceph-mon[99735]: pgmap v338: 161 pgs: 5 peering, 34 active+undersized, 19 active+undersized+degraded, 103 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 775 B/s rd, 0 op/s; 73/726 objects degraded (10.055%) 2024-06-18T02:17:20.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:19 smithi130 ceph-mon[84407]: osdmap e175: 8 total, 8 up, 8 in 2024-06-18T02:17:20.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:19 smithi130 ceph-mon[84407]: pgmap v338: 161 pgs: 5 peering, 34 active+undersized, 19 active+undersized+degraded, 103 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 775 B/s rd, 0 op/s; 73/726 objects degraded (10.055%) 2024-06-18T02:17:20.988 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:20 smithi130 ceph-mon[84407]: Health check update: Degraded data redundancy: 73/726 objects degraded (10.055%), 19 pgs degraded (PG_DEGRADED) 2024-06-18T02:17:21.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:20 smithi007 ceph-mon[113333]: Health check update: Degraded data redundancy: 73/726 objects degraded (10.055%), 19 pgs degraded (PG_DEGRADED) 2024-06-18T02:17:21.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:20 smithi007 ceph-mon[99735]: Health check update: Degraded data redundancy: 73/726 objects degraded (10.055%), 19 pgs degraded (PG_DEGRADED) 2024-06-18T02:17:21.772 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:21 smithi130 ceph-mon[84407]: pgmap v339: 161 pgs: 5 peering, 22 active+undersized, 14 active+undersized+degraded, 120 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s; 50/726 objects degraded (6.887%) 2024-06-18T02:17:21.772 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:21 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:21.772 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:21 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:21.772 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:21 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:22.061 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:21 smithi007 ceph-mon[113333]: pgmap v339: 161 pgs: 5 peering, 22 active+undersized, 14 active+undersized+degraded, 120 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s; 50/726 objects degraded (6.887%) 2024-06-18T02:17:22.062 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:21 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:22.062 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:21 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:22.062 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:21 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:22.062 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:21 smithi007 ceph-mon[99735]: pgmap v339: 161 pgs: 5 peering, 22 active+undersized, 14 active+undersized+degraded, 120 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s; 50/726 objects degraded (6.887%) 2024-06-18T02:17:22.062 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:21 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:22.062 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:21 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:22.062 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:21 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:23.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:22 smithi130 ceph-mon[84407]: pgmap v340: 161 pgs: 5 peering, 10 active+undersized, 5 active+undersized+degraded, 141 active+clean; 585 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 3 op/s; 13/726 objects degraded (1.791%) 2024-06-18T02:17:23.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:22 smithi130 ceph-mon[84407]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-06-18T02:17:23.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:22 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:23.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:22 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:23.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:22 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:23.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:22 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:23.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:22 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:23.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:22 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:23.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:22 smithi007 ceph-mon[113333]: pgmap v340: 161 pgs: 5 peering, 10 active+undersized, 5 active+undersized+degraded, 141 active+clean; 585 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 3 op/s; 13/726 objects degraded (1.791%) 2024-06-18T02:17:23.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:22 smithi007 ceph-mon[113333]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-06-18T02:17:23.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:22 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:23.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:22 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:23.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:22 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:23.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:22 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:23.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:22 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:23.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:22 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:23.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:22 smithi007 ceph-mon[99735]: pgmap v340: 161 pgs: 5 peering, 10 active+undersized, 5 active+undersized+degraded, 141 active+clean; 585 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 3 op/s; 13/726 objects degraded (1.791%) 2024-06-18T02:17:23.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:22 smithi007 ceph-mon[99735]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-06-18T02:17:23.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:22 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:23.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:22 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:23.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:22 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:23.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:22 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:23.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:22 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:23.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:22 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:24.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:23 smithi130 ceph-mon[84407]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:17:24.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:23 smithi007 ceph-mon[113333]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:17:24.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:23 smithi007 ceph-mon[99735]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:17:24.995 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:24 smithi007 ceph-mon[113333]: pgmap v341: 161 pgs: 161 active+clean; 585 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 3 op/s 2024-06-18T02:17:24.996 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:24 smithi007 ceph-mon[113333]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 13/726 objects degraded (1.791%), 5 pgs degraded) 2024-06-18T02:17:24.996 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:24 smithi007 ceph-mon[113333]: Cluster is now healthy 2024-06-18T02:17:24.996 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:24 smithi007 ceph-mon[99735]: pgmap v341: 161 pgs: 161 active+clean; 585 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 3 op/s 2024-06-18T02:17:24.996 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:24 smithi007 ceph-mon[99735]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 13/726 objects degraded (1.791%), 5 pgs degraded) 2024-06-18T02:17:24.996 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:24 smithi007 ceph-mon[99735]: Cluster is now healthy 2024-06-18T02:17:25.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:24 smithi130 ceph-mon[84407]: pgmap v341: 161 pgs: 161 active+clean; 585 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 3 op/s 2024-06-18T02:17:25.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:24 smithi130 ceph-mon[84407]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 13/726 objects degraded (1.791%), 5 pgs degraded) 2024-06-18T02:17:25.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:24 smithi130 ceph-mon[84407]: Cluster is now healthy 2024-06-18T02:17:27.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:26 smithi130 ceph-mon[84407]: pgmap v342: 161 pgs: 161 active+clean; 585 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.1 KiB/s rd, 3 op/s 2024-06-18T02:17:27.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:27.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:17:27.163 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:26 smithi007 ceph-mon[113333]: pgmap v342: 161 pgs: 161 active+clean; 585 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.1 KiB/s rd, 3 op/s 2024-06-18T02:17:27.163 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:26 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:27.163 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:17:27.163 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:26 smithi007 ceph-mon[99735]: pgmap v342: 161 pgs: 161 active+clean; 585 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 3.1 KiB/s rd, 3 op/s 2024-06-18T02:17:27.163 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:27.163 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:17:28.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:17:27 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:17:27] "GET /metrics HTTP/1.1" 200 38506 "" "Prometheus/2.33.4" 2024-06-18T02:17:29.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:28 smithi130 ceph-mon[84407]: pgmap v343: 161 pgs: 161 active+clean; 585 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-06-18T02:17:29.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:28 smithi007 ceph-mon[113333]: pgmap v343: 161 pgs: 161 active+clean; 585 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-06-18T02:17:29.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:28 smithi007 ceph-mon[99735]: pgmap v343: 161 pgs: 161 active+clean; 585 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-06-18T02:17:29.356 INFO:teuthology.orchestra.run.smithi007.stdout:true 2024-06-18T02:17:30.043 INFO:teuthology.orchestra.run.smithi007.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-18T02:17:30.043 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi007 smithi007 running 7s ago 20m - - 2024-06-18T02:17:30.043 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi130 smithi130 running 8s ago 20m - - 2024-06-18T02:17:30.043 INFO:teuthology.orchestra.run.smithi007.stdout:alertmanager.a smithi007 *:9093,9094 running (10m) 7s ago 15m 24.0M - 0.23.0 ba2b418f427c 5994e8525c64 2024-06-18T02:17:30.043 INFO:teuthology.orchestra.run.smithi007.stdout:grafana.a smithi130 *:3000 running (10m) 8s ago 15m 49.6M - 8.3.5 dad864ee21e9 70ba81d97c8e 2024-06-18T02:17:30.043 INFO:teuthology.orchestra.run.smithi007.stdout:iscsi.foo.smithi007.xvdrwd smithi007 running (8m) 7s ago 13m 64.0M - 3.5 e1d6a67b021e 94121ad2702c 2024-06-18T02:17:30.043 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.x smithi130 *:8443,9283,8765 running (9m) 8s ago 19m 534M - 19.0.0-3124-g3781e3a5 af93c036e016 01017e37bdbe 2024-06-18T02:17:30.043 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.y smithi007 *:8443,9283,8765 running (7m) 7s ago 21m 444M - 19.0.0-3124-g3781e3a5 af93c036e016 2141e131e896 2024-06-18T02:17:30.043 INFO:teuthology.orchestra.run.smithi007.stdout:mon.a smithi007 running (5m) 7s ago 21m 64.0M 2048M 19.0.0-3124-g3781e3a5 af93c036e016 7bbe646cd5b7 2024-06-18T02:17:30.043 INFO:teuthology.orchestra.run.smithi007.stdout:mon.b smithi130 running (6m) 8s ago 20m 58.0M 2048M 19.0.0-3124-g3781e3a5 af93c036e016 baacf2add994 2024-06-18T02:17:30.043 INFO:teuthology.orchestra.run.smithi007.stdout:mon.c smithi007 running (7m) 7s ago 20m 59.7M 2048M 19.0.0-3124-g3781e3a5 af93c036e016 39418356156e 2024-06-18T02:17:30.043 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.a smithi007 *:9100 running (10m) 7s ago 15m 17.6M - 1.3.1 1dbe0e931976 8128e558f099 2024-06-18T02:17:30.044 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.b smithi130 *:9100 running (10m) 8s ago 15m 17.2M - 1.3.1 1dbe0e931976 bab93b43cf16 2024-06-18T02:17:30.044 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0 smithi007 running (4m) 7s ago 19m 54.8M 4096M 19.0.0-3124-g3781e3a5 af93c036e016 07c7f4afd49a 2024-06-18T02:17:30.044 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1 smithi007 running (3m) 7s ago 19m 52.5M 4096M 19.0.0-3124-g3781e3a5 af93c036e016 e8d184614e94 2024-06-18T02:17:30.044 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2 smithi007 running (3m) 7s ago 18m 46.2M 4096M 19.0.0-3124-g3781e3a5 af93c036e016 7d9a05b4bfa5 2024-06-18T02:17:30.044 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3 smithi007 running (2m) 7s ago 18m 54.0M 4096M 19.0.0-3124-g3781e3a5 af93c036e016 7e879cda3b51 2024-06-18T02:17:30.044 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4 smithi130 running (47s) 8s ago 17m 52.2M 4096M 19.0.0-3124-g3781e3a5 af93c036e016 24f46c456c31 2024-06-18T02:17:30.044 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5 smithi130 running (18s) 8s ago 17m 52.5M 4096M 19.0.0-3124-g3781e3a5 af93c036e016 210471d14700 2024-06-18T02:17:30.044 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6 smithi130 running (17m) 8s ago 17m 61.0M 4096M 17.2.0 e1d6a67b021e c7af86c14959 2024-06-18T02:17:30.044 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7 smithi130 running (16m) 8s ago 16m 65.0M 4096M 17.2.0 e1d6a67b021e 3688af8b2c46 2024-06-18T02:17:30.044 INFO:teuthology.orchestra.run.smithi007.stdout:prometheus.a smithi130 *:9095 running (9m) 8s ago 16m 75.9M - 2.33.4 514e6a882f6e e905fb2eb4a6 2024-06-18T02:17:30.044 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi007.dvbvbk smithi007 *:8000 running (14m) 7s ago 14m 78.7M - 17.2.0 e1d6a67b021e 1344b55b763c 2024-06-18T02:17:30.044 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi130.aakmof smithi130 *:8000 running (14m) 8s ago 14m 76.4M - 17.2.0 e1d6a67b021e e257e3230c6c 2024-06-18T02:17:30.044 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi007.hgrnmk smithi007 *:80 running (14m) 7s ago 14m 76.5M - 17.2.0 e1d6a67b021e 2173947bc4d6 2024-06-18T02:17:30.044 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi130.wwebfk smithi130 *:80 running (14m) 8s ago 14m 78.4M - 17.2.0 e1d6a67b021e 8662706b2231 2024-06-18T02:17:30.457 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:17:30.457 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": { 2024-06-18T02:17:30.457 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 3 2024-06-18T02:17:30.457 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:17:30.457 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": { 2024-06-18T02:17:30.457 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 2 2024-06-18T02:17:30.457 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:17:30.457 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": { 2024-06-18T02:17:30.458 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2, 2024-06-18T02:17:30.458 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 6 2024-06-18T02:17:30.458 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:17:30.458 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw": { 2024-06-18T02:17:30.458 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-06-18T02:17:30.458 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:17:30.458 INFO:teuthology.orchestra.run.smithi007.stdout: "overall": { 2024-06-18T02:17:30.458 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 6, 2024-06-18T02:17:30.458 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 11 2024-06-18T02:17:30.458 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-06-18T02:17:30.458 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:17:30.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:30 smithi130 ceph-mon[84407]: from='client.54562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:17:30.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:30 smithi130 ceph-mon[84407]: pgmap v344: 161 pgs: 161 active+clean; 585 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-06-18T02:17:30.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:30 smithi130 ceph-mon[84407]: from='client.54568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:17:30.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-06-18T02:17:30.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:30 smithi130 ceph-mon[84407]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-06-18T02:17:30.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:30 smithi130 ceph-mon[84407]: Upgrade: osd.6 is safe to restart 2024-06-18T02:17:30.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:30 smithi130 ceph-mon[84407]: from='client.54574 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:17:30.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:30 smithi130 ceph-mon[84407]: from='client.? 172.21.15.7:0/1709502923' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:30.806 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:17:30.806 INFO:teuthology.orchestra.run.smithi007.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00", 2024-06-18T02:17:30.806 INFO:teuthology.orchestra.run.smithi007.stdout: "in_progress": true, 2024-06-18T02:17:30.807 INFO:teuthology.orchestra.run.smithi007.stdout: "which": "Upgrading all daemon types on all hosts", 2024-06-18T02:17:30.807 INFO:teuthology.orchestra.run.smithi007.stdout: "services_complete": [ 2024-06-18T02:17:30.807 INFO:teuthology.orchestra.run.smithi007.stdout: "mon", 2024-06-18T02:17:30.807 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr" 2024-06-18T02:17:30.807 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-06-18T02:17:30.807 INFO:teuthology.orchestra.run.smithi007.stdout: "progress": "11/23 daemons upgraded", 2024-06-18T02:17:30.808 INFO:teuthology.orchestra.run.smithi007.stdout: "message": "Currently upgrading osd daemons", 2024-06-18T02:17:30.808 INFO:teuthology.orchestra.run.smithi007.stdout: "is_paused": false 2024-06-18T02:17:30.808 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:17:31.181 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:30 smithi007 ceph-mon[99735]: from='client.54562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:17:31.181 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:30 smithi007 ceph-mon[99735]: pgmap v344: 161 pgs: 161 active+clean; 585 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-06-18T02:17:31.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:30 smithi007 ceph-mon[99735]: from='client.54568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:17:31.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-06-18T02:17:31.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:30 smithi007 ceph-mon[99735]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-06-18T02:17:31.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:30 smithi007 ceph-mon[99735]: Upgrade: osd.6 is safe to restart 2024-06-18T02:17:31.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:30 smithi007 ceph-mon[99735]: from='client.54574 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:17:31.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:30 smithi007 ceph-mon[99735]: from='client.? 172.21.15.7:0/1709502923' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:31.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:30 smithi007 ceph-mon[113333]: from='client.54562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:17:31.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:30 smithi007 ceph-mon[113333]: pgmap v344: 161 pgs: 161 active+clean; 585 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-06-18T02:17:31.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:30 smithi007 ceph-mon[113333]: from='client.54568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:17:31.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-06-18T02:17:31.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:30 smithi007 ceph-mon[113333]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-06-18T02:17:31.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:30 smithi007 ceph-mon[113333]: Upgrade: osd.6 is safe to restart 2024-06-18T02:17:31.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:30 smithi007 ceph-mon[113333]: from='client.54574 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:17:31.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:30 smithi007 ceph-mon[113333]: from='client.? 172.21.15.7:0/1709502923' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:31.217 INFO:teuthology.orchestra.run.smithi007.stdout:HEALTH_OK 2024-06-18T02:17:32.026 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:31 smithi130 ceph-mon[84407]: from='client.94545 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:17:32.027 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:31 smithi130 ceph-mon[84407]: from='client.? 172.21.15.7:0/207234954' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:17:32.027 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:31 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:32.027 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-06-18T02:17:32.027 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:32.027 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:31 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:32.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:31 smithi007 ceph-mon[113333]: from='client.94545 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:17:32.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:31 smithi007 ceph-mon[113333]: from='client.? 172.21.15.7:0/207234954' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:17:32.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:31 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:32.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-06-18T02:17:32.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:32.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:31 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:32.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:31 smithi007 ceph-mon[99735]: from='client.94545 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:17:32.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:31 smithi007 ceph-mon[99735]: from='client.? 172.21.15.7:0/207234954' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:17:32.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:31 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:32.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-06-18T02:17:32.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:32.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:31 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:33.033 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:32 smithi130 ceph-mon[84407]: Upgrade: Updating osd.6 2024-06-18T02:17:33.033 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:32 smithi130 ceph-mon[84407]: Deploying daemon osd.6 on smithi130 2024-06-18T02:17:33.033 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:32 smithi130 ceph-mon[84407]: pgmap v345: 161 pgs: 161 active+clean; 585 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-06-18T02:17:33.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:32 smithi007 ceph-mon[113333]: Upgrade: Updating osd.6 2024-06-18T02:17:33.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:32 smithi007 ceph-mon[113333]: Deploying daemon osd.6 on smithi130 2024-06-18T02:17:33.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:32 smithi007 ceph-mon[113333]: pgmap v345: 161 pgs: 161 active+clean; 585 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-06-18T02:17:33.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:32 smithi007 ceph-mon[99735]: Upgrade: Updating osd.6 2024-06-18T02:17:33.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:32 smithi007 ceph-mon[99735]: Deploying daemon osd.6 on smithi130 2024-06-18T02:17:33.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:32 smithi007 ceph-mon[99735]: pgmap v345: 161 pgs: 161 active+clean; 585 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-06-18T02:17:33.838 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:33 smithi130 ceph-mon[84407]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:17:34.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:33 smithi007 ceph-mon[113333]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:17:34.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:33 smithi007 ceph-mon[99735]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:17:34.926 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:34 smithi130 ceph-mon[84407]: pgmap v346: 161 pgs: 161 active+clean; 585 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:17:35.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:34 smithi007 ceph-mon[113333]: pgmap v346: 161 pgs: 161 active+clean; 585 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:17:35.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:34 smithi007 ceph-mon[99735]: pgmap v346: 161 pgs: 161 active+clean; 585 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:17:35.189 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:35 smithi130 systemd[1]: Stopping Ceph osd.6 for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:17:35.737 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:35 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[36581]: 2024-06-18T02:17:35.476+0000 7f6e40318700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-18T02:17:35.737 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:35 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[36581]: 2024-06-18T02:17:35.476+0000 7f6e40318700 -1 osd.6 175 *** Got signal Terminated *** 2024-06-18T02:17:35.737 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:35 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[36581]: 2024-06-18T02:17:35.476+0000 7f6e40318700 -1 osd.6 175 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-18T02:17:36.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:35 smithi130 ceph-mon[84407]: osd.6 marked itself down and dead 2024-06-18T02:17:36.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:35 smithi007 ceph-mon[113333]: osd.6 marked itself down and dead 2024-06-18T02:17:36.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:35 smithi007 ceph-mon[99735]: osd.6 marked itself down and dead 2024-06-18T02:17:36.585 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:36 smithi130 podman[132926]: 2024-06-18 02:17:36.294745283 +0000 UTC m=+0.939659185 container died c7af86c1495954e6e4e840d9c9e27e43ca0573dc135106ba88a5505f357916ee (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6, name=centos-stream, GIT_BRANCH=HEAD, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, distribution-scope=public, vendor=Red Hat, Inc., build-date=2022-05-03T08:36:31.336870, io.openshift.expose-services=, architecture=x86_64, ceph=True, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, vcs-type=git, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, RELEASE=HEAD, io.k8s.display-name=CentOS Stream 8, GIT_REPO=https://github.com/ceph/ceph-container.git, com.redhat.component=centos-stream-container, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.openshift.tags=base centos centos-stream, io.buildah.version=1.19.8, maintainer=Guillaume Abrioux , version=8, CEPH_POINT_RELEASE=-17.2.0, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., release=754, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, GIT_CLEAN=True) 2024-06-18T02:17:36.902 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:36 smithi130 ceph-mon[84407]: pgmap v347: 161 pgs: 161 active+clean; 585 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:17:36.902 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:36 smithi130 ceph-mon[84407]: Health check failed: 1 osds down (OSD_DOWN) 2024-06-18T02:17:36.902 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:36 smithi130 ceph-mon[84407]: osdmap e176: 8 total, 7 up, 8 in 2024-06-18T02:17:36.903 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:36 smithi130 podman[132926]: 2024-06-18 02:17:36.685299742 +0000 UTC m=+1.330213648 container cleanup c7af86c1495954e6e4e840d9c9e27e43ca0573dc135106ba88a5505f357916ee (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6, release=754, GIT_BRANCH=HEAD, io.buildah.version=1.19.8, name=centos-stream, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, io.openshift.expose-services=, version=8, GIT_CLEAN=True, RELEASE=HEAD, ceph=True, CEPH_POINT_RELEASE=-17.2.0, distribution-scope=public, vendor=Red Hat, Inc., build-date=2022-05-03T08:36:31.336870, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.component=centos-stream-container, architecture=x86_64, maintainer=Guillaume Abrioux , description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.k8s.display-name=CentOS Stream 8, io.openshift.tags=base centos centos-stream, vcs-type=git, com.redhat.license_terms=https://centos.org/legal/licensing-policy/) 2024-06-18T02:17:36.903 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:36 smithi130 bash[132926]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6 2024-06-18T02:17:37.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:36 smithi007 ceph-mon[113333]: pgmap v347: 161 pgs: 161 active+clean; 585 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:17:37.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:36 smithi007 ceph-mon[113333]: Health check failed: 1 osds down (OSD_DOWN) 2024-06-18T02:17:37.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:36 smithi007 ceph-mon[113333]: osdmap e176: 8 total, 7 up, 8 in 2024-06-18T02:17:37.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:36 smithi007 ceph-mon[99735]: pgmap v347: 161 pgs: 161 active+clean; 585 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:17:37.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:36 smithi007 ceph-mon[99735]: Health check failed: 1 osds down (OSD_DOWN) 2024-06-18T02:17:37.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:36 smithi007 ceph-mon[99735]: osdmap e176: 8 total, 7 up, 8 in 2024-06-18T02:17:37.293 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:36 smithi130 podman[132944]: 2024-06-18 02:17:36.903641794 +0000 UTC m=+0.610806579 container remove c7af86c1495954e6e4e840d9c9e27e43ca0573dc135106ba88a5505f357916ee (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6, version=8, vcs-type=git, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., maintainer=Guillaume Abrioux , url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_REPO=https://github.com/ceph/ceph-container.git, build-date=2022-05-03T08:36:31.336870, distribution-scope=public, architecture=x86_64, RELEASE=HEAD, ceph=True, io.k8s.display-name=CentOS Stream 8, release=754, name=centos-stream, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.openshift.tags=base centos centos-stream, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.openshift.expose-services=, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, vendor=Red Hat, Inc., GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.buildah.version=1.19.8, com.redhat.component=centos-stream-container, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, CEPH_POINT_RELEASE=-17.2.0) 2024-06-18T02:17:37.568 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:37 smithi130 podman[133032]: 2024-06-18 02:17:37.220226547 +0000 UTC m=+0.017542935 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:17:37.568 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:37 smithi130 podman[133032]: 2024-06-18 02:17:37.36298383 +0000 UTC m=+0.160300210 container create 92c394b1b5024764b10e3531d1c2a466ded68f76696be1e33ce343a660910d33 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6-deactivate, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_CLEAN=True, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-3781e3a, org.label-schema.build-date=20240612, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True) 2024-06-18T02:17:37.569 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:37 smithi130 podman[133032]: 2024-06-18 02:17:37.56590471 +0000 UTC m=+0.363221109 container init 92c394b1b5024764b10e3531d1c2a466ded68f76696be1e33ce343a660910d33 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6-deactivate, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.build-date=20240612, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, RELEASE=squid-3781e3a, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-06-18T02:17:37.569 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:37 smithi130 podman[133032]: 2024-06-18 02:17:37.569652285 +0000 UTC m=+0.366968669 container start 92c394b1b5024764b10e3531d1c2a466ded68f76696be1e33ce343a660910d33 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6-deactivate, org.label-schema.build-date=20240612, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-3781e3a, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-06-18T02:17:37.834 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:37 smithi130 ceph-mon[84407]: osdmap e177: 8 total, 7 up, 8 in 2024-06-18T02:17:37.834 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:37 smithi130 podman[133032]: 2024-06-18 02:17:37.665957582 +0000 UTC m=+0.463273971 container attach 92c394b1b5024764b10e3531d1c2a466ded68f76696be1e33ce343a660910d33 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240612, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-3781e3a, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47) 2024-06-18T02:17:38.168 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:17:37 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:17:37] "GET /metrics HTTP/1.1" 200 38506 "" "Prometheus/2.33.4" 2024-06-18T02:17:38.168 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:37 smithi130 podman[133032]: 2024-06-18 02:17:37.860741004 +0000 UTC m=+0.658057393 container died 92c394b1b5024764b10e3531d1c2a466ded68f76696be1e33ce343a660910d33 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6-deactivate, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-3781e3a, org.label-schema.build-date=20240612, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-06-18T02:17:38.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:37 smithi007 ceph-mon[113333]: osdmap e177: 8 total, 7 up, 8 in 2024-06-18T02:17:38.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:37 smithi007 ceph-mon[99735]: osdmap e177: 8 total, 7 up, 8 in 2024-06-18T02:17:38.753 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:38 smithi130 podman[133120]: 2024-06-18 02:17:38.428176027 +0000 UTC m=+0.561716936 container remove 92c394b1b5024764b10e3531d1c2a466ded68f76696be1e33ce343a660910d33 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.build-date=20240612, RELEASE=squid-3781e3a, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-18T02:17:38.754 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:38 smithi130 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.6.service: Deactivated successfully. 2024-06-18T02:17:38.754 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:38 smithi130 systemd[1]: Stopped Ceph osd.6 for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:17:38.754 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:38 smithi130 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.6.service: Consumed 11.164s CPU time. 2024-06-18T02:17:38.754 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:38 smithi130 systemd[1]: Starting Ceph osd.6 for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:17:39.019 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:38 smithi130 ceph-mon[84407]: pgmap v350: 161 pgs: 17 active+undersized, 10 peering, 4 stale+active+clean, 8 active+undersized+degraded, 122 active+clean; 585 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s; 44/726 objects degraded (6.061%) 2024-06-18T02:17:39.019 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:38 smithi130 ceph-mon[84407]: Health check failed: Degraded data redundancy: 44/726 objects degraded (6.061%), 8 pgs degraded (PG_DEGRADED) 2024-06-18T02:17:39.019 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:38 smithi130 podman[133272]: 2024-06-18 02:17:38.797842715 +0000 UTC m=+0.019768648 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:17:39.019 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:38 smithi130 podman[133272]: 2024-06-18 02:17:38.920915274 +0000 UTC m=+0.142841236 container create 447a84d4632754f995e913a2e6f096049610b350d905dee3547b6c2f1dcaddae (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6-activate, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.36.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-3781e3a, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240612, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-06-18T02:17:39.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:38 smithi007 ceph-mon[113333]: pgmap v350: 161 pgs: 17 active+undersized, 10 peering, 4 stale+active+clean, 8 active+undersized+degraded, 122 active+clean; 585 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s; 44/726 objects degraded (6.061%) 2024-06-18T02:17:39.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:38 smithi007 ceph-mon[113333]: Health check failed: Degraded data redundancy: 44/726 objects degraded (6.061%), 8 pgs degraded (PG_DEGRADED) 2024-06-18T02:17:39.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:38 smithi007 ceph-mon[99735]: pgmap v350: 161 pgs: 17 active+undersized, 10 peering, 4 stale+active+clean, 8 active+undersized+degraded, 122 active+clean; 585 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s; 44/726 objects degraded (6.061%) 2024-06-18T02:17:39.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:38 smithi007 ceph-mon[99735]: Health check failed: Degraded data redundancy: 44/726 objects degraded (6.061%), 8 pgs degraded (PG_DEGRADED) 2024-06-18T02:17:39.293 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:39 smithi130 podman[133272]: 2024-06-18 02:17:39.132291764 +0000 UTC m=+0.354217694 container init 447a84d4632754f995e913a2e6f096049610b350d905dee3547b6c2f1dcaddae (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6-activate, io.buildah.version=1.36.0, org.label-schema.build-date=20240612, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-3781e3a, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47) 2024-06-18T02:17:39.293 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:39 smithi130 podman[133272]: 2024-06-18 02:17:39.136142157 +0000 UTC m=+0.358068085 container start 447a84d4632754f995e913a2e6f096049610b350d905dee3547b6c2f1dcaddae (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6-activate, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240612, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, RELEASE=squid-3781e3a, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-06-18T02:17:39.293 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:39 smithi130 podman[133272]: 2024-06-18 02:17:39.215081486 +0000 UTC m=+0.437007417 container attach 447a84d4632754f995e913a2e6f096049610b350d905dee3547b6c2f1dcaddae (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6-activate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.build-date=20240612, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-3781e3a, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-06-18T02:17:39.793 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6-activate[133300]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-06-18T02:17:39.793 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:39 smithi130 bash[133272]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-06-18T02:17:39.794 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6-activate[133300]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-6 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-06-18T02:17:39.794 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:39 smithi130 bash[133272]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-6 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-06-18T02:17:39.794 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6-activate[133300]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-06-18T02:17:39.794 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:39 smithi130 bash[133272]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-06-18T02:17:39.794 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6-activate[133300]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-06-18T02:17:39.794 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:39 smithi130 bash[133272]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-06-18T02:17:39.794 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6-activate[133300]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-6/block 2024-06-18T02:17:39.794 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:39 smithi130 bash[133272]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-6/block 2024-06-18T02:17:39.794 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6-activate[133300]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-06-18T02:17:39.794 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:39 smithi130 bash[133272]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-06-18T02:17:39.794 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6-activate[133300]: --> ceph-volume raw activate successful for osd ID: 6 2024-06-18T02:17:39.794 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:39 smithi130 bash[133272]: --> ceph-volume raw activate successful for osd ID: 6 2024-06-18T02:17:39.794 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:39 smithi130 podman[133272]: 2024-06-18 02:17:39.657199198 +0000 UTC m=+0.879125163 container died 447a84d4632754f995e913a2e6f096049610b350d905dee3547b6c2f1dcaddae (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6-activate, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.build-date=20240612, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-3781e3a) 2024-06-18T02:17:40.543 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:40 smithi130 podman[133466]: 2024-06-18 02:17:40.263151455 +0000 UTC m=+0.679266894 container remove 447a84d4632754f995e913a2e6f096049610b350d905dee3547b6c2f1dcaddae (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6-activate, org.label-schema.schema-version=1.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-3781e3a, org.label-schema.build-date=20240612, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=) 2024-06-18T02:17:41.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:40 smithi130 ceph-mon[84407]: pgmap v351: 161 pgs: 23 active+undersized, 10 peering, 3 stale+active+clean, 13 active+undersized+degraded, 112 active+clean; 585 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 895 B/s rd, 0 op/s; 59/726 objects degraded (8.127%) 2024-06-18T02:17:41.043 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:40 smithi130 podman[133579]: 2024-06-18 02:17:40.715075676 +0000 UTC m=+0.018278412 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:17:41.043 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:40 smithi130 podman[133579]: 2024-06-18 02:17:40.849549365 +0000 UTC m=+0.152752087 container create 8b34e05bc5839c0fa8a297940ebceba4f9036837b7ceb38415d1b9d340532fab (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, io.buildah.version=1.36.0, RELEASE=squid-3781e3a, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240612) 2024-06-18T02:17:41.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:40 smithi007 ceph-mon[99735]: pgmap v351: 161 pgs: 23 active+undersized, 10 peering, 3 stale+active+clean, 13 active+undersized+degraded, 112 active+clean; 585 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 895 B/s rd, 0 op/s; 59/726 objects degraded (8.127%) 2024-06-18T02:17:41.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:40 smithi007 ceph-mon[113333]: pgmap v351: 161 pgs: 23 active+undersized, 10 peering, 3 stale+active+clean, 13 active+undersized+degraded, 112 active+clean; 585 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 895 B/s rd, 0 op/s; 59/726 objects degraded (8.127%) 2024-06-18T02:17:41.426 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:41 smithi130 podman[133579]: 2024-06-18 02:17:41.102162414 +0000 UTC m=+0.405365152 container init 8b34e05bc5839c0fa8a297940ebceba4f9036837b7ceb38415d1b9d340532fab (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, RELEASE=squid-3781e3a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240612, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-06-18T02:17:41.426 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:41 smithi130 podman[133579]: 2024-06-18 02:17:41.105492215 +0000 UTC m=+0.408694937 container start 8b34e05bc5839c0fa8a297940ebceba4f9036837b7ceb38415d1b9d340532fab (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240612, io.buildah.version=1.36.0, RELEASE=squid-3781e3a, CEPH_POINT_RELEASE=) 2024-06-18T02:17:41.426 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:41 smithi130 ceph-osd[133629]: -- 172.21.15.130:0/2405297889 <== mon.2 v2:172.21.15.130:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559eb78d5a40 con 0x559eb78b3c00 2024-06-18T02:17:41.426 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:41 smithi130 bash[133579]: 8b34e05bc5839c0fa8a297940ebceba4f9036837b7ceb38415d1b9d340532fab 2024-06-18T02:17:41.426 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:41 smithi130 systemd[1]: Started Ceph osd.6 for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:17:41.739 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:41 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[133625]: 2024-06-18T02:17:41.667+0000 7fa860d29640 -1 Falling back to public interface 2024-06-18T02:17:42.452 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:42 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:42.453 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:17:42.453 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:42 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:42.453 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:42 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:42.453 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:42 smithi130 ceph-mon[84407]: pgmap v352: 161 pgs: 34 active+undersized, 19 active+undersized+degraded, 108 active+clean; 585 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 127 B/s rd, 0 op/s; 85/726 objects degraded (11.708%) 2024-06-18T02:17:42.453 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:42 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:42.453 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:42 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:42.453 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:42.453 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:42.453 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:42 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:42.453 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:42 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:42.453 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:42.453 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:42.454 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:42.454 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:42.454 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:42 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:42.454 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:42 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:42.454 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:42 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:42.454 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:42 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:42.454 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:42 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:42.454 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:42.454 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:42.454 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:42.454 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:42.454 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-06-18T02:17:42.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:42 smithi130 ceph-mon[84407]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-06-18T02:17:42.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:42 smithi130 ceph-mon[84407]: Upgrade: osd.6 is safe to restart 2024-06-18T02:17:42.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:42 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:42.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:42 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:42.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:42 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:42.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:42.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:17:42.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:42.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:42.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[113333]: pgmap v352: 161 pgs: 34 active+undersized, 19 active+undersized+degraded, 108 active+clean; 585 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 127 B/s rd, 0 op/s; 85/726 objects degraded (11.708%) 2024-06-18T02:17:42.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:42.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:42.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:42.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:42.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:42.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:42.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:42.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:42.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:42.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:42.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:42.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:42.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:42.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:42.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:42.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:42.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:42.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:42.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:42.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-06-18T02:17:42.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[113333]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-06-18T02:17:42.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[113333]: Upgrade: osd.6 is safe to restart 2024-06-18T02:17:42.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:42.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:42.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:42.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:42.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:17:42.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:42.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:42.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[99735]: pgmap v352: 161 pgs: 34 active+undersized, 19 active+undersized+degraded, 108 active+clean; 585 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 127 B/s rd, 0 op/s; 85/726 objects degraded (11.708%) 2024-06-18T02:17:42.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:42.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:42.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:42.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:42.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:42.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:42.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:42.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:42.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:42.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:42.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:42.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:42.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:42.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:42.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:42.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:42.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:42.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:42.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:42.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-06-18T02:17:42.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[99735]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-06-18T02:17:42.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[99735]: Upgrade: osd.6 is safe to restart 2024-06-18T02:17:42.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:42.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:42.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:43.439 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:43 smithi130 ceph-mon[84407]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:17:43.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:43 smithi007 ceph-mon[113333]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:17:43.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:43 smithi007 ceph-mon[99735]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:17:44.542 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:44 smithi130 ceph-mon[84407]: pgmap v353: 161 pgs: 34 active+undersized, 19 active+undersized+degraded, 108 active+clean; 585 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s; 85/726 objects degraded (11.708%) 2024-06-18T02:17:44.542 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[133625]: 2024-06-18T02:17:44.357+0000 7fa860d29640 -1 osd.6 0 read_superblock omap replica is missing. 2024-06-18T02:17:44.542 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[133625]: 2024-06-18T02:17:44.387+0000 7fa860d29640 -1 osd.6 175 log_to_monitors true 2024-06-18T02:17:44.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:44 smithi007 ceph-mon[113333]: pgmap v353: 161 pgs: 34 active+undersized, 19 active+undersized+degraded, 108 active+clean; 585 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s; 85/726 objects degraded (11.708%) 2024-06-18T02:17:44.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:44 smithi007 ceph-mon[99735]: pgmap v353: 161 pgs: 34 active+undersized, 19 active+undersized+degraded, 108 active+clean; 585 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s; 85/726 objects degraded (11.708%) 2024-06-18T02:17:45.543 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:45 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[133625]: 2024-06-18T02:17:45.300+0000 7fa858ad4640 -1 osd.6 175 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-18T02:17:45.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:45 smithi130 ceph-mon[84407]: from='osd.6 [v2:172.21.15.130:6816/1040120580,v1:172.21.15.130:6817/1040120580]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-06-18T02:17:45.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:45 smithi130 ceph-mon[84407]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-06-18T02:17:45.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:45 smithi130 ceph-mon[84407]: Health check update: Degraded data redundancy: 85/726 objects degraded (11.708%), 19 pgs degraded (PG_DEGRADED) 2024-06-18T02:17:45.681 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:45 smithi007 ceph-mon[99735]: from='osd.6 [v2:172.21.15.130:6816/1040120580,v1:172.21.15.130:6817/1040120580]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-06-18T02:17:45.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:45 smithi007 ceph-mon[99735]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-06-18T02:17:45.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:45 smithi007 ceph-mon[99735]: Health check update: Degraded data redundancy: 85/726 objects degraded (11.708%), 19 pgs degraded (PG_DEGRADED) 2024-06-18T02:17:45.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:45 smithi007 ceph-mon[113333]: from='osd.6 [v2:172.21.15.130:6816/1040120580,v1:172.21.15.130:6817/1040120580]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-06-18T02:17:45.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:45 smithi007 ceph-mon[113333]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-06-18T02:17:45.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:45 smithi007 ceph-mon[113333]: Health check update: Degraded data redundancy: 85/726 objects degraded (11.708%), 19 pgs degraded (PG_DEGRADED) 2024-06-18T02:17:46.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:46 smithi130 ceph-mon[84407]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-06-18T02:17:46.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:46 smithi130 ceph-mon[84407]: osdmap e178: 8 total, 7 up, 8 in 2024-06-18T02:17:46.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:46 smithi130 ceph-mon[84407]: from='osd.6 [v2:172.21.15.130:6816/1040120580,v1:172.21.15.130:6817/1040120580]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:17:46.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:46 smithi130 ceph-mon[84407]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:17:46.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:46 smithi130 ceph-mon[84407]: pgmap v355: 161 pgs: 34 active+undersized, 19 active+undersized+degraded, 108 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 697 B/s rd, 0 op/s; 85/726 objects degraded (11.708%) 2024-06-18T02:17:46.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:46 smithi130 ceph-mon[84407]: Upgrade: Updating osd.6 2024-06-18T02:17:46.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-06-18T02:17:46.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:46 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:46.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:46 smithi130 ceph-mon[84407]: Deploying daemon osd.6 on smithi130 2024-06-18T02:17:46.546 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:46 smithi007 ceph-mon[99735]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-06-18T02:17:46.546 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:46 smithi007 ceph-mon[99735]: osdmap e178: 8 total, 7 up, 8 in 2024-06-18T02:17:46.546 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:46 smithi007 ceph-mon[99735]: from='osd.6 [v2:172.21.15.130:6816/1040120580,v1:172.21.15.130:6817/1040120580]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:17:46.546 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:46 smithi007 ceph-mon[99735]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:17:46.546 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:46 smithi007 ceph-mon[99735]: pgmap v355: 161 pgs: 34 active+undersized, 19 active+undersized+degraded, 108 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 697 B/s rd, 0 op/s; 85/726 objects degraded (11.708%) 2024-06-18T02:17:46.546 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:46 smithi007 ceph-mon[99735]: Upgrade: Updating osd.6 2024-06-18T02:17:46.546 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-06-18T02:17:46.546 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:46 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:46.546 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:46 smithi007 ceph-mon[99735]: Deploying daemon osd.6 on smithi130 2024-06-18T02:17:46.547 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:46 smithi007 ceph-mon[113333]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-06-18T02:17:46.547 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:46 smithi007 ceph-mon[113333]: osdmap e178: 8 total, 7 up, 8 in 2024-06-18T02:17:46.547 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:46 smithi007 ceph-mon[113333]: from='osd.6 [v2:172.21.15.130:6816/1040120580,v1:172.21.15.130:6817/1040120580]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:17:46.547 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:46 smithi007 ceph-mon[113333]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:17:46.547 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:46 smithi007 ceph-mon[113333]: pgmap v355: 161 pgs: 34 active+undersized, 19 active+undersized+degraded, 108 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 697 B/s rd, 0 op/s; 85/726 objects degraded (11.708%) 2024-06-18T02:17:46.547 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:46 smithi007 ceph-mon[113333]: Upgrade: Updating osd.6 2024-06-18T02:17:46.547 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-06-18T02:17:46.547 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:46 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:46.547 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:46 smithi007 ceph-mon[113333]: Deploying daemon osd.6 on smithi130 2024-06-18T02:17:47.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:47 smithi007 ceph-mon[113333]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-06-18T02:17:47.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:47 smithi007 ceph-mon[113333]: osd.6 [v2:172.21.15.130:6816/1040120580,v1:172.21.15.130:6817/1040120580] boot 2024-06-18T02:17:47.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:47 smithi007 ceph-mon[113333]: osdmap e179: 8 total, 8 up, 8 in 2024-06-18T02:17:47.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-18T02:17:47.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:47 smithi007 ceph-mon[113333]: osdmap e180: 8 total, 8 up, 8 in 2024-06-18T02:17:47.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:47 smithi007 ceph-mon[99735]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-06-18T02:17:47.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:47 smithi007 ceph-mon[99735]: osd.6 [v2:172.21.15.130:6816/1040120580,v1:172.21.15.130:6817/1040120580] boot 2024-06-18T02:17:47.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:47 smithi007 ceph-mon[99735]: osdmap e179: 8 total, 8 up, 8 in 2024-06-18T02:17:47.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-18T02:17:47.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:47 smithi007 ceph-mon[99735]: osdmap e180: 8 total, 8 up, 8 in 2024-06-18T02:17:47.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:47 smithi130 ceph-mon[84407]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-06-18T02:17:47.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:47 smithi130 ceph-mon[84407]: osd.6 [v2:172.21.15.130:6816/1040120580,v1:172.21.15.130:6817/1040120580] boot 2024-06-18T02:17:47.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:47 smithi130 ceph-mon[84407]: osdmap e179: 8 total, 8 up, 8 in 2024-06-18T02:17:47.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-18T02:17:47.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:47 smithi130 ceph-mon[84407]: osdmap e180: 8 total, 8 up, 8 in 2024-06-18T02:17:48.104 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:17:47 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:17:47] "GET /metrics HTTP/1.1" 200 38513 "" "Prometheus/2.33.4" 2024-06-18T02:17:48.374 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:48 smithi130 ceph-mon[84407]: pgmap v358: 161 pgs: 26 peering, 18 active+undersized, 9 active+undersized+degraded, 108 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 39/726 objects degraded (5.372%) 2024-06-18T02:17:48.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:48 smithi007 ceph-mon[113333]: pgmap v358: 161 pgs: 26 peering, 18 active+undersized, 9 active+undersized+degraded, 108 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 39/726 objects degraded (5.372%) 2024-06-18T02:17:48.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:48 smithi007 ceph-mon[99735]: pgmap v358: 161 pgs: 26 peering, 18 active+undersized, 9 active+undersized+degraded, 108 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 39/726 objects degraded (5.372%) 2024-06-18T02:17:49.901 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:49 smithi130 ceph-mon[84407]: Health check update: Degraded data redundancy: 39/726 objects degraded (5.372%), 9 pgs degraded (PG_DEGRADED) 2024-06-18T02:17:49.901 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:49 smithi130 systemd[1]: Stopping Ceph osd.6 for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:17:49.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:49 smithi007 ceph-mon[113333]: Health check update: Degraded data redundancy: 39/726 objects degraded (5.372%), 9 pgs degraded (PG_DEGRADED) 2024-06-18T02:17:49.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:49 smithi007 ceph-mon[99735]: Health check update: Degraded data redundancy: 39/726 objects degraded (5.372%), 9 pgs degraded (PG_DEGRADED) 2024-06-18T02:17:50.194 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[133625]: 2024-06-18T02:17:50.038+0000 7fa85dcc1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-18T02:17:50.194 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[133625]: 2024-06-18T02:17:50.038+0000 7fa85dcc1640 -1 osd.6 180 *** Got signal Terminated *** 2024-06-18T02:17:50.194 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[133625]: 2024-06-18T02:17:50.038+0000 7fa85dcc1640 -1 osd.6 180 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-18T02:17:51.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:50 smithi130 ceph-mon[84407]: pgmap v359: 161 pgs: 26 peering, 13 active+undersized, 4 active+undersized+degraded, 118 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s; 24/726 objects degraded (3.306%) 2024-06-18T02:17:51.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:50 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:51.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:50 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:51.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:50 smithi130 ceph-mon[84407]: pgmap v360: 161 pgs: 26 peering, 13 active+undersized, 4 active+undersized+degraded, 118 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 873 B/s rd, 0 op/s; 24/726 objects degraded (3.306%) 2024-06-18T02:17:51.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:50 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:51.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:50 smithi130 ceph-mon[84407]: osd.6 marked itself down and dead 2024-06-18T02:17:51.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:50 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:51.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:50 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:51.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:50 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:51.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:50 smithi007 ceph-mon[113333]: pgmap v359: 161 pgs: 26 peering, 13 active+undersized, 4 active+undersized+degraded, 118 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s; 24/726 objects degraded (3.306%) 2024-06-18T02:17:51.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:50 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:51.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:50 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:51.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:50 smithi007 ceph-mon[113333]: pgmap v360: 161 pgs: 26 peering, 13 active+undersized, 4 active+undersized+degraded, 118 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 873 B/s rd, 0 op/s; 24/726 objects degraded (3.306%) 2024-06-18T02:17:51.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:50 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:51.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:50 smithi007 ceph-mon[113333]: osd.6 marked itself down and dead 2024-06-18T02:17:51.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:50 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:51.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:50 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:51.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:50 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:51.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:50 smithi007 ceph-mon[99735]: pgmap v359: 161 pgs: 26 peering, 13 active+undersized, 4 active+undersized+degraded, 118 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s; 24/726 objects degraded (3.306%) 2024-06-18T02:17:51.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:50 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:51.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:50 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:51.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:50 smithi007 ceph-mon[99735]: pgmap v360: 161 pgs: 26 peering, 13 active+undersized, 4 active+undersized+degraded, 118 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 873 B/s rd, 0 op/s; 24/726 objects degraded (3.306%) 2024-06-18T02:17:51.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:50 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:51.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:50 smithi007 ceph-mon[99735]: osd.6 marked itself down and dead 2024-06-18T02:17:51.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:50 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:51.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:50 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:51.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:50 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:51.689 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:51 smithi130 podman[135116]: 2024-06-18 02:17:51.396389358 +0000 UTC m=+1.491136502 container died 8b34e05bc5839c0fa8a297940ebceba4f9036837b7ceb38415d1b9d340532fab (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6, org.label-schema.license=GPLv2, RELEASE=squid-3781e3a, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240612, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, CEPH_POINT_RELEASE=) 2024-06-18T02:17:51.951 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:51 smithi130 podman[135116]: 2024-06-18 02:17:51.872183645 +0000 UTC m=+1.966930831 container cleanup 8b34e05bc5839c0fa8a297940ebceba4f9036837b7ceb38415d1b9d340532fab (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.build-date=20240612, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-3781e3a, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-06-18T02:17:51.951 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:51 smithi130 bash[135116]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6 2024-06-18T02:17:52.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:51 smithi130 ceph-mon[84407]: pgmap v361: 161 pgs: 26 peering, 10 active+undersized, 3 active+undersized+degraded, 122 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 884 B/s rd, 0 op/s; 13/726 objects degraded (1.791%) 2024-06-18T02:17:52.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:51 smithi130 ceph-mon[84407]: pgmap v362: 161 pgs: 26 peering, 10 active+undersized, 3 active+undersized+degraded, 122 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s; 13/726 objects degraded (1.791%) 2024-06-18T02:17:52.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:51 smithi130 ceph-mon[84407]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-06-18T02:17:52.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:51 smithi130 ceph-mon[84407]: Health check failed: 1 osds down (OSD_DOWN) 2024-06-18T02:17:52.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:51 smithi130 ceph-mon[84407]: osdmap e181: 8 total, 7 up, 8 in 2024-06-18T02:17:52.294 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:52 smithi130 podman[135214]: 2024-06-18 02:17:52.174124915 +0000 UTC m=+0.779795157 container remove 8b34e05bc5839c0fa8a297940ebceba4f9036837b7ceb38415d1b9d340532fab (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, io.buildah.version=1.36.0, org.label-schema.build-date=20240612, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-3781e3a, maintainer=Guillaume Abrioux ) 2024-06-18T02:17:52.335 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:51 smithi007 ceph-mon[99735]: pgmap v361: 161 pgs: 26 peering, 10 active+undersized, 3 active+undersized+degraded, 122 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 884 B/s rd, 0 op/s; 13/726 objects degraded (1.791%) 2024-06-18T02:17:52.335 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:51 smithi007 ceph-mon[99735]: pgmap v362: 161 pgs: 26 peering, 10 active+undersized, 3 active+undersized+degraded, 122 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s; 13/726 objects degraded (1.791%) 2024-06-18T02:17:52.335 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:51 smithi007 ceph-mon[99735]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-06-18T02:17:52.335 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:51 smithi007 ceph-mon[99735]: Health check failed: 1 osds down (OSD_DOWN) 2024-06-18T02:17:52.335 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:51 smithi007 ceph-mon[99735]: osdmap e181: 8 total, 7 up, 8 in 2024-06-18T02:17:52.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:51 smithi007 ceph-mon[113333]: pgmap v361: 161 pgs: 26 peering, 10 active+undersized, 3 active+undersized+degraded, 122 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 884 B/s rd, 0 op/s; 13/726 objects degraded (1.791%) 2024-06-18T02:17:52.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:51 smithi007 ceph-mon[113333]: pgmap v362: 161 pgs: 26 peering, 10 active+undersized, 3 active+undersized+degraded, 122 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s; 13/726 objects degraded (1.791%) 2024-06-18T02:17:52.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:51 smithi007 ceph-mon[113333]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-06-18T02:17:52.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:51 smithi007 ceph-mon[113333]: Health check failed: 1 osds down (OSD_DOWN) 2024-06-18T02:17:52.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:51 smithi007 ceph-mon[113333]: osdmap e181: 8 total, 7 up, 8 in 2024-06-18T02:17:52.794 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:52 smithi130 podman[135300]: 2024-06-18 02:17:52.408691303 +0000 UTC m=+0.017858410 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:17:52.794 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:52 smithi130 podman[135300]: 2024-06-18 02:17:52.525178504 +0000 UTC m=+0.134345600 container create 6344454ccd4f3950688f7aa139ae81d7fbc12736cd754b46328802a967dcb046 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, RELEASE=squid-3781e3a, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240612, org.label-schema.license=GPLv2) 2024-06-18T02:17:52.794 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:52 smithi130 podman[135300]: 2024-06-18 02:17:52.744280398 +0000 UTC m=+0.353447511 container init 6344454ccd4f3950688f7aa139ae81d7fbc12736cd754b46328802a967dcb046 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6-deactivate, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.build-date=20240612, maintainer=Guillaume Abrioux , RELEASE=squid-3781e3a, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-06-18T02:17:52.794 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:52 smithi130 podman[135300]: 2024-06-18 02:17:52.747531566 +0000 UTC m=+0.356698662 container start 6344454ccd4f3950688f7aa139ae81d7fbc12736cd754b46328802a967dcb046 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.build-date=20240612, RELEASE=squid-3781e3a, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.36.0) 2024-06-18T02:17:53.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:52 smithi130 ceph-mon[84407]: osdmap e182: 8 total, 7 up, 8 in 2024-06-18T02:17:53.294 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:52 smithi130 podman[135300]: 2024-06-18 02:17:52.82771383 +0000 UTC m=+0.436880944 container attach 6344454ccd4f3950688f7aa139ae81d7fbc12736cd754b46328802a967dcb046 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6-deactivate, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240612, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-3781e3a) 2024-06-18T02:17:53.294 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:53 smithi130 podman[135300]: 2024-06-18 02:17:53.005446513 +0000 UTC m=+0.614613609 container died 6344454ccd4f3950688f7aa139ae81d7fbc12736cd754b46328802a967dcb046 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240612, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_CLEAN=True, io.buildah.version=1.36.0, RELEASE=squid-3781e3a) 2024-06-18T02:17:53.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:52 smithi007 ceph-mon[113333]: osdmap e182: 8 total, 7 up, 8 in 2024-06-18T02:17:53.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:52 smithi007 ceph-mon[99735]: osdmap e182: 8 total, 7 up, 8 in 2024-06-18T02:17:53.970 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:53 smithi130 podman[135323]: 2024-06-18 02:17:53.632418866 +0000 UTC m=+0.617922298 container remove 6344454ccd4f3950688f7aa139ae81d7fbc12736cd754b46328802a967dcb046 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240612, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, RELEASE=squid-3781e3a, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0) 2024-06-18T02:17:53.971 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:53 smithi130 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.6.service: Deactivated successfully. 2024-06-18T02:17:53.971 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:53 smithi130 systemd[1]: Stopped Ceph osd.6 for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:17:53.971 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:53 smithi130 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.6.service: Consumed 1.744s CPU time. 2024-06-18T02:17:53.971 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:53 smithi130 systemd[1]: Starting Ceph osd.6 for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:17:54.229 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:53 smithi130 ceph-mon[84407]: pgmap v365: 161 pgs: 6 active+undersized, 12 stale+active+clean, 17 peering, 4 active+undersized+degraded, 122 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 17/726 objects degraded (2.342%) 2024-06-18T02:17:54.229 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:53 smithi130 ceph-mon[84407]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:17:54.230 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:54 smithi130 podman[135424]: 2024-06-18 02:17:53.9859914 +0000 UTC m=+0.019375974 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:17:54.230 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:54 smithi130 podman[135424]: 2024-06-18 02:17:54.100185255 +0000 UTC m=+0.133569828 container create 54e934179e703b2cd5a0430c104662e5314b2128881952e38ce8bfde7d8ddc62 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6-activate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, RELEASE=squid-3781e3a, org.label-schema.build-date=20240612) 2024-06-18T02:17:54.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:53 smithi007 ceph-mon[113333]: pgmap v365: 161 pgs: 6 active+undersized, 12 stale+active+clean, 17 peering, 4 active+undersized+degraded, 122 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 17/726 objects degraded (2.342%) 2024-06-18T02:17:54.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:53 smithi007 ceph-mon[113333]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:17:54.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:53 smithi007 ceph-mon[99735]: pgmap v365: 161 pgs: 6 active+undersized, 12 stale+active+clean, 17 peering, 4 active+undersized+degraded, 122 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 17/726 objects degraded (2.342%) 2024-06-18T02:17:54.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:53 smithi007 ceph-mon[99735]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:17:54.711 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:54 smithi130 podman[135424]: 2024-06-18 02:17:54.344396784 +0000 UTC m=+0.377781357 container init 54e934179e703b2cd5a0430c104662e5314b2128881952e38ce8bfde7d8ddc62 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-3781e3a, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240612, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-06-18T02:17:54.711 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:54 smithi130 podman[135424]: 2024-06-18 02:17:54.347778596 +0000 UTC m=+0.381163170 container start 54e934179e703b2cd5a0430c104662e5314b2128881952e38ce8bfde7d8ddc62 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6-activate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240612, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-3781e3a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux ) 2024-06-18T02:17:54.711 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:54 smithi130 podman[135424]: 2024-06-18 02:17:54.452902408 +0000 UTC m=+0.486286984 container attach 54e934179e703b2cd5a0430c104662e5314b2128881952e38ce8bfde7d8ddc62 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6-activate, RELEASE=squid-3781e3a, CEPH_POINT_RELEASE=, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240612, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-06-18T02:17:54.711 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:54 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6-activate[135438]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-06-18T02:17:54.977 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:54 smithi130 bash[135424]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-06-18T02:17:54.977 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:54 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6-activate[135438]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-6 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-06-18T02:17:54.977 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:54 smithi130 bash[135424]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-6 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-06-18T02:17:54.977 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:54 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6-activate[135438]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-06-18T02:17:54.977 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:54 smithi130 bash[135424]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-06-18T02:17:54.977 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:54 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6-activate[135438]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-06-18T02:17:54.977 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:54 smithi130 bash[135424]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-06-18T02:17:54.977 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:54 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6-activate[135438]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-6/block 2024-06-18T02:17:54.978 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:54 smithi130 bash[135424]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-6/block 2024-06-18T02:17:54.978 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:54 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6-activate[135438]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-06-18T02:17:54.978 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:54 smithi130 bash[135424]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-06-18T02:17:54.978 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:54 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6-activate[135438]: --> ceph-volume raw activate successful for osd ID: 6 2024-06-18T02:17:54.978 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:54 smithi130 bash[135424]: --> ceph-volume raw activate successful for osd ID: 6 2024-06-18T02:17:54.978 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:54 smithi130 podman[135424]: 2024-06-18 02:17:54.76536709 +0000 UTC m=+0.798751673 container died 54e934179e703b2cd5a0430c104662e5314b2128881952e38ce8bfde7d8ddc62 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6-activate, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240612, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_CLEAN=True, io.buildah.version=1.36.0, RELEASE=squid-3781e3a, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-18T02:17:55.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:54 smithi130 ceph-mon[84407]: Health check update: Degraded data redundancy: 17/726 objects degraded (2.342%), 4 pgs degraded (PG_DEGRADED) 2024-06-18T02:17:55.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:54 smithi007 ceph-mon[113333]: Health check update: Degraded data redundancy: 17/726 objects degraded (2.342%), 4 pgs degraded (PG_DEGRADED) 2024-06-18T02:17:55.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:54 smithi007 ceph-mon[99735]: Health check update: Degraded data redundancy: 17/726 objects degraded (2.342%), 4 pgs degraded (PG_DEGRADED) 2024-06-18T02:17:55.640 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:55 smithi130 podman[135559]: 2024-06-18 02:17:55.390731113 +0000 UTC m=+0.616359295 container remove 54e934179e703b2cd5a0430c104662e5314b2128881952e38ce8bfde7d8ddc62 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6-activate, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-3781e3a, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240612, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47) 2024-06-18T02:17:55.641 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:55 smithi130 podman[135616]: 2024-06-18 02:17:55.512218208 +0000 UTC m=+0.017490224 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:17:55.641 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:55 smithi130 podman[135616]: 2024-06-18 02:17:55.641627945 +0000 UTC m=+0.146900058 container create eb813977281a549932896ccb9368b650ab41e6b9ed82cef6d4bcd437d9dc75d4 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6, RELEASE=squid-3781e3a, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240612, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-06-18T02:17:55.959 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:55 smithi130 podman[135616]: 2024-06-18 02:17:55.852576209 +0000 UTC m=+0.357848223 container init eb813977281a549932896ccb9368b650ab41e6b9ed82cef6d4bcd437d9dc75d4 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, RELEASE=squid-3781e3a, org.label-schema.license=GPLv2, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240612) 2024-06-18T02:17:55.959 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:55 smithi130 podman[135616]: 2024-06-18 02:17:55.85606374 +0000 UTC m=+0.361335745 container start eb813977281a549932896ccb9368b650ab41e6b9ed82cef6d4bcd437d9dc75d4 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-3781e3a, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240612) 2024-06-18T02:17:55.959 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:55 smithi130 ceph-osd[135635]: -- 172.21.15.130:0/1299154284 <== mon.2 v2:172.21.15.130:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5643f12e1a40 con 0x5643f12bfc00 2024-06-18T02:17:56.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:55 smithi130 ceph-mon[84407]: pgmap v366: 161 pgs: 12 active+undersized, 11 stale+active+clean, 17 peering, 9 active+undersized+degraded, 112 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 242 B/s rd, 0 op/s; 32/726 objects degraded (4.408%) 2024-06-18T02:17:56.293 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:55 smithi130 bash[135616]: eb813977281a549932896ccb9368b650ab41e6b9ed82cef6d4bcd437d9dc75d4 2024-06-18T02:17:56.294 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:55 smithi130 systemd[1]: Started Ceph osd.6 for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:17:56.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:55 smithi007 ceph-mon[113333]: pgmap v366: 161 pgs: 12 active+undersized, 11 stale+active+clean, 17 peering, 9 active+undersized+degraded, 112 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 242 B/s rd, 0 op/s; 32/726 objects degraded (4.408%) 2024-06-18T02:17:56.431 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:55 smithi007 ceph-mon[99735]: pgmap v366: 161 pgs: 12 active+undersized, 11 stale+active+clean, 17 peering, 9 active+undersized+degraded, 112 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 242 B/s rd, 0 op/s; 32/726 objects degraded (4.408%) 2024-06-18T02:17:56.793 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:56 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:17:56.400+0000 7f03e8b96640 -1 Falling back to public interface 2024-06-18T02:17:57.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:57 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:57.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:57 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:57.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:57.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:57.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:57 smithi130 ceph-mon[84407]: pgmap v367: 161 pgs: 17 active+undersized, 8 stale+active+clean, 17 peering, 11 active+undersized+degraded, 108 active+clean; 585 KiB data, 246 MiB used, 715 GiB / 715 GiB avail; 175 B/s rd, 0 op/s; 45/726 objects degraded (6.198%) 2024-06-18T02:17:57.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:57 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:57.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:57 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:57.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:57.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:57.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:57.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:57.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:57 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:57.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:57 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:57.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:17:57.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:57.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:57.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:57.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:57.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:57 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:57.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:57.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:57.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:57.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:57.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:57 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:57.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:57.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:57.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:57.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:57.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:57 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:57.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:57.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:57.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:57.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:57.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:57 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:57.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:57.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:57.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:57.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:57.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:57 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:57.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:57.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:57.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:57.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:57.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:57 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:57.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:57.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:57.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:57.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:57.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:57.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:57.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:57.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:57.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[113333]: pgmap v367: 161 pgs: 17 active+undersized, 8 stale+active+clean, 17 peering, 11 active+undersized+degraded, 108 active+clean; 585 KiB data, 246 MiB used, 715 GiB / 715 GiB avail; 175 B/s rd, 0 op/s; 45/726 objects degraded (6.198%) 2024-06-18T02:17:57.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:57.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:57.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:57.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:57.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:57.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:57.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:57.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:57.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:17:57.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:57.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:57.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:57.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:57.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:57.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:57.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:57.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:57.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:57.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:57.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:57.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:57.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:57.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:57.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:57.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:57.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:57.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:57.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:57.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[99735]: pgmap v367: 161 pgs: 17 active+undersized, 8 stale+active+clean, 17 peering, 11 active+undersized+degraded, 108 active+clean; 585 KiB data, 246 MiB used, 715 GiB / 715 GiB avail; 175 B/s rd, 0 op/s; 45/726 objects degraded (6.198%) 2024-06-18T02:17:57.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:57.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:57.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:57.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:57.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:57.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:57.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:57.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:57.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:17:57.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:57.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:57.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:57.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:57.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:57.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:57.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:57.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:57.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:57.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:57.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:57.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:57.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:57.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:57.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:57.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:57.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:57.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:57.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:57.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:57.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:57.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:57.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:57.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:57.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:57.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:57.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:57.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:57.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:57.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:57.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:57.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:57.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:57.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:57.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:57.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:57.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:57.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:57.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:57.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:57.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:57.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:57.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:57.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:57.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:57.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:57.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:57.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:57.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:57.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:57.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:57.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:57.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:58.111 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:17:57 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:17:57] "GET /metrics HTTP/1.1" 200 38524 "" "Prometheus/2.33.4" 2024-06-18T02:17:58.112 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:58 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:58.112 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:58 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:58.112 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:58 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:58.112 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:58 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:58.112 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:58 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:58.112 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:58 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:58.112 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:58 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:58.112 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:58 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:58.112 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:58 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:58.112 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:58 smithi130 ceph-mon[84407]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-06-18T02:17:58.112 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:58.112 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:58.112 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:58.113 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:58.113 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:58 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:58.113 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:58.113 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:58.113 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:58.113 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:58.113 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:58 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:58.113 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:58.113 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:58.113 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:58.113 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:58.113 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:58 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:58.113 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:58.113 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:58.114 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:58.114 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:58.114 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:58 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:58.114 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:58.114 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:58.114 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:58.114 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:58.114 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:58 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:58.114 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:58.114 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:58.114 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:58.114 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:58.114 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:58 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:58.115 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:58.115 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:58.115 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:58.115 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:58.115 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:58 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:58.115 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:58.115 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:58.115 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:58.115 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:58.115 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:58 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:58.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:58.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:58.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:58.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:58.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:58.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:58.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:58.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:58.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:58.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[99735]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-06-18T02:17:58.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:58.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:58.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:58.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:58.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:58.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:58.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:58.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:58.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:58.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:58.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:58.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:58.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:58.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:58.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:58.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:58.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:58.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:58.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:58.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:58.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:58.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:58.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:58.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:58.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:58.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:58.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:58.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:58.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:58.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:58.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[113333]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-06-18T02:17:58.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:58.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:58.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:58.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:58.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:58.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:58.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:58.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:58.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:58.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:58.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:58.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:58.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:58.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:58.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:58.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:58.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:58.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:58.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:58.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:58.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:58.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:58.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:58.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:58.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:58.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:58.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:58.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:58.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:58.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:58.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:58.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:58.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:58.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:58.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:58.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:58.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:58.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:58.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:58.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:58.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:58.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:58.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:58.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:58.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:58.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:58.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:58.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:58.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:58.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:58.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:58.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:58.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:58.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:58.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:58.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:58.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:58.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:58.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:58 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:59.144 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:59 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:59.144 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:59 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:59.144 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:59 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:59.144 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:59 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:59.145 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:59 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:59.145 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:59 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:59.145 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:59 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:59.145 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:59 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:59.145 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:59 smithi130 ceph-mon[84407]: pgmap v368: 161 pgs: 34 active+undersized, 19 active+undersized+degraded, 108 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 784 B/s rd, 0 op/s; 85/726 objects degraded (11.708%) 2024-06-18T02:17:59.145 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:59.145 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:59.145 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:59.145 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:59.145 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:59 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:59.145 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:59 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:59.145 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:59.145 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:59.145 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:59.146 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:59.146 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:59 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:59.146 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:59.146 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:59.146 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:59.146 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:59.146 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:59 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:59.146 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:59.146 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:59.146 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:59.146 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:59.146 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:59 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:59.147 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:59.147 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:59.147 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:59.147 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:59.147 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:59 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:59.147 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:59.147 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:59.147 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:59.147 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:59.147 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:59 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:59.148 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:59.148 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:59.148 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:59.148 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:59.148 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:59 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:59.148 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:59.148 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:59.148 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:59.148 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:59.148 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:59 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:59.148 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:59.148 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:59.148 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:59.149 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:59.149 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:17:59 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:59.405 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:17:59 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:17:59.144+0000 7f03e8b96640 -1 osd.6 180 log_to_monitors true 2024-06-18T02:17:59.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:59.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:59.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:59.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:59.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:59.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:59.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:59.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:59.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[99735]: pgmap v368: 161 pgs: 34 active+undersized, 19 active+undersized+degraded, 108 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 784 B/s rd, 0 op/s; 85/726 objects degraded (11.708%) 2024-06-18T02:17:59.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:59.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:59.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:59.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:59.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:59.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:59.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:59.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:59.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:59.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:59.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:59.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:59.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:59.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:59.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:59.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:59.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:59.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:59.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:59.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:59.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:59.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:59.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:59.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:59.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:59.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:59.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:59.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:59.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:59.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:59.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:59.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:59.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:59.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:59.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:59.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:59.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:59.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:59.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:59.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:59.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:59.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:59.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:59.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:59.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:59.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:59.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:59.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:59.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:59.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:59.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:59.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:59.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:59.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:59.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[113333]: pgmap v368: 161 pgs: 34 active+undersized, 19 active+undersized+degraded, 108 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 784 B/s rd, 0 op/s; 85/726 objects degraded (11.708%) 2024-06-18T02:17:59.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:59.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:59.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:59.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:59.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:59.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:17:59.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:59.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:59.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:59.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:59.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:59.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:59.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:59.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:59.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:59.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:59.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:59.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:59.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:59.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:59.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:59.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:59.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:59.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:59.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:59.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:59.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:59.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:59.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:59.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:59.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:59.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:59.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:59.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:59.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:59.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:59.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:59.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:59.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:59.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:59.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:17:59.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:17:59.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:17:59.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:17:59.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:17:59.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:17:59 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:00.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:00 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:00.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:00 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:00.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:00 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:00.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:00 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:00.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:00 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:00.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:00 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:00.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:00 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:00.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:00 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:00.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:00.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:00.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:00.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:00.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:00 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:00.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:00 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:00.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:00 smithi130 ceph-mon[84407]: from='osd.6 [v2:172.21.15.130:6816/2166376926,v1:172.21.15.130:6817/2166376926]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-06-18T02:18:00.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:00 smithi130 ceph-mon[84407]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-06-18T02:18:00.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:00.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:00.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:00.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:00.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:00 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:00.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:00.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:00.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:00.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:00.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:00 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:00.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:00.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:00.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:00.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:00.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:00 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:00.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:00 smithi130 ceph-mon[84407]: Health check update: Degraded data redundancy: 85/726 objects degraded (11.708%), 19 pgs degraded (PG_DEGRADED) 2024-06-18T02:18:00.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:00.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:00.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:00.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:00.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:00 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:00.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:00.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:00.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:00.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:00.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:00 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:00.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:00.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:00.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:00.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:00.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:00 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:00.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:00.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:00.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:00.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:00.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:00.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:00.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:00.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:00.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:00.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:00.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:00.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:00.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:00.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:00.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:00.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:00.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:00.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:00.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[113333]: from='osd.6 [v2:172.21.15.130:6816/2166376926,v1:172.21.15.130:6817/2166376926]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-06-18T02:18:00.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[113333]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-06-18T02:18:00.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:00.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:00.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:00.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:00.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:00.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:00.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:00.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:00.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:00.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:00.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:00.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:00.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:00.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:00.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:00.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[113333]: Health check update: Degraded data redundancy: 85/726 objects degraded (11.708%), 19 pgs degraded (PG_DEGRADED) 2024-06-18T02:18:00.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:00.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:00.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:00.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:00.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:00.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:00.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:00.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:00.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:00.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:00.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:00.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:00.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:00.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:00.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:00.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:00.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:00.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:00.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:00.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:00.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:00.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:00.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:00.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:00.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:00.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:00.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:00.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:00.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:00.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:00.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:00.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:00.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:00.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[99735]: from='osd.6 [v2:172.21.15.130:6816/2166376926,v1:172.21.15.130:6817/2166376926]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-06-18T02:18:00.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[99735]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-06-18T02:18:00.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:00.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:00.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:00.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:00.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:00.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:00.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:00.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:00.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:00.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:00.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:00.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:00.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:00.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:00.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:00.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[99735]: Health check update: Degraded data redundancy: 85/726 objects degraded (11.708%), 19 pgs degraded (PG_DEGRADED) 2024-06-18T02:18:00.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:00.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:00.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:00.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:00.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:00.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:00.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:00.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:00.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:00.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:00.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:00.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:00.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:00.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:00.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:00.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:00.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:00.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:00.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:00.693 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:18:00 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:18:00.609+0000 7f03dc939640 -1 osd.6 180 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-18T02:18:01.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:01 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:01.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:01 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:01.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:01 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:01.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:01 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:01.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:01 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:01.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:01 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:01.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:01 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:01.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:01 smithi130 ceph-mon[84407]: pgmap v369: 161 pgs: 34 active+undersized, 19 active+undersized+degraded, 108 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 678 B/s rd, 0 op/s; 85/726 objects degraded (11.708%) 2024-06-18T02:18:01.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:01 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:01.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:01 smithi130 ceph-mon[84407]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-06-18T02:18:01.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:01 smithi130 ceph-mon[84407]: osdmap e183: 8 total, 7 up, 8 in 2024-06-18T02:18:01.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:01 smithi130 ceph-mon[84407]: from='osd.6 [v2:172.21.15.130:6816/2166376926,v1:172.21.15.130:6817/2166376926]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:18:01.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:01 smithi130 ceph-mon[84407]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:18:01.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:01.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:01.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:01.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:01.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:01 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:01.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:01.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:01.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:01.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:01.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:01 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:01.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:01.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:01.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:01.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:01.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:01 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:01.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:01 smithi130 ceph-mon[84407]: from='osd.6 ' entity='osd.6' 2024-06-18T02:18:01.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:01.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:01.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:01.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:01.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:01 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:01.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:01.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:01.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:01.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:01.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:01 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:01.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:01.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:01.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:01.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:01.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:01 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:01.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:01.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:01.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:01.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:01 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:01.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:01.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:01.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:01.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:01.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:01.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:01.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:01.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[113333]: pgmap v369: 161 pgs: 34 active+undersized, 19 active+undersized+degraded, 108 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 678 B/s rd, 0 op/s; 85/726 objects degraded (11.708%) 2024-06-18T02:18:01.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:01.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[113333]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-06-18T02:18:01.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[113333]: osdmap e183: 8 total, 7 up, 8 in 2024-06-18T02:18:01.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[113333]: from='osd.6 [v2:172.21.15.130:6816/2166376926,v1:172.21.15.130:6817/2166376926]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:18:01.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[113333]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:18:01.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:01.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:01.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:01.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:01.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:01.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:01.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:01.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:01.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:01.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:01.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:01.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:01.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:01.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:01.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:01.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[113333]: from='osd.6 ' entity='osd.6' 2024-06-18T02:18:01.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:01.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:01.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:01.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:01.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:01.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:01.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:01.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[99735]: pgmap v369: 161 pgs: 34 active+undersized, 19 active+undersized+degraded, 108 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 678 B/s rd, 0 op/s; 85/726 objects degraded (11.708%) 2024-06-18T02:18:01.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:01.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[99735]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-06-18T02:18:01.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[99735]: osdmap e183: 8 total, 7 up, 8 in 2024-06-18T02:18:01.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[99735]: from='osd.6 [v2:172.21.15.130:6816/2166376926,v1:172.21.15.130:6817/2166376926]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:18:01.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[99735]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:18:01.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:01.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:01.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:01.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:01.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:01.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:01.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:01.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:01.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:01.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:01.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:01.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:01.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:01.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:01.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:01.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[99735]: from='osd.6 ' entity='osd.6' 2024-06-18T02:18:01.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:01.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:01.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:01.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:01.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:01.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:01.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:01.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:01.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:01.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:01.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:01.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:01.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:01.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:01.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:01.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:01.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:01.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:01.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:01.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:01.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:01.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:01.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:01.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:01.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:01.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:01.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:01.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:01.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:01.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:01.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:01.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:01.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:01.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:01.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:01.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:01.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:01.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:01 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:01.590 INFO:teuthology.orchestra.run.smithi007.stdout:true 2024-06-18T02:18:02.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:02 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:02.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:02 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:02.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:02 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:02.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:02 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:02.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:02 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:02.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:02 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:02.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:02 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:02.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:02 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:02.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:02.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:02.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:02.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:02.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:02 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:02.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:02.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:02.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:02.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:02.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:02 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:02.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:02.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:02.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:02.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:02.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:02 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:02.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:02.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:02.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:02.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:02.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:02 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:02.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:02 smithi130 ceph-mon[84407]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-06-18T02:18:02.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:02 smithi130 ceph-mon[84407]: osd.6 [v2:172.21.15.130:6816/2166376926,v1:172.21.15.130:6817/2166376926] boot 2024-06-18T02:18:02.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:02 smithi130 ceph-mon[84407]: osdmap e184: 8 total, 8 up, 8 in 2024-06-18T02:18:02.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-18T02:18:02.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:02.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:02.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:02.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:02.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:02 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:02.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:02.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:02.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:02.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:02.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:02 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:02.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:02.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:02.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:02.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:02.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:02 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:02.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:02.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:02.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:02.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:02.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:02 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:02.299 INFO:teuthology.orchestra.run.smithi007.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-18T02:18:02.300 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi007 smithi007 running 20s ago 21m - - 2024-06-18T02:18:02.300 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi130 smithi130 running 12s ago 21m - - 2024-06-18T02:18:02.300 INFO:teuthology.orchestra.run.smithi007.stdout:alertmanager.a smithi007 *:9093,9094 running (10m) 20s ago 15m 24.0M - 0.23.0 ba2b418f427c 5994e8525c64 2024-06-18T02:18:02.300 INFO:teuthology.orchestra.run.smithi007.stdout:grafana.a smithi130 *:3000 running (10m) 12s ago 15m 49.5M - 8.3.5 dad864ee21e9 70ba81d97c8e 2024-06-18T02:18:02.300 INFO:teuthology.orchestra.run.smithi007.stdout:iscsi.foo.smithi007.xvdrwd smithi007 running (9m) 20s ago 14m 64.0M - 3.5 e1d6a67b021e 94121ad2702c 2024-06-18T02:18:02.300 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.x smithi130 *:8443,9283,8765 running (9m) 12s ago 20m 535M - 19.0.0-3124-g3781e3a5 af93c036e016 01017e37bdbe 2024-06-18T02:18:02.300 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.y smithi007 *:8443,9283,8765 running (8m) 20s ago 22m 444M - 19.0.0-3124-g3781e3a5 af93c036e016 2141e131e896 2024-06-18T02:18:02.300 INFO:teuthology.orchestra.run.smithi007.stdout:mon.a smithi007 running (6m) 20s ago 22m 62.5M 2048M 19.0.0-3124-g3781e3a5 af93c036e016 7bbe646cd5b7 2024-06-18T02:18:02.300 INFO:teuthology.orchestra.run.smithi007.stdout:mon.b smithi130 running (7m) 12s ago 20m 59.0M 2048M 19.0.0-3124-g3781e3a5 af93c036e016 baacf2add994 2024-06-18T02:18:02.300 INFO:teuthology.orchestra.run.smithi007.stdout:mon.c smithi007 running (7m) 20s ago 20m 60.3M 2048M 19.0.0-3124-g3781e3a5 af93c036e016 39418356156e 2024-06-18T02:18:02.300 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.a smithi007 *:9100 running (11m) 20s ago 16m 17.9M - 1.3.1 1dbe0e931976 8128e558f099 2024-06-18T02:18:02.300 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.b smithi130 *:9100 running (10m) 12s ago 16m 16.8M - 1.3.1 1dbe0e931976 bab93b43cf16 2024-06-18T02:18:02.301 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0 smithi007 running (5m) 20s ago 20m 55.2M 4096M 19.0.0-3124-g3781e3a5 af93c036e016 07c7f4afd49a 2024-06-18T02:18:02.301 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1 smithi007 running (4m) 20s ago 19m 52.2M 4096M 19.0.0-3124-g3781e3a5 af93c036e016 e8d184614e94 2024-06-18T02:18:02.301 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2 smithi007 running (3m) 20s ago 19m 46.6M 4096M 19.0.0-3124-g3781e3a5 af93c036e016 7d9a05b4bfa5 2024-06-18T02:18:02.301 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3 smithi007 running (2m) 20s ago 18m 53.6M 4096M 19.0.0-3124-g3781e3a5 af93c036e016 7e879cda3b51 2024-06-18T02:18:02.301 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4 smithi130 running (80s) 12s ago 18m 54.0M 4096M 19.0.0-3124-g3781e3a5 af93c036e016 24f46c456c31 2024-06-18T02:18:02.301 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5 smithi130 running (50s) 12s ago 18m 53.0M 4096M 19.0.0-3124-g3781e3a5 af93c036e016 210471d14700 2024-06-18T02:18:02.301 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6 smithi130 starting - - - 4096M 2024-06-18T02:18:02.301 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7 smithi130 running (17m) 12s ago 17m 66.0M 4096M 17.2.0 e1d6a67b021e 3688af8b2c46 2024-06-18T02:18:02.301 INFO:teuthology.orchestra.run.smithi007.stdout:prometheus.a smithi130 *:9095 running (9m) 12s ago 16m 75.9M - 2.33.4 514e6a882f6e e905fb2eb4a6 2024-06-18T02:18:02.301 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi007.dvbvbk smithi007 *:8000 running (14m) 20s ago 14m 78.8M - 17.2.0 e1d6a67b021e 1344b55b763c 2024-06-18T02:18:02.301 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi130.aakmof smithi130 *:8000 running (14m) 12s ago 14m 76.6M - 17.2.0 e1d6a67b021e e257e3230c6c 2024-06-18T02:18:02.301 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi007.hgrnmk smithi007 *:80 running (14m) 20s ago 14m 76.7M - 17.2.0 e1d6a67b021e 2173947bc4d6 2024-06-18T02:18:02.301 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi130.wwebfk smithi130 *:80 running (14m) 12s ago 14m 78.6M - 17.2.0 e1d6a67b021e 8662706b2231 2024-06-18T02:18:02.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:02.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:02.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:02.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:02.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:02.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:02.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:02.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:02.303 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:02.303 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:02.303 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:02.303 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:02.303 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:02.303 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:02.303 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:02.303 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:02.303 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:02.303 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:02.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:02.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:02.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:02.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:02.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:02.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:02.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:02.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:02.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:02.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:02.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[113333]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-06-18T02:18:02.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[113333]: osd.6 [v2:172.21.15.130:6816/2166376926,v1:172.21.15.130:6817/2166376926] boot 2024-06-18T02:18:02.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[113333]: osdmap e184: 8 total, 8 up, 8 in 2024-06-18T02:18:02.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-18T02:18:02.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:02.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:02.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:02.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:02.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:02.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:02.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:02.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:02.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:02.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:02.305 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:02.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:02.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:02.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:02.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:02.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:02.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:02.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:02.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:02.306 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:02.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:02.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:02.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:02.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:02.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:02.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:02.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:02.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:02.307 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:02.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:02.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:02.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:02.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:02.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:02.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:02.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:02.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:02.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:02.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:02.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:02.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:02.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:02.308 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:02.309 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:02.309 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:02.309 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:02.309 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:02.309 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:02.309 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[99735]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-06-18T02:18:02.309 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[99735]: osd.6 [v2:172.21.15.130:6816/2166376926,v1:172.21.15.130:6817/2166376926] boot 2024-06-18T02:18:02.309 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[99735]: osdmap e184: 8 total, 8 up, 8 in 2024-06-18T02:18:02.309 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-18T02:18:02.309 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:02.309 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:02.309 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:02.309 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:02.309 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:02.310 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:02.310 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:02.310 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:02.310 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:02.310 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:02.310 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:02.310 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:02.310 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:02.310 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:02.310 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:02.310 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:02.310 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:02.310 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:02.311 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:02.311 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:02 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:02.738 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:18:02.738 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": { 2024-06-18T02:18:02.738 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 3 2024-06-18T02:18:02.738 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:18:02.738 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": { 2024-06-18T02:18:02.739 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 2 2024-06-18T02:18:02.739 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:18:02.739 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": { 2024-06-18T02:18:02.739 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 1, 2024-06-18T02:18:02.739 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 7 2024-06-18T02:18:02.739 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:18:02.739 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw": { 2024-06-18T02:18:02.739 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-06-18T02:18:02.739 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:18:02.739 INFO:teuthology.orchestra.run.smithi007.stdout: "overall": { 2024-06-18T02:18:02.739 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 5, 2024-06-18T02:18:02.739 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 12 2024-06-18T02:18:02.740 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-06-18T02:18:02.740 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:18:03.095 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:18:03.095 INFO:teuthology.orchestra.run.smithi007.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00", 2024-06-18T02:18:03.096 INFO:teuthology.orchestra.run.smithi007.stdout: "in_progress": true, 2024-06-18T02:18:03.096 INFO:teuthology.orchestra.run.smithi007.stdout: "which": "Upgrading all daemon types on all hosts", 2024-06-18T02:18:03.096 INFO:teuthology.orchestra.run.smithi007.stdout: "services_complete": [ 2024-06-18T02:18:03.096 INFO:teuthology.orchestra.run.smithi007.stdout: "mon", 2024-06-18T02:18:03.096 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr" 2024-06-18T02:18:03.096 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-06-18T02:18:03.096 INFO:teuthology.orchestra.run.smithi007.stdout: "progress": "11/23 daemons upgraded", 2024-06-18T02:18:03.096 INFO:teuthology.orchestra.run.smithi007.stdout: "message": "Currently upgrading osd daemons", 2024-06-18T02:18:03.096 INFO:teuthology.orchestra.run.smithi007.stdout: "is_paused": false 2024-06-18T02:18:03.096 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:18:03.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:03 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:03.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:03 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:03.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:03 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:03.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:03 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:03.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:03 smithi130 ceph-mon[84407]: from='client.54607 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:18:03.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:03 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:03.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:03 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:03.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:03 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:03.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:03 smithi130 ceph-mon[84407]: from='client.54613 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:18:03.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:03 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:03.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:03 smithi130 ceph-mon[84407]: pgmap v372: 161 pgs: 9 peering, 28 active+undersized, 16 active+undersized+degraded, 108 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 653 B/s rd, 0 op/s; 68/726 objects degraded (9.366%) 2024-06-18T02:18:03.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:03.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:03.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:03.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:03.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:03 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:03.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:03 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:03.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:03.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:03.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:03.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:03.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:03 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:03.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:03 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:03.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:03 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:03.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:03 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:03.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:03.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:03.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:03.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:03.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:03 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:03.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:03.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:03.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:03.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:03.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:03 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:03.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:03.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:03.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:03.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:03.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:03 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:03.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:03 smithi130 ceph-mon[84407]: osdmap e185: 8 total, 8 up, 8 in 2024-06-18T02:18:03.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:03.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:03.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:03.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:03.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:03 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:03.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:03 smithi130 ceph-mon[84407]: from='client.? 172.21.15.7:0/1035087948' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:03.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:03.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:03.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:03.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:03.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:03 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:03.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:03.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:03.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:03.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:03 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:03.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:03 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:03.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:03.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:03.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:03.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:03.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[113333]: from='client.54607 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:18:03.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:03.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:03.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:03.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[113333]: from='client.54613 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:18:03.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:03.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[113333]: pgmap v372: 161 pgs: 9 peering, 28 active+undersized, 16 active+undersized+degraded, 108 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 653 B/s rd, 0 op/s; 68/726 objects degraded (9.366%) 2024-06-18T02:18:03.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:03.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:03.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:03.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:03.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:03.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:03.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:03.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:03.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:03.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:03.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:03.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:03.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:03.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:03.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:03.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:03.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:03.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:03.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:03.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:03.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:03.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:03.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:03.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:03.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:03.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:03.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:03.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:03.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:03.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[113333]: osdmap e185: 8 total, 8 up, 8 in 2024-06-18T02:18:03.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:03.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:03.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:03.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:03.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:03.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[113333]: from='client.? 172.21.15.7:0/1035087948' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:03.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:03.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:03.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:03.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:03.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:03.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:03.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:03.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:03.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:03.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:03.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:03.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:03.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:03.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:03.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[99735]: from='client.54607 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:18:03.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:03.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:03.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:03.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[99735]: from='client.54613 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:18:03.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:03.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[99735]: pgmap v372: 161 pgs: 9 peering, 28 active+undersized, 16 active+undersized+degraded, 108 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 653 B/s rd, 0 op/s; 68/726 objects degraded (9.366%) 2024-06-18T02:18:03.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:03.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:03.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:03.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:03.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:03.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:03.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:03.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:03.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:03.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:03.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:03.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:03.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:03.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:03.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:03.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:03.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:03.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:03.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:03.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:03.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:03.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:03.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:03.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:03.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:03.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:03.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:03.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:03.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:03.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[99735]: osdmap e185: 8 total, 8 up, 8 in 2024-06-18T02:18:03.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:03.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:03.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:03.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:03.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:03.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[99735]: from='client.? 172.21.15.7:0/1035087948' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:03.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:03.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:03.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:03.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:03.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:03.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:03.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:03.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:03.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:03.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:03 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:03.522 INFO:teuthology.orchestra.run.smithi007.stdout:HEALTH_WARN Degraded data redundancy: 68/726 objects degraded (9.366%), 16 pgs degraded 2024-06-18T02:18:03.522 INFO:teuthology.orchestra.run.smithi007.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 68/726 objects degraded (9.366%), 16 pgs degraded 2024-06-18T02:18:03.523 INFO:teuthology.orchestra.run.smithi007.stdout: pg 1.0 is active+undersized+degraded, acting [7,0] 2024-06-18T02:18:03.523 INFO:teuthology.orchestra.run.smithi007.stdout: pg 2.16 is active+undersized+degraded, acting [5,2] 2024-06-18T02:18:03.523 INFO:teuthology.orchestra.run.smithi007.stdout: pg 2.19 is active+undersized+degraded, acting [3,0] 2024-06-18T02:18:03.523 INFO:teuthology.orchestra.run.smithi007.stdout: pg 2.1b is active+undersized+degraded, acting [3,7] 2024-06-18T02:18:03.523 INFO:teuthology.orchestra.run.smithi007.stdout: pg 3.0 is active+undersized+degraded, acting [1,2] 2024-06-18T02:18:03.523 INFO:teuthology.orchestra.run.smithi007.stdout: pg 3.2 is active+undersized+degraded, acting [3,5] 2024-06-18T02:18:03.523 INFO:teuthology.orchestra.run.smithi007.stdout: pg 3.a is active+undersized+degraded, acting [4,1] 2024-06-18T02:18:03.523 INFO:teuthology.orchestra.run.smithi007.stdout: pg 3.c is active+undersized+degraded, acting [5,3] 2024-06-18T02:18:03.523 INFO:teuthology.orchestra.run.smithi007.stdout: pg 3.d is active+undersized+degraded, acting [7,5] 2024-06-18T02:18:03.523 INFO:teuthology.orchestra.run.smithi007.stdout: pg 3.10 is active+undersized+degraded, acting [0,5] 2024-06-18T02:18:03.524 INFO:teuthology.orchestra.run.smithi007.stdout: pg 3.11 is active+undersized+degraded, acting [7,4] 2024-06-18T02:18:03.524 INFO:teuthology.orchestra.run.smithi007.stdout: pg 3.1d is active+undersized+degraded, acting [5,4] 2024-06-18T02:18:03.524 INFO:teuthology.orchestra.run.smithi007.stdout: pg 3.1e is active+undersized+degraded, acting [3,2] 2024-06-18T02:18:03.524 INFO:teuthology.orchestra.run.smithi007.stdout: pg 4.1f is active+undersized+degraded, acting [5,1] 2024-06-18T02:18:03.524 INFO:teuthology.orchestra.run.smithi007.stdout: pg 5.10 is active+undersized+degraded, acting [7,4] 2024-06-18T02:18:03.524 INFO:teuthology.orchestra.run.smithi007.stdout: pg 6.c is active+undersized+degraded, acting [3,5] 2024-06-18T02:18:04.267 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:04 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:04.267 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:04 smithi130 ceph-mon[84407]: from='client.54619 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:18:04.267 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:04 smithi130 ceph-mon[84407]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:18:04.267 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:04 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:04.267 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:04 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:04.267 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:04 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:04.268 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:04 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:04.268 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:04 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:04.268 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:04 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:04.268 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:04.268 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:04.268 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:04.268 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:04.268 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:04 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:04.268 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:04 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:04.268 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:04 smithi130 ceph-mon[84407]: from='client.94587 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:18:04.268 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:04.268 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:04.268 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:04.269 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:04.269 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:04 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:04.269 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:04.269 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:04.269 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:04.269 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:04.269 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:04 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:04.269 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:04.269 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:04.269 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:04.269 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:04.269 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:04 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:04.269 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:04 smithi130 ceph-mon[84407]: from='client.? 172.21.15.7:0/3548030783' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:18:04.269 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:04.270 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:04.270 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:04.270 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:04.270 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:04 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:04.270 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:04.270 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:04.270 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:04.270 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:04.270 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:04 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:04.270 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:04.270 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:04.270 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:04.270 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:04.271 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:04 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:04.271 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:04.271 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:04.271 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:04.271 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:04 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:04.271 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:04 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:04.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:04.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[113333]: from='client.54619 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:18:04.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[113333]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:18:04.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:04.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:04.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:04.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:04.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:04.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:04.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:04.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:04.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:04.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:04.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:04.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:04.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[113333]: from='client.94587 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:18:04.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:04.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:04.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:04.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:04.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:04.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:04.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:04.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:04.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:04.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:04.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:04.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:04.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:04.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:04.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:04.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[113333]: from='client.? 172.21.15.7:0/3548030783' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:18:04.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:04.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:04.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:04.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:04.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:04.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:04.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:04.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:04.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:04.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:04.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:04.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:04.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:04.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:04.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:04.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:04.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:04.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:04.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:04.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:04.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:04.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[99735]: from='client.54619 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:18:04.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[99735]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:18:04.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:04.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:04.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:04.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:04.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:04.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:04.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:04.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:04.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:04.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:04.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:04.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:04.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[99735]: from='client.94587 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:18:04.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:04.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:04.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:04.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:04.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:04.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:04.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:04.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:04.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:04.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:04.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:04.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:04.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:04.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:04.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:04.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[99735]: from='client.? 172.21.15.7:0/3548030783' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:18:04.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:04.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:04.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:04.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:04.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:04.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:04.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:04.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:04.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:04.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:04.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:04.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:04.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:04.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:04.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:04.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:04.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:04.442 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:04.442 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:04.442 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:04 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:05.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:05 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:05.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:05 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:05.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:05 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:05.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:05 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:05.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:05 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:05.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:05 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:05.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:05 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:05.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:05 smithi130 ceph-mon[84407]: pgmap v374: 161 pgs: 18 peering, 18 active+undersized, 7 active+undersized+degraded, 118 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 36/726 objects degraded (4.959%) 2024-06-18T02:18:05.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:05.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:05.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:05.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:05.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:05 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:05.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:05 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:05.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:05.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:05.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:05.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:05.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:05 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:05.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:05.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:05.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:05.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:05.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:05 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:05.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:05.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:05.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:05.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:05.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:05 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:05.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:05 smithi130 ceph-mon[84407]: Health check update: Degraded data redundancy: 68/726 objects degraded (9.366%), 16 pgs degraded (PG_DEGRADED) 2024-06-18T02:18:05.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:05.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:05.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:05.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:05.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:05 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:05.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:05.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:05.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:05.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:05.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:05 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:05.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:05.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:05.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:05.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:05.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:05 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:05.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:05.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:05.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:05.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:05 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:05.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:05 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:05.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:05.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:05.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:05.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:05.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:05.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:05.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:05.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[113333]: pgmap v374: 161 pgs: 18 peering, 18 active+undersized, 7 active+undersized+degraded, 118 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 36/726 objects degraded (4.959%) 2024-06-18T02:18:05.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:05.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:05.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:05.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:05.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:05.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:05.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:05.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:05.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:05.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:05.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:05.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:05.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:05.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:05.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:05.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:05.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:05.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:05.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:05.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:05.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:05.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:05.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:05.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:05.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:05.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:05.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:05.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:05.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[99735]: pgmap v374: 161 pgs: 18 peering, 18 active+undersized, 7 active+undersized+degraded, 118 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 36/726 objects degraded (4.959%) 2024-06-18T02:18:05.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:05.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:05.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:05.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:05.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:05.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:05.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:05.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:05.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:05.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:05.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:05.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:05.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:05.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:05.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:05.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:05.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:05.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:05.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:05.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:05.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:05.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[99735]: Health check update: Degraded data redundancy: 68/726 objects degraded (9.366%), 16 pgs degraded (PG_DEGRADED) 2024-06-18T02:18:05.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[113333]: Health check update: Degraded data redundancy: 68/726 objects degraded (9.366%), 16 pgs degraded (PG_DEGRADED) 2024-06-18T02:18:05.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:05.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:05.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:05.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:05.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:05.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:05.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:05.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:05.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:05.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:05.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:05.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:05.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:05.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:05.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:05.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:05.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:05.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:05.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:05.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:05.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:05.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:05.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:05.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:05.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:05.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:05.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:05.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:05.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:05.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:05.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:05.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:05.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:05.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:05.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:05.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:05.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:05.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:05.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:05.441 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:05 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:06.278 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:06.278 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:06.278 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:06.278 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:06.278 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:06.278 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:06.278 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:06.278 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:06.279 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:06.279 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:06.279 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:06.279 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:06.279 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:06.279 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:06.279 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:06.279 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:06.279 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:06.279 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:06.279 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:06.279 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:06.279 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:06.279 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:06.280 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:06.280 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:06.280 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:06.280 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:06.280 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:06.280 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:06.280 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:06.280 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:06.280 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:06.280 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:06.280 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:06.281 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:06.281 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:06.281 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:06.281 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:06.281 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:06.281 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:06.281 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:06.281 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:06.281 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:06.281 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:06.281 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:06.281 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:06.281 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:06.282 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:06.282 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:06.282 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:06.282 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:06.282 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:06.282 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:06.282 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:06.282 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:06.282 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:06.282 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:06.282 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:06.282 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:06.282 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:06.282 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:06.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:06.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:06.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:06.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:06.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:06.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:06.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:06.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:06.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:06.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:06.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:06.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:06.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:06.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:06.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:06.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:06.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:06.284 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:06.284 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:06.284 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:06.284 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:06.285 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:06.285 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:06.285 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:06.285 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:06.285 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:06.285 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:06.285 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:06.285 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:06.285 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:06.285 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:06.285 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:06.285 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:06.285 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:06 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:06.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:06 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:06.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:06 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:06.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:06 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:06.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:06 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:06.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:06 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:06.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:06 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:06.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:06 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:06.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:06.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:06.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:06.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:06.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:06 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:06.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:06.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:06.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:06.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:06.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:06 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:06.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:06.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:06.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:06.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:06.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:06 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:06.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:06.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:06.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:06.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:06.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:06 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:06.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:06.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:06.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:06.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:06.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:06 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:06.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:06.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:06.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:06.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:06.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:06 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:06.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:06.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:06.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:06.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:06.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:06 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:06.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:06.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:06.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:06.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:06 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:06.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:06 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:07.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:07 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:07.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:07 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:07.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:07 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:07.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:07 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:07.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:07 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:07.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:07 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:07.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:07 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:07.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:07 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:07.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:07 smithi130 ceph-mon[84407]: pgmap v375: 161 pgs: 18 peering, 5 active+undersized, 3 active+undersized+degraded, 135 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 12/726 objects degraded (1.653%) 2024-06-18T02:18:07.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:07.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:07.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:07.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:07.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:07 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:07.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:07 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:07.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:07.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:07.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:07.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:07.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:07 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:07.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:07.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:07.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:07.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:07.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:07 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:07.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:07.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:07.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:07.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:07.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:07 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:07.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:07.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:07.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:07.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:07.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:07 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:07.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:07.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:07.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:07.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:07.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:07 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:07.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:07.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:07.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:07.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:07.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:07 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:07.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:07.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:07.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:07.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:07.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:07 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:07.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:07.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:07.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:07.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:07.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:07 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:07.309 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:07.309 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:07.309 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:07.309 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:07.309 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:07.309 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:07.309 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:07.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:07.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[113333]: pgmap v375: 161 pgs: 18 peering, 5 active+undersized, 3 active+undersized+degraded, 135 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 12/726 objects degraded (1.653%) 2024-06-18T02:18:07.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:07.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:07.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:07.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:07.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:07.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:07.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:07.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:07.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:07.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:07.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:07.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:07.311 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:07.311 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:07.311 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:07.311 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:07.311 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:07.311 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:07.311 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:07.311 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:07.311 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:07.311 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:07.312 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:07.312 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:07.312 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:07.312 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:07.312 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:07.312 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:07.312 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:07.312 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[99735]: pgmap v375: 161 pgs: 18 peering, 5 active+undersized, 3 active+undersized+degraded, 135 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 12/726 objects degraded (1.653%) 2024-06-18T02:18:07.312 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:07.312 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:07.312 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:07.312 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:07.312 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:07.312 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:07.313 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:07.313 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:07.313 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:07.313 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:07.313 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:07.313 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:07.313 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:07.313 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:07.313 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:07.313 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:07.313 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:07.313 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:07.313 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:07.313 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:07.314 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:07.314 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:07.314 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:07.314 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:07.314 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:07.314 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:07.314 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:07.314 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:07.314 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:07.314 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:07.315 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:07.315 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:07.315 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:07.315 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:07.315 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:07.315 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:07.315 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:07.315 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:07.315 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:07.315 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:07.315 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:07.315 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:07.315 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:07.316 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:07.316 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:07.316 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:07.316 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:07.316 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:07.316 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:07.316 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:07.316 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:07.316 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:07.316 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:07.316 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:07.316 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:07.317 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:07.317 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:07.317 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:07.317 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:07.317 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:07.317 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:07.317 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:07.317 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:07.317 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:07.317 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:07.317 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:07.317 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:07.317 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:07.317 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:07.318 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:07.318 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:07 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:07.949 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:18:07 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:18:07] "GET /metrics HTTP/1.1" 200 38524 "" "Prometheus/2.33.4" 2024-06-18T02:18:08.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:08 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:08.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:08 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:08.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:08 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:08.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:08 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:08.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:08 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:08.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:08 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:08.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:08 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:08.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:08 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:08.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:08.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:08.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:08.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:08.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:08 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:08.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:08 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:08.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:08.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:08.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:08.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:08.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:08 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:08.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:08.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:08.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:08.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:08.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:08 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:08.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:08.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:08.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:08.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:08.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:08 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:08.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:08.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:08.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:08.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:08.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:08 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:08.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:08.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:08.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:08.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:08.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:08 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:08.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:08.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:08.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:08.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:08.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:08 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:08.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:08.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:08.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:08.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:08 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:08.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:08 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:08.421 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:08.421 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:08.422 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:08.422 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:08.422 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:08.422 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:08.422 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:08.422 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:08.422 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:08.422 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:08.422 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:08.422 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:08.422 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:08.422 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:08.423 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:08.423 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:08.423 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:08.423 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:08.423 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:08.423 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:08.423 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:08.423 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:08.423 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:08.423 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:08.423 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:08.423 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:08.423 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:08.423 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:08.424 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:08.424 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:08.424 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:08.424 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:08.424 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:08.424 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:08.424 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:08.424 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:08.424 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:08.425 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:08.425 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:08.425 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:08.425 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:08.425 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:08.425 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:08.425 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:08.425 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:08.425 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:08.425 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:08.425 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:08.426 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:08.426 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:08.426 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:08.426 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:08.426 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:08.426 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:08.426 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:08.426 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:08.426 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:08.426 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:08.427 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:08.427 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:08.427 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:08.427 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:08.427 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:08.427 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:08.427 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:08.427 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:08.427 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:08.427 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:08.428 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:08.428 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:08.428 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:08.428 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:08.428 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:08.428 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:08.428 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:08.428 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:08.428 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:08.428 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:08.428 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:08.428 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:08.429 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:08.429 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:08.429 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:08.429 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:08.429 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:08.429 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:08.429 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:08.429 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:08.429 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:08.429 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:08.429 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:08.429 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:08.430 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:08.430 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:08.430 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:08.430 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:08.430 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:08.430 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:08 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:09.084 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:09 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:09.084 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:09 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:09.084 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:09 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:09.084 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:09 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:09.084 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:09 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:09.085 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:09 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:09.085 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:09 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:09.085 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:09 smithi130 ceph-mon[84407]: pgmap v376: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-06-18T02:18:09.085 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:09.085 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:09.085 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:09.085 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:09.085 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:09 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:09.085 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:09 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:09.085 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:09.085 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:09.085 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:09.085 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:09.086 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:09 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:09.086 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:09.086 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:09.086 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:09.086 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:09.086 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:09 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:09.086 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:09.086 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:09.086 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:09.086 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:09.086 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:09 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:09.086 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:09.086 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:09.087 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:09.087 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:09.087 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:09 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:09.087 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:09.087 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:09.087 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:09.087 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:09.087 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:09 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:09.087 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:09.087 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:09.087 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:09.087 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:09.087 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:09 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:09.087 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:09.088 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:09.088 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:09.088 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:09.088 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:09 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:09.088 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:09 smithi130 ceph-mon[84407]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 12/726 objects degraded (1.653%), 3 pgs degraded) 2024-06-18T02:18:09.088 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:09 smithi130 ceph-mon[84407]: Cluster is now healthy 2024-06-18T02:18:09.088 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:09.088 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:09.088 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:09.088 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:09 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:09.088 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:09 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:09.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:09.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:09.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:09.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:09.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:09.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:09.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:09.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[113333]: pgmap v376: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-06-18T02:18:09.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:09.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:09.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:09.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:09.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:09.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:09.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:09.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:09.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:09.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:09.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:09.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:09.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:09.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:09.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:09.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:09.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:09.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:09.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:09.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:09.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:09.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:09.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:09.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:09.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:09.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:09.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:09.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:09.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:09.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[99735]: pgmap v376: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-06-18T02:18:09.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:09.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:09.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:09.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:09.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:09.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:09.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:09.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:09.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:09.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:09.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:09.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:09.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:09.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:09.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:09.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:09.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:09.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:09.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:09.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:09.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:09.187 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:09.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:09.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:09.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:09.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:09.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:09.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:09.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:09.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:09.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:09.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:09.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:09.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:09.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:09.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:09.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:09.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:09.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:09.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:09.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:09.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[113333]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 12/726 objects degraded (1.653%), 3 pgs degraded) 2024-06-18T02:18:09.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[113333]: Cluster is now healthy 2024-06-18T02:18:09.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:09.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:09.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:09.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:09.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:09.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:09.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:09.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:09.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:09.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:09.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:09.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:09.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:09.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:09.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:09.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:09.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:09.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:09.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:09.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:09.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:09.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:09.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:09.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:09.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[99735]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 12/726 objects degraded (1.653%), 3 pgs degraded) 2024-06-18T02:18:09.190 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[99735]: Cluster is now healthy 2024-06-18T02:18:09.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:09.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:09.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:09.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:09.191 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:09 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:10.358 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:10 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:10.361 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:10 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:10.361 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:10 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:10.361 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:10 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:10.361 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:10 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:10.362 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:10 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:10.362 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:10 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:10.362 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:10 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:10.362 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:10.362 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:10.362 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:10.362 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:10.362 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:10 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:10.362 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:10.362 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:10.362 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:10.362 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:10.363 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:10 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:10.363 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:10.363 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:10.363 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:10.363 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:10.363 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:10 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:10.363 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:10.363 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:10.363 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:10.363 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:10.363 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:10 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:10.363 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:10.363 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:10.363 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:10.363 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:10.363 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:10 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:10.364 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:10 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:10.364 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:10 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:10.364 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:10 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:10.364 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:10.364 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:10.364 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:10.364 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:10.364 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-06-18T02:18:10.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:10.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:10.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:10.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:10.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:10.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:10.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:10.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:10.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:10.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:10.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:10.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:10.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:10.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:10.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:10.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:10.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:10.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:10.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:10.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:10.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:10.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:10.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:10.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:10.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:10.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:10.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:10.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:10.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:10.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:10.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:10.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:10.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:10.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:10.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:10.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:10.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:10.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:10.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:10.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:10.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:10.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:10.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:10.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:10.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:10.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:10.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:10.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:10.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:10.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:10.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:10.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:10.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:10.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:10.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:10.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:10.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:10.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:10.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:10.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:10.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:10.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:10.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:10.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:10.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:10.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:10.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:10.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:10.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:10.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:10.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-06-18T02:18:10.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:10.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:10.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:10.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:10.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:10.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:10.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:10.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:10.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:10.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:10.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-06-18T02:18:11.189 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:11 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:11.189 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:11 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:11.189 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:11 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:11.189 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:11 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:11.190 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:11 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:11.190 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:11 smithi130 ceph-mon[84407]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-06-18T02:18:11.190 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:11 smithi130 ceph-mon[84407]: Upgrade: osd.7 is safe to restart 2024-06-18T02:18:11.190 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:11 smithi130 ceph-mon[84407]: pgmap v377: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:18:11.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:11 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:11.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:11 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:11.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:11 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:11.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:11 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:11.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:11 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:11.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:11 smithi007 ceph-mon[113333]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-06-18T02:18:11.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:11 smithi007 ceph-mon[113333]: Upgrade: osd.7 is safe to restart 2024-06-18T02:18:11.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:11 smithi007 ceph-mon[113333]: pgmap v377: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:18:11.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:11 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:11.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:11 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:11.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:11 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:11.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:11 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:11.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:11 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:11.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:11 smithi007 ceph-mon[99735]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-06-18T02:18:11.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:11 smithi007 ceph-mon[99735]: Upgrade: osd.7 is safe to restart 2024-06-18T02:18:11.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:11 smithi007 ceph-mon[99735]: pgmap v377: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:18:12.466 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:12 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:12.466 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:18:12.466 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:12 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:12.467 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:12 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:12.467 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:12 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:12.467 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:12 smithi130 ceph-mon[84407]: Upgrade: Updating osd.7 2024-06-18T02:18:12.467 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:12 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:12.467 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-06-18T02:18:12.467 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:12.467 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:12 smithi130 ceph-mon[84407]: Deploying daemon osd.7 on smithi130 2024-06-18T02:18:12.467 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:12 smithi130 ceph-mon[84407]: pgmap v378: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-06-18T02:18:12.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:12 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:12.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:18:12.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:12 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:12.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:12 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:12.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:12 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:12.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:12 smithi007 ceph-mon[113333]: Upgrade: Updating osd.7 2024-06-18T02:18:12.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:12 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:12.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-06-18T02:18:12.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:12.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:12 smithi007 ceph-mon[113333]: Deploying daemon osd.7 on smithi130 2024-06-18T02:18:12.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:12 smithi007 ceph-mon[113333]: pgmap v378: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-06-18T02:18:12.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:12 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:12.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:18:12.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:12 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:12.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:12 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:12.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:12 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:12.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:12 smithi007 ceph-mon[99735]: Upgrade: Updating osd.7 2024-06-18T02:18:12.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:12 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:12.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-06-18T02:18:12.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:12.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:12 smithi007 ceph-mon[99735]: Deploying daemon osd.7 on smithi130 2024-06-18T02:18:12.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:12 smithi007 ceph-mon[99735]: pgmap v378: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-06-18T02:18:14.181 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:13 smithi130 ceph-mon[84407]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:18:14.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:13 smithi007 ceph-mon[113333]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:18:14.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:13 smithi007 ceph-mon[99735]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:18:15.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:14 smithi130 ceph-mon[84407]: pgmap v379: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-06-18T02:18:15.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:14 smithi007 ceph-mon[113333]: pgmap v379: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-06-18T02:18:15.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:14 smithi007 ceph-mon[99735]: pgmap v379: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-06-18T02:18:17.427 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:17 smithi130 ceph-mon[84407]: pgmap v380: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:18:17.427 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:17 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:17.428 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:17 smithi130 systemd[1]: Stopping Ceph osd.7 for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:18:17.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:17 smithi007 ceph-mon[113333]: pgmap v380: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:18:17.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:17 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:17.431 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:17 smithi007 ceph-mon[99735]: pgmap v380: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:18:17.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:17 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:17.793 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[39665]: 2024-06-18T02:18:17.427+0000 7f6f9fba9700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-18T02:18:17.793 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[39665]: 2024-06-18T02:18:17.427+0000 7f6f9fba9700 -1 osd.7 185 *** Got signal Terminated *** 2024-06-18T02:18:17.793 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[39665]: 2024-06-18T02:18:17.427+0000 7f6f9fba9700 -1 osd.7 185 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-18T02:18:18.090 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:18:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:18:17] "GET /metrics HTTP/1.1" 200 38521 "" "Prometheus/2.33.4" 2024-06-18T02:18:18.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:18 smithi007 ceph-mon[113333]: osd.7 marked itself down and dead 2024-06-18T02:18:18.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:18 smithi007 ceph-mon[99735]: osd.7 marked itself down and dead 2024-06-18T02:18:18.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:18 smithi130 ceph-mon[84407]: osd.7 marked itself down and dead 2024-06-18T02:18:18.936 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:18 smithi130 podman[141356]: 2024-06-18 02:18:18.644204989 +0000 UTC m=+1.324861584 container died 3688af8b2c46314e3ffc390e65a7084de8cf6fce63e0c983dd39379f167bdc24 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.k8s.display-name=CentOS Stream 8, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, name=centos-stream, RELEASE=HEAD, build-date=2022-05-03T08:36:31.336870, io.buildah.version=1.19.8, ceph=True, vendor=Red Hat, Inc., GIT_REPO=https://github.com/ceph/ceph-container.git, release=754, vcs-type=git, io.openshift.expose-services=, com.redhat.component=centos-stream-container, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.openshift.tags=base centos centos-stream, CEPH_POINT_RELEASE=-17.2.0, distribution-scope=public, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, version=8, architecture=x86_64) 2024-06-18T02:18:19.254 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:19 smithi130 ceph-mon[84407]: pgmap v381: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:18:19.254 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:19 smithi130 ceph-mon[84407]: Health check failed: 1 osds down (OSD_DOWN) 2024-06-18T02:18:19.254 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:19 smithi130 ceph-mon[84407]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-06-18T02:18:19.254 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:19 smithi130 ceph-mon[84407]: osdmap e186: 8 total, 7 up, 8 in 2024-06-18T02:18:19.254 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:19 smithi130 podman[141356]: 2024-06-18 02:18:19.036679603 +0000 UTC m=+1.717336209 container cleanup 3688af8b2c46314e3ffc390e65a7084de8cf6fce63e0c983dd39379f167bdc24 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7, GIT_CLEAN=True, name=centos-stream, io.k8s.display-name=CentOS Stream 8, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_REPO=https://github.com/ceph/ceph-container.git, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, release=754, io.buildah.version=1.19.8, maintainer=Guillaume Abrioux , vendor=Red Hat, Inc., GIT_BRANCH=HEAD, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, distribution-scope=public, architecture=x86_64, com.redhat.component=centos-stream-container, RELEASE=HEAD, ceph=True, vcs-type=git, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, version=8, CEPH_POINT_RELEASE=-17.2.0, io.openshift.tags=base centos centos-stream, build-date=2022-05-03T08:36:31.336870, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.openshift.expose-services=) 2024-06-18T02:18:19.255 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:19 smithi130 bash[141356]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7 2024-06-18T02:18:19.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:19 smithi007 ceph-mon[113333]: pgmap v381: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:18:19.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:19 smithi007 ceph-mon[113333]: Health check failed: 1 osds down (OSD_DOWN) 2024-06-18T02:18:19.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:19 smithi007 ceph-mon[113333]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-06-18T02:18:19.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:19 smithi007 ceph-mon[113333]: osdmap e186: 8 total, 7 up, 8 in 2024-06-18T02:18:19.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:19 smithi007 ceph-mon[99735]: pgmap v381: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:18:19.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:19 smithi007 ceph-mon[99735]: Health check failed: 1 osds down (OSD_DOWN) 2024-06-18T02:18:19.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:19 smithi007 ceph-mon[99735]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-06-18T02:18:19.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:19 smithi007 ceph-mon[99735]: osdmap e186: 8 total, 7 up, 8 in 2024-06-18T02:18:19.543 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:19 smithi130 podman[141372]: 2024-06-18 02:18:19.254711852 +0000 UTC m=+0.609570363 container remove 3688af8b2c46314e3ffc390e65a7084de8cf6fce63e0c983dd39379f167bdc24 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7, build-date=2022-05-03T08:36:31.336870, CEPH_POINT_RELEASE=-17.2.0, distribution-scope=public, GIT_REPO=https://github.com/ceph/ceph-container.git, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_BRANCH=HEAD, vcs-type=git, com.redhat.component=centos-stream-container, io.openshift.expose-services=, release=754, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, version=8, architecture=x86_64, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_CLEAN=True, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, maintainer=Guillaume Abrioux , RELEASE=HEAD, name=centos-stream, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vendor=Red Hat, Inc., ceph=True, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.buildah.version=1.19.8, io.k8s.display-name=CentOS Stream 8, io.openshift.tags=base centos centos-stream) 2024-06-18T02:18:19.933 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:19 smithi130 podman[141462]: 2024-06-18 02:18:19.575370629 +0000 UTC m=+0.017777030 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:18:19.933 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:19 smithi130 podman[141462]: 2024-06-18 02:18:19.692911546 +0000 UTC m=+0.135317947 container create 636d2f8eff6ed09284d09947bb1be189fcc3db3193fdfccf8ecb21373c24bf9b (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7-deactivate, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240612, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-3781e3a, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True) 2024-06-18T02:18:20.210 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:20 smithi130 ceph-mon[84407]: osdmap e187: 8 total, 7 up, 8 in 2024-06-18T02:18:20.210 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:19 smithi130 podman[141462]: 2024-06-18 02:18:19.933855683 +0000 UTC m=+0.376262100 container init 636d2f8eff6ed09284d09947bb1be189fcc3db3193fdfccf8ecb21373c24bf9b (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-3781e3a, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240612) 2024-06-18T02:18:20.210 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:19 smithi130 podman[141462]: 2024-06-18 02:18:19.937831904 +0000 UTC m=+0.380238314 container start 636d2f8eff6ed09284d09947bb1be189fcc3db3193fdfccf8ecb21373c24bf9b (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7-deactivate, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240612, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-3781e3a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.name=CentOS Stream 9 Base Image) 2024-06-18T02:18:20.210 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:20 smithi130 podman[141462]: 2024-06-18 02:18:20.008174137 +0000 UTC m=+0.450580558 container attach 636d2f8eff6ed09284d09947bb1be189fcc3db3193fdfccf8ecb21373c24bf9b (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240612, org.label-schema.vendor=CentOS, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-3781e3a) 2024-06-18T02:18:20.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:20 smithi007 ceph-mon[113333]: osdmap e187: 8 total, 7 up, 8 in 2024-06-18T02:18:20.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:20 smithi007 ceph-mon[99735]: osdmap e187: 8 total, 7 up, 8 in 2024-06-18T02:18:20.520 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:20 smithi130 podman[141462]: 2024-06-18 02:18:20.211275506 +0000 UTC m=+0.653681914 container died 636d2f8eff6ed09284d09947bb1be189fcc3db3193fdfccf8ecb21373c24bf9b (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240612, io.buildah.version=1.36.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-3781e3a, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-06-18T02:18:21.097 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:20 smithi130 podman[141494]: 2024-06-18 02:18:20.795499151 +0000 UTC m=+0.578431464 container remove 636d2f8eff6ed09284d09947bb1be189fcc3db3193fdfccf8ecb21373c24bf9b (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-3781e3a, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.build-date=20240612) 2024-06-18T02:18:21.098 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:20 smithi130 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.7.service: Deactivated successfully. 2024-06-18T02:18:21.098 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:20 smithi130 systemd[1]: Stopped Ceph osd.7 for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:18:21.098 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:20 smithi130 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.7.service: Consumed 14.343s CPU time. 2024-06-18T02:18:21.098 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:21 smithi130 systemd[1]: Starting Ceph osd.7 for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:18:21.418 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:21 smithi130 ceph-mon[84407]: pgmap v384: 161 pgs: 7 active+undersized, 20 stale+active+clean, 5 active+undersized+degraded, 129 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 11/726 objects degraded (1.515%) 2024-06-18T02:18:21.419 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:21 smithi130 ceph-mon[84407]: Health check failed: Degraded data redundancy: 11/726 objects degraded (1.515%), 5 pgs degraded (PG_DEGRADED) 2024-06-18T02:18:21.419 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:21 smithi130 podman[141595]: 2024-06-18 02:18:21.156409544 +0000 UTC m=+0.017711638 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:18:21.419 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:21 smithi130 podman[141595]: 2024-06-18 02:18:21.305191252 +0000 UTC m=+0.166493332 container create 99cf7bfc3954ecc7b5fa82be0349360c7b17605aec5f0a229ca15dcb4b71e7ed (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7-activate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240612, org.label-schema.license=GPLv2, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.36.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3781e3a) 2024-06-18T02:18:21.431 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:21 smithi007 ceph-mon[99735]: pgmap v384: 161 pgs: 7 active+undersized, 20 stale+active+clean, 5 active+undersized+degraded, 129 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 11/726 objects degraded (1.515%) 2024-06-18T02:18:21.431 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:21 smithi007 ceph-mon[99735]: Health check failed: Degraded data redundancy: 11/726 objects degraded (1.515%), 5 pgs degraded (PG_DEGRADED) 2024-06-18T02:18:21.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:21 smithi007 ceph-mon[113333]: pgmap v384: 161 pgs: 7 active+undersized, 20 stale+active+clean, 5 active+undersized+degraded, 129 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 11/726 objects degraded (1.515%) 2024-06-18T02:18:21.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:21 smithi007 ceph-mon[113333]: Health check failed: Degraded data redundancy: 11/726 objects degraded (1.515%), 5 pgs degraded (PG_DEGRADED) 2024-06-18T02:18:21.793 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:21 smithi130 podman[141595]: 2024-06-18 02:18:21.541303084 +0000 UTC m=+0.402605188 container init 99cf7bfc3954ecc7b5fa82be0349360c7b17605aec5f0a229ca15dcb4b71e7ed (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7-activate, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-3781e3a, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240612, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47) 2024-06-18T02:18:21.794 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:21 smithi130 podman[141595]: 2024-06-18 02:18:21.544660958 +0000 UTC m=+0.405963043 container start 99cf7bfc3954ecc7b5fa82be0349360c7b17605aec5f0a229ca15dcb4b71e7ed (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7-activate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240612, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-3781e3a) 2024-06-18T02:18:21.794 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:21 smithi130 podman[141595]: 2024-06-18 02:18:21.607690032 +0000 UTC m=+0.468992120 container attach 99cf7bfc3954ecc7b5fa82be0349360c7b17605aec5f0a229ca15dcb4b71e7ed (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7-activate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_BRANCH=HEAD, org.label-schema.build-date=20240612, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3781e3a) 2024-06-18T02:18:22.294 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:21 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7-activate[141610]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-06-18T02:18:22.294 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:21 smithi130 bash[141595]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-06-18T02:18:22.294 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:21 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7-activate[141610]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-7 --no-mon-config --dev /dev/mapper/vg_nvme-lv_1 2024-06-18T02:18:22.294 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:21 smithi130 bash[141595]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-7 --no-mon-config --dev /dev/mapper/vg_nvme-lv_1 2024-06-18T02:18:22.294 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:21 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7-activate[141610]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_1 2024-06-18T02:18:22.294 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:21 smithi130 bash[141595]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_1 2024-06-18T02:18:22.295 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:21 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7-activate[141610]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-06-18T02:18:22.295 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:21 smithi130 bash[141595]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-06-18T02:18:22.295 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:21 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7-activate[141610]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-7/block 2024-06-18T02:18:22.295 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:21 smithi130 bash[141595]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-7/block 2024-06-18T02:18:22.295 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:21 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7-activate[141610]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-06-18T02:18:22.295 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:21 smithi130 bash[141595]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-06-18T02:18:22.295 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:21 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7-activate[141610]: --> ceph-volume raw activate successful for osd ID: 7 2024-06-18T02:18:22.295 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:21 smithi130 bash[141595]: --> ceph-volume raw activate successful for osd ID: 7 2024-06-18T02:18:22.295 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:21 smithi130 podman[141595]: 2024-06-18 02:18:21.96307503 +0000 UTC m=+0.824377111 container died 99cf7bfc3954ecc7b5fa82be0349360c7b17605aec5f0a229ca15dcb4b71e7ed (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7-activate, org.label-schema.build-date=20240612, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, io.buildah.version=1.36.0, RELEASE=squid-3781e3a, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-06-18T02:18:22.828 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:22 smithi130 podman[141734]: 2024-06-18 02:18:22.578808398 +0000 UTC m=+0.609815787 container remove 99cf7bfc3954ecc7b5fa82be0349360c7b17605aec5f0a229ca15dcb4b71e7ed (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7-activate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240612, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-3781e3a, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-06-18T02:18:22.828 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:22 smithi130 podman[141794]: 2024-06-18 02:18:22.69508551 +0000 UTC m=+0.017478766 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:18:23.080 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:22 smithi130 podman[141794]: 2024-06-18 02:18:22.829961789 +0000 UTC m=+0.152355038 container create 1e7d3da6f4b24edfa4f73ce437d51337689bbd926b27208d91004caf8b98eb11 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-3781e3a, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240612, GIT_BRANCH=HEAD) 2024-06-18T02:18:23.080 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:23 smithi130 podman[141794]: 2024-06-18 02:18:23.057049031 +0000 UTC m=+0.379442285 container init 1e7d3da6f4b24edfa4f73ce437d51337689bbd926b27208d91004caf8b98eb11 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240612, RELEASE=squid-3781e3a, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-06-18T02:18:23.080 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:23 smithi130 podman[141794]: 2024-06-18 02:18:23.060271792 +0000 UTC m=+0.382665041 container start 1e7d3da6f4b24edfa4f73ce437d51337689bbd926b27208d91004caf8b98eb11 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240612, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.vendor=CentOS, RELEASE=squid-3781e3a, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-06-18T02:18:23.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:23 smithi007 ceph-mon[113333]: pgmap v385: 161 pgs: 33 active+undersized, 1 stale+active+clean, 20 active+undersized+degraded, 107 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 71/726 objects degraded (9.780%) 2024-06-18T02:18:23.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:23 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:23.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:23 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:23.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:23 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:23.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:23 smithi007 ceph-mon[99735]: pgmap v385: 161 pgs: 33 active+undersized, 1 stale+active+clean, 20 active+undersized+degraded, 107 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 71/726 objects degraded (9.780%) 2024-06-18T02:18:23.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:23 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:23.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:23 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:23.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:23 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:23.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:23 smithi130 ceph-mon[84407]: pgmap v385: 161 pgs: 33 active+undersized, 1 stale+active+clean, 20 active+undersized+degraded, 107 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 71/726 objects degraded (9.780%) 2024-06-18T02:18:23.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:23 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:23.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:23 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:23.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:23 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:23.544 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:23 smithi130 ceph-osd[141812]: -- 172.21.15.130:0/3051425241 <== mon.2 v2:172.21.15.130:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d01a8cba40 con 0x55d01a8a9c00 2024-06-18T02:18:23.544 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:23 smithi130 bash[141794]: 1e7d3da6f4b24edfa4f73ce437d51337689bbd926b27208d91004caf8b98eb11 2024-06-18T02:18:23.544 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:23 smithi130 systemd[1]: Started Ceph osd.7 for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:18:24.043 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:23 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[141808]: 2024-06-18T02:18:23.600+0000 7f38fcfb9640 -1 Falling back to public interface 2024-06-18T02:18:24.384 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:24 smithi130 ceph-mon[84407]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:18:24.384 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:24 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:24.384 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:24 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:24.384 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:24.384 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:24.384 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:24 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:24.384 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:24.384 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:24.384 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:24.385 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:24.385 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:24 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:24.385 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:24.385 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:24.385 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:24.385 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:24.385 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:24 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:24.385 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:24.385 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:24.385 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:24.385 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:24.385 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:24 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:24.385 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:24.385 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:24.386 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:24.386 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:24.386 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:24 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:24.386 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:24.386 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:24.386 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:24.386 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:24.386 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:24 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:24.386 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:24.386 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:24.386 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:24.386 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:24.386 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:24 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:24.386 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:24.387 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:24.387 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:24.387 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:24 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:24.387 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:24 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:24.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[113333]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:18:24.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:24.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:24.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:24.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:24.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:24.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:24.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:24.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:24.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:24.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:24.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:24.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:24.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:24.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:24.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:24.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:24.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:24.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:24.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:24.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:24.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:24.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:24.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:24.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:24.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:24.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:24.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:24.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:24.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:24.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:24.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:24.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:24.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:24.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:24.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:24.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:24.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:24.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:24.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:24.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:24.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[99735]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:18:24.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:24.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:24.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:24.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:24.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:24.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:24.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:24.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:24.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:24.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:24.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:24.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:24.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:24.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:24.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:24.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:24.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:24.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:24.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:24.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:24.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:24.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:24.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:24.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:24.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:24.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:24.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:24.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:24.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:24.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:24.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:24.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:24.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:24.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:24.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:24.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:24.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:24.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:24.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:24.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:24 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:25.387 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:25 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:25.387 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:25 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:25.387 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:25 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:25.387 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:25 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:25.387 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:25 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:25.387 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:25 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:25.387 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:25 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:25.388 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:25 smithi130 ceph-mon[84407]: pgmap v386: 161 pgs: 40 active+undersized, 26 active+undersized+degraded, 95 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 94/726 objects degraded (12.948%) 2024-06-18T02:18:25.388 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:25 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:25.388 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:25.388 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:25.388 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:25.388 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:25.388 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:25 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:25.388 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:25.388 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:25.388 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:25.388 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:25.388 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:25 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:25.388 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:25.388 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:25.389 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:25.389 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:25.389 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:25 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:25.389 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:25.389 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:25.389 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:25.389 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:25.389 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:25 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:25.389 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:25.389 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:25.389 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:25.389 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:25.389 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:25 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:25.389 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:25.390 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:25.390 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:25.390 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:25.390 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:25 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:25.390 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:25.390 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:25.390 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:25.390 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:25.390 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:25 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:25.390 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:25.390 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:25.390 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:25.390 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:25 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:25.390 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:25 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:25.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:25.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:25.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:25.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:25.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:25.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:25.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:25.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[113333]: pgmap v386: 161 pgs: 40 active+undersized, 26 active+undersized+degraded, 95 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 94/726 objects degraded (12.948%) 2024-06-18T02:18:25.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:25.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:25.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:25.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:25.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:25.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:25.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:25.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:25.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:25.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:25.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:25.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:25.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:25.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:25.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:25.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:25.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:25.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:25.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:25.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:25.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:25.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:25.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:25.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:25.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:25.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:25.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:25.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:25.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:25.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[99735]: pgmap v386: 161 pgs: 40 active+undersized, 26 active+undersized+degraded, 95 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 94/726 objects degraded (12.948%) 2024-06-18T02:18:25.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:25.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:25.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:25.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:25.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:25.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:25.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:25.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:25.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:25.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:25.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:25.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:25.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:25.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:25.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:25.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:25.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:25.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:25.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:25.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:25.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:25.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:25.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:25.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:25.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:25.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:25.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:25.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:25.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:25.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:25.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:25.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:25.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:25.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:25.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:25.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:25.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:25.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:25.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:25.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:25.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:25.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:25.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:25.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:25.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:25.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:25.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:25.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:25.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:25.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:25.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:25.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:25.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:25.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:25.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:25.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:25.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:25.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:25.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:25.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:25 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:26.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:26 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:26.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:26 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:26.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:26 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:26.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:26 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:26.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:26 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:26.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:26 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:26.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:26 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:26.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:26 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:26.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:26.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:26.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:26.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:26.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:26.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:26 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:26.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:26.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:26.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:26.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:26.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:26.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:26.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:26.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:26.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:26.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:26.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:26.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:26.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:26.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:26.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:26.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:26.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:26.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:26.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:26.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:26.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:26.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:26.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:26.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:26.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:26.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:26.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:26.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:26.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:26.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:26.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:26.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:26.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:26.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:26.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:26.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:26.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:26.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:26.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:26.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:26.426 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:26.426 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:26.426 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:26.426 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:26.427 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:26.427 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:26.427 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:26.427 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:26.427 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:26.427 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:26.427 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:26.427 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:26.427 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:26.427 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:26.427 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:26.427 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:26.427 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:26.427 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:26.428 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:26.428 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:26.428 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:26.428 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:26.428 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:26.428 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:26.428 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:26.428 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:26.428 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:26.428 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:26.428 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:26.428 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:26.429 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:26.429 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:26.429 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:26.430 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:26.430 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:26.430 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:26.430 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:26.430 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:26.431 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:26.431 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:26.431 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:26.431 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:26.431 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:26.431 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:26.431 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:26.431 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:26.431 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:26.431 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:26.431 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:26.431 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:26.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:26.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:26.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:26.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:26.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:26.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:26.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:26.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:26.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:26.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:26.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:26.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:26.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:26.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:26.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:26.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:26.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:26.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:26.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:26.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:26.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:26.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:26.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:26.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:26.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:26.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:26.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:26.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:26.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:26.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:26.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:26.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:26.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:26.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:26.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:26.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:26.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:26.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:26.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:26.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:26.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:26.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:26.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:26.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:26.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:26.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:26.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:26.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:26.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:26.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:26.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:26.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:26.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:26.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:26.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:26.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:26.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:26.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:26.602 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:26 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[141808]: 2024-06-18T02:18:26.337+0000 7f38fcfb9640 -1 osd.7 0 read_superblock omap replica is missing. 2024-06-18T02:18:26.603 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:26 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[141808]: 2024-06-18T02:18:26.372+0000 7f38fcfb9640 -1 osd.7 185 log_to_monitors true 2024-06-18T02:18:27.246 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:27 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:27.246 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:27 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:27.246 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:27 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:27.246 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:27 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:27.246 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:27 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:27.246 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:27 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:27.246 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:27 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:27.246 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:27 smithi130 ceph-mon[84407]: pgmap v387: 161 pgs: 40 active+undersized, 26 active+undersized+degraded, 95 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 94/726 objects degraded (12.948%) 2024-06-18T02:18:27.247 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:27 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:27.247 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:27.247 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:27.247 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:27.247 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:27.247 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:27 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:27.247 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:27 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:27.247 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:18:27.247 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:27.247 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:27.247 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:27.247 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:27.247 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:27 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:27.247 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:27 smithi130 ceph-mon[84407]: from='osd.7 [v2:172.21.15.130:6824/242764339,v1:172.21.15.130:6825/242764339]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-18T02:18:27.248 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:27 smithi130 ceph-mon[84407]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-18T02:18:27.248 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:27.248 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:27.248 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:27.248 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:27.248 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:27 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:27.248 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:27.248 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:27.248 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:27.248 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:27.249 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:27 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:27.249 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:27.249 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:27.249 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:27.249 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:27.249 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:27 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:27.249 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:27.249 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:27.249 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:27.249 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:27.249 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:27 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:27.249 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:27.249 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:27.250 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:27.250 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:27.250 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:27 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:27.250 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:27.250 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:27.250 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:27.250 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:27.250 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:27 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:27.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:27.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:27.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:27.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:27.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:27.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:27.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:27.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[99735]: pgmap v387: 161 pgs: 40 active+undersized, 26 active+undersized+degraded, 95 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 94/726 objects degraded (12.948%) 2024-06-18T02:18:27.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:27.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:27.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:27.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:27.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:27.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:27.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:27.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:18:27.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:27.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:27.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:27.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:27.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:27.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[99735]: from='osd.7 [v2:172.21.15.130:6824/242764339,v1:172.21.15.130:6825/242764339]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-18T02:18:27.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[99735]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-18T02:18:27.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:27.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:27.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:27.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:27.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:27.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:27.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:27.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:27.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:27.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:27.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:27.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:27.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:27.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[113333]: pgmap v387: 161 pgs: 40 active+undersized, 26 active+undersized+degraded, 95 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 94/726 objects degraded (12.948%) 2024-06-18T02:18:27.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:27.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:27.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:27.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:27.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:27.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:27.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:27.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:18:27.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:27.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:27.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:27.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:27.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:27.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[113333]: from='osd.7 [v2:172.21.15.130:6824/242764339,v1:172.21.15.130:6825/242764339]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-18T02:18:27.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[113333]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-18T02:18:27.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:27.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:27.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:27.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:27.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:27.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:27.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:27.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:27.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:27.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:27.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:27.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:27.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:27.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:27.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:27.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:27.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:27.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:27.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:27.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:27.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:27.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:27.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:27.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:27.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:27.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:27.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:27.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:27.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:27.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:27.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:27.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:27.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:27.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:27.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:27.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:27.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:27.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:27.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:27.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:27.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:27.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:27.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:27.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:27.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:27.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:27.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:27.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:27.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:27.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:27.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:27.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:27.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:27.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:27 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:27.793 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:27 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[141808]: 2024-06-18T02:18:27.784+0000 7f38f0d5c640 -1 osd.7 185 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-18T02:18:28.106 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:18:27 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:18:27] "GET /metrics HTTP/1.1" 200 38600 "" "Prometheus/2.33.4" 2024-06-18T02:18:28.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:28.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:28.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:28.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:28.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:28.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:28.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:28.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:28.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:28.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:28.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:28.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:28.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:28.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:28.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:28.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:28.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:28.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:28.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[99735]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-06-18T02:18:28.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[99735]: osdmap e188: 8 total, 7 up, 8 in 2024-06-18T02:18:28.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[99735]: from='osd.7 [v2:172.21.15.130:6824/242764339,v1:172.21.15.130:6825/242764339]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:18:28.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[99735]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:18:28.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:28.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:28.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:28.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:28.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:28.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:28.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:28.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:28.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:28.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:28.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[99735]: from='osd.7 ' entity='osd.7' 2024-06-18T02:18:28.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:28.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:28.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:28.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:28.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:28.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:28.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:28.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:28.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:28.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:28.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:28.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:28.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:28.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:28.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:28.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:28.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:28.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:28.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:28.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:28.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:28.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:28.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:28.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:28.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:28.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:28.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:28.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:28.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:28.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:28.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:28.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:28.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:28.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[113333]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-06-18T02:18:28.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[113333]: osdmap e188: 8 total, 7 up, 8 in 2024-06-18T02:18:28.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[113333]: from='osd.7 [v2:172.21.15.130:6824/242764339,v1:172.21.15.130:6825/242764339]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:18:28.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[113333]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:18:28.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:28.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:28.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:28.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:28.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:28.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:28.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:28.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:28.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:28.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:28.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[113333]: from='osd.7 ' entity='osd.7' 2024-06-18T02:18:28.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:28.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:28.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:28.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:28.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:28.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:28.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:28.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:28.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:28.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:28.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:28.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:28.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:28.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:28.439 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:28 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:28.525 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:28 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:28.525 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:28 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:28.525 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:28 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:28.525 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:28 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:28.525 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:28 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:28.525 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:28 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:28.525 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:28 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:28.525 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:28 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:28.525 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:28.525 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:28.525 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:28.526 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:28.526 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:28 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:28.526 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:28.526 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:28.526 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:28.526 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:28.526 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:28 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:28.526 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:28 smithi130 ceph-mon[84407]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-06-18T02:18:28.526 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:28 smithi130 ceph-mon[84407]: osdmap e188: 8 total, 7 up, 8 in 2024-06-18T02:18:28.526 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:28 smithi130 ceph-mon[84407]: from='osd.7 [v2:172.21.15.130:6824/242764339,v1:172.21.15.130:6825/242764339]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:18:28.526 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:28 smithi130 ceph-mon[84407]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:18:28.526 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:28.526 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:28.527 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:28.527 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:28.527 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:28 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:28.527 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:28.527 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:28.527 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:28.527 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:28.527 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:28 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:28.527 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:28 smithi130 ceph-mon[84407]: from='osd.7 ' entity='osd.7' 2024-06-18T02:18:28.528 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:28.528 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:28.528 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:28.528 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:28.528 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:28 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:28.528 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:28.528 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:28.528 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:28.528 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:28.528 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:28 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:28.528 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:28.528 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:28.528 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:28.528 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:28.529 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:28 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:29.359 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:29 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:29.360 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:29 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:29.360 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:29 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:29.360 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:29 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:29.360 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:29 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:29.360 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:29 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:29.360 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:29 smithi130 ceph-mon[84407]: pgmap v389: 161 pgs: 40 active+undersized, 26 active+undersized+degraded, 95 active+clean; 585 KiB data, 367 MiB used, 715 GiB / 715 GiB avail; 94/726 objects degraded (12.948%) 2024-06-18T02:18:29.360 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:29 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:29.360 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:29.360 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:29.360 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:29.360 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:29.360 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:29 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:29.360 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:29.361 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:29.361 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:29.361 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:29.361 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:29 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:29.361 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:29.361 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:29.361 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:29.361 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:29.361 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:29 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:29.361 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:29.361 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:29.361 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:29.361 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:29.362 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:29 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:29.362 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:29.362 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:29.362 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:29.362 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:29.362 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:29 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:29.362 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:29.362 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:29.362 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:29.362 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:29.362 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:29 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:29.362 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:29 smithi130 ceph-mon[84407]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-06-18T02:18:29.362 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:29 smithi130 ceph-mon[84407]: osd.7 [v2:172.21.15.130:6824/242764339,v1:172.21.15.130:6825/242764339] boot 2024-06-18T02:18:29.362 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:29 smithi130 ceph-mon[84407]: osdmap e189: 8 total, 8 up, 8 in 2024-06-18T02:18:29.363 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-18T02:18:29.363 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:29.363 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:29.363 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:29.363 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:29.363 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:29 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:29.363 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:29.363 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:29.363 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:29.363 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:29 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:29.363 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:29 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:29.385 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:29.385 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:29.385 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:29.385 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:29.385 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:29.385 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:29.385 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[113333]: pgmap v389: 161 pgs: 40 active+undersized, 26 active+undersized+degraded, 95 active+clean; 585 KiB data, 367 MiB used, 715 GiB / 715 GiB avail; 94/726 objects degraded (12.948%) 2024-06-18T02:18:29.385 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:29.385 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:29.386 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:29.386 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:29.386 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:29.386 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:29.386 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:29.386 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:29.386 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:29.386 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:29.386 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:29.386 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:29.386 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:29.386 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:29.386 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:29.387 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:29.387 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:29.387 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:29.387 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:29.387 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:29.387 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:29.387 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:29.387 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:29.387 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:29.387 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:29.387 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:29.387 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:29.387 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:29.387 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:29.388 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:29.388 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:29.388 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[113333]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-06-18T02:18:29.388 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[113333]: osd.7 [v2:172.21.15.130:6824/242764339,v1:172.21.15.130:6825/242764339] boot 2024-06-18T02:18:29.388 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[113333]: osdmap e189: 8 total, 8 up, 8 in 2024-06-18T02:18:29.388 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-18T02:18:29.388 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:29.388 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:29.388 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:29.388 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:29.388 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:29.388 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:29.388 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:29.388 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:29.389 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:29.389 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:29.389 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:29.389 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:29.390 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:29.390 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:29.390 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:29.390 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:29.390 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[99735]: pgmap v389: 161 pgs: 40 active+undersized, 26 active+undersized+degraded, 95 active+clean; 585 KiB data, 367 MiB used, 715 GiB / 715 GiB avail; 94/726 objects degraded (12.948%) 2024-06-18T02:18:29.390 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:29.390 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:29.390 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:29.390 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:29.390 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:29.390 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:29.390 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:29.390 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:29.391 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:29.391 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:29.391 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:29.391 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:29.391 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:29.391 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:29.391 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:29.391 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:29.391 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:29.391 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:29.391 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:29.391 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:29.391 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:29.391 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:29.392 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:29.392 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:29.392 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:29.392 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:29.392 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:29.392 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:29.392 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:29.392 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:29.392 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:29.392 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[99735]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-06-18T02:18:29.392 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[99735]: osd.7 [v2:172.21.15.130:6824/242764339,v1:172.21.15.130:6825/242764339] boot 2024-06-18T02:18:29.392 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[99735]: osdmap e189: 8 total, 8 up, 8 in 2024-06-18T02:18:29.392 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-18T02:18:29.393 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:29.393 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:29.393 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:29.393 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:29.393 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:29.393 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:29.393 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:29.393 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:29.393 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:29.393 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:29 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:30.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:30.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:30.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:30.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:30.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:30.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:30.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:30.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:30.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:30.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:30.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:30.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:30.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:30.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:30.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:30.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:30.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:30.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:30.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:30.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:30.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:30.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:30.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:30.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:30.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:30.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:30.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:30.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:30.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:30.184 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[113333]: Health check update: Degraded data redundancy: 94/726 objects degraded (12.948%), 26 pgs degraded (PG_DEGRADED) 2024-06-18T02:18:30.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:30.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:30.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:30.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:30.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:30.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:30.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:30.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:30.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:30.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:30.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:30.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:30.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:30.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:30.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:30.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:30.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:30.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:30.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:30.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:30.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:30.185 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:30.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:30.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:30.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:30.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:30.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:30.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:30.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:30.186 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[99735]: Health check update: Degraded data redundancy: 94/726 objects degraded (12.948%), 26 pgs degraded (PG_DEGRADED) 2024-06-18T02:18:30.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:30.186 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:30.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:30.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:30.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:30.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:30.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:30.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:30.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:30.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:30.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[113333]: osdmap e190: 8 total, 8 up, 8 in 2024-06-18T02:18:30.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:30.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:30.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:30.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:30.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:30.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:30.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:30.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:30.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:30.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:30.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:30.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:30.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:30.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:30.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:30.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:30.188 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:30.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:30.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:30.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:30.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[99735]: osdmap e190: 8 total, 8 up, 8 in 2024-06-18T02:18:30.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:30.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:30.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:30.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:30.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:30.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:30.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:30.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:30.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:30.189 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:30 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:30.466 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:30 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:30.466 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:30 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:30.466 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:30 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:30.466 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:30 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:30.466 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:30 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:30.466 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:30 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:30.466 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:30 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:30.466 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:30 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:30.466 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:30.466 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:30.466 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:30.467 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:30.467 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:30 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:30.467 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:30 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:30.467 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:30.467 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:30.467 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:30.467 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:30.467 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:30 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:30.467 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:30.467 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:30.467 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:30.467 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:30.467 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:30 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:30.467 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:30.468 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:30.468 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:30.468 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:30.468 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:30 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:30.468 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:30 smithi130 ceph-mon[84407]: Health check update: Degraded data redundancy: 94/726 objects degraded (12.948%), 26 pgs degraded (PG_DEGRADED) 2024-06-18T02:18:30.468 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:30.468 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:30.468 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:30.468 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:30.468 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:30 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:30.468 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:30.468 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:30.468 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:30.468 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:30.469 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:30 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:30.469 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:30 smithi130 ceph-mon[84407]: osdmap e190: 8 total, 8 up, 8 in 2024-06-18T02:18:30.469 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:30.469 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:30.469 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:30.469 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:30.469 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:30 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:30.469 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:30.469 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:30.469 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:30.469 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:30 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:30.469 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:30 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:31.398 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:31 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:31.398 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:31 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:31.398 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:31 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:31.398 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:31 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:31.398 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:31 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:31.398 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:31 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:31.398 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:31 smithi130 ceph-mon[84407]: pgmap v392: 161 pgs: 34 active+undersized, 22 active+undersized+degraded, 105 active+clean; 585 KiB data, 367 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 85/726 objects degraded (11.708%) 2024-06-18T02:18:31.398 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:31 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:31.398 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:31.398 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:31.399 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:31.399 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:31.399 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:31 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:31.399 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:31.399 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:31.399 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:31.399 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:31.399 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:31 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:31.399 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:31.399 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:31.399 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:31.399 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:31.399 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:31 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:31.399 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:31.400 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:31.400 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:31.400 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:31.400 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:31 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:31.400 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:31.400 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:31.400 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:31.400 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:31.400 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:31 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:31.400 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:31.400 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:31.400 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:31.400 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:31.400 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:31 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:31.400 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:31.401 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:31.401 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:31.401 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:31.401 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:31 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:31.401 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:31.401 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:31.401 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:31.401 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:31.401 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:31 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:31.401 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:31 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:31.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:31.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:31.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:31.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:31.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:31.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:31.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[113333]: pgmap v392: 161 pgs: 34 active+undersized, 22 active+undersized+degraded, 105 active+clean; 585 KiB data, 367 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 85/726 objects degraded (11.708%) 2024-06-18T02:18:31.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:31.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:31.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:31.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:31.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:31.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:31.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:31.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:31.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:31.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:31.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:31.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:31.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:31.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:31.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:31.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:31.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:31.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:31.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:31.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:31.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:31.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:31.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:31.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:31.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:31.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:31.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:31.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:31.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[99735]: pgmap v392: 161 pgs: 34 active+undersized, 22 active+undersized+degraded, 105 active+clean; 585 KiB data, 367 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 85/726 objects degraded (11.708%) 2024-06-18T02:18:31.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:31.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:31.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:31.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:31.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:31.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:31.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:31.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:31.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:31.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:31.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:31.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:31.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:31.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:31.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:31.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:31.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:31.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:31.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:31.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:31.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:31.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:31.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:31.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:31.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:31.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:31.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:31.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:31.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:31.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:31.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:31.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:31.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:31.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:31.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:31.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:31.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:31.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:31.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:31.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:31.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:31.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:31.437 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:31.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:31.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:31.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:31.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:31.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:31.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:31.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:31.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:31.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:31.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:31.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:31.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:31.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:31.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:31.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:31.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:31.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:31.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:31.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:31 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:32.371 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:32.371 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:32.371 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:32.371 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:32.371 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:32.371 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:32.371 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:32.371 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:32.372 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:32.372 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:32.372 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:32.372 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:32.372 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:32.372 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:32.372 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:32.372 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:32.372 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:32.372 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:32.373 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:32.373 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:32.373 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:32.373 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:32.373 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:32.373 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:32.373 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:32.373 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:32.373 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:32.373 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:32.373 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:32.373 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:32.374 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:32.374 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:32.374 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:32.374 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:32.374 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:32.374 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:32.374 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:32.374 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:32.374 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:32.374 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:32.374 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:32.374 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:32.375 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:32.375 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:32.375 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:32.375 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:32.375 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:32.375 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:32.375 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:32.375 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:32.375 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:32.375 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:32.375 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:32.375 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:32.375 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:32.376 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:32.376 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:32.376 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:32.376 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:32.376 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:32.376 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:32.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:32.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:32.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:32.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:32.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:32.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:32.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:32.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:32.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:32.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:32.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:32.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:32.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:32.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:32.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:32.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:32.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:32.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:32.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:32.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:32.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-06-18T02:18:32.379 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:32.379 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:32.379 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:32.379 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:32.379 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:32.379 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:32.379 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:32.379 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:32.379 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:32.379 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:32.379 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:32.379 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:32.380 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:32.380 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:32.380 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:32.380 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:32.380 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:32.380 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:32.380 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:32.380 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:32 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-06-18T02:18:32.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:32 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:32.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:32 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:32.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:32 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:32.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:32 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:32.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:32 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:32.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:32 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:32.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:32 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:32.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:32 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:32.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:32.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:32.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:32.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:32 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:32.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:32 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:32.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:32.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:32.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:32.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:32.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:32 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:32.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:32.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:32.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:32.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:32.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:32 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:32.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:32.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:32.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:32.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:32.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:32 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:32.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:32.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:32.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:32.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:32.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:32 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:32.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:32.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:32.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:32.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:32.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:32 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:32.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:32.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:32.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:32.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:32 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:32.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:32.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:32 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:32.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:32 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:32.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:32 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:32.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:32.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:32.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:32.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:32.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:32 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-06-18T02:18:33.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:33 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:33.422 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:33 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:33.422 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:33 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:33.422 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:33 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:33.422 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:33 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:33.423 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:33 smithi130 ceph-mon[84407]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-06-18T02:18:33.423 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:33 smithi130 ceph-mon[84407]: Upgrade: osd.7 is safe to restart 2024-06-18T02:18:33.423 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:33 smithi130 ceph-mon[84407]: pgmap v393: 161 pgs: 20 active+undersized, 14 active+undersized+degraded, 127 active+clean; 585 KiB data, 368 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 59/726 objects degraded (8.127%) 2024-06-18T02:18:33.431 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:33 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:33.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:33 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:33.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:33 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:33.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:33 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:33.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:33 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:33.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:33 smithi007 ceph-mon[99735]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-06-18T02:18:33.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:33 smithi007 ceph-mon[99735]: Upgrade: osd.7 is safe to restart 2024-06-18T02:18:33.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:33 smithi007 ceph-mon[99735]: pgmap v393: 161 pgs: 20 active+undersized, 14 active+undersized+degraded, 127 active+clean; 585 KiB data, 368 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 59/726 objects degraded (8.127%) 2024-06-18T02:18:33.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:33 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:33.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:33 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:33.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:33 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:33.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:33 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:33.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:33 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:33.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:33 smithi007 ceph-mon[113333]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-06-18T02:18:33.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:33 smithi007 ceph-mon[113333]: Upgrade: osd.7 is safe to restart 2024-06-18T02:18:33.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:33 smithi007 ceph-mon[113333]: pgmap v393: 161 pgs: 20 active+undersized, 14 active+undersized+degraded, 127 active+clean; 585 KiB data, 368 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 59/726 objects degraded (8.127%) 2024-06-18T02:18:33.901 INFO:teuthology.orchestra.run.smithi007.stdout:true 2024-06-18T02:18:34.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:34 smithi007 ceph-mon[113333]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:18:34.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:34 smithi007 ceph-mon[99735]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:18:34.187 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:34 smithi130 ceph-mon[84407]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:18:34.583 INFO:teuthology.orchestra.run.smithi007.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-18T02:18:34.583 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi007 smithi007 running 12s ago 21m - - 2024-06-18T02:18:34.583 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi130 smithi130 running 2s ago 21m - - 2024-06-18T02:18:34.583 INFO:teuthology.orchestra.run.smithi007.stdout:alertmanager.a smithi007 *:9093,9094 running (11m) 12s ago 16m 24.0M - 0.23.0 ba2b418f427c 5994e8525c64 2024-06-18T02:18:34.584 INFO:teuthology.orchestra.run.smithi007.stdout:grafana.a smithi130 *:3000 running (11m) 2s ago 16m 49.8M - 8.3.5 dad864ee21e9 70ba81d97c8e 2024-06-18T02:18:34.584 INFO:teuthology.orchestra.run.smithi007.stdout:iscsi.foo.smithi007.xvdrwd smithi007 running (9m) 12s ago 14m 64.0M - 3.5 e1d6a67b021e 94121ad2702c 2024-06-18T02:18:34.584 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.x smithi130 *:8443,9283,8765 running (10m) 2s ago 20m 536M - 19.0.0-3124-g3781e3a5 af93c036e016 01017e37bdbe 2024-06-18T02:18:34.584 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.y smithi007 *:8443,9283,8765 running (8m) 12s ago 22m 444M - 19.0.0-3124-g3781e3a5 af93c036e016 2141e131e896 2024-06-18T02:18:34.584 INFO:teuthology.orchestra.run.smithi007.stdout:mon.a smithi007 running (6m) 12s ago 22m 65.9M 2048M 19.0.0-3124-g3781e3a5 af93c036e016 7bbe646cd5b7 2024-06-18T02:18:34.584 INFO:teuthology.orchestra.run.smithi007.stdout:mon.b smithi130 running (7m) 2s ago 21m 61.5M 2048M 19.0.0-3124-g3781e3a5 af93c036e016 baacf2add994 2024-06-18T02:18:34.584 INFO:teuthology.orchestra.run.smithi007.stdout:mon.c smithi007 running (8m) 12s ago 21m 63.6M 2048M 19.0.0-3124-g3781e3a5 af93c036e016 39418356156e 2024-06-18T02:18:34.584 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.a smithi007 *:9100 running (11m) 12s ago 16m 18.5M - 1.3.1 1dbe0e931976 8128e558f099 2024-06-18T02:18:34.584 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.b smithi130 *:9100 running (11m) 2s ago 16m 19.5M - 1.3.1 1dbe0e931976 bab93b43cf16 2024-06-18T02:18:34.584 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0 smithi007 running (5m) 12s ago 20m 56.1M 4096M 19.0.0-3124-g3781e3a5 af93c036e016 07c7f4afd49a 2024-06-18T02:18:34.584 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1 smithi007 running (4m) 12s ago 20m 54.7M 4096M 19.0.0-3124-g3781e3a5 af93c036e016 e8d184614e94 2024-06-18T02:18:34.584 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2 smithi007 running (4m) 12s ago 19m 48.1M 4096M 19.0.0-3124-g3781e3a5 af93c036e016 7d9a05b4bfa5 2024-06-18T02:18:34.584 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3 smithi007 running (3m) 12s ago 19m 56.1M 4096M 19.0.0-3124-g3781e3a5 af93c036e016 7e879cda3b51 2024-06-18T02:18:34.585 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4 smithi130 running (112s) 2s ago 19m 55.9M 4096M 19.0.0-3124-g3781e3a5 af93c036e016 24f46c456c31 2024-06-18T02:18:34.585 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5 smithi130 running (83s) 2s ago 18m 55.0M 4096M 19.0.0-3124-g3781e3a5 af93c036e016 210471d14700 2024-06-18T02:18:34.585 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6 smithi130 running (39s) 2s ago 18m 50.2M 4096M 19.0.0-3124-g3781e3a5 af93c036e016 eb813977281a 2024-06-18T02:18:34.585 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7 smithi130 running (17m) 2s ago 17m 66.0M 4096M 17.2.0 e1d6a67b021e 3688af8b2c46 2024-06-18T02:18:34.585 INFO:teuthology.orchestra.run.smithi007.stdout:prometheus.a smithi130 *:9095 running (10m) 2s ago 17m 75.9M - 2.33.4 514e6a882f6e e905fb2eb4a6 2024-06-18T02:18:34.585 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi007.dvbvbk smithi007 *:8000 running (15m) 12s ago 15m 79.1M - 17.2.0 e1d6a67b021e 1344b55b763c 2024-06-18T02:18:34.585 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi130.aakmof smithi130 *:8000 running (15m) 2s ago 15m 76.8M - 17.2.0 e1d6a67b021e e257e3230c6c 2024-06-18T02:18:34.585 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi007.hgrnmk smithi007 *:80 running (15m) 12s ago 15m 76.9M - 17.2.0 e1d6a67b021e 2173947bc4d6 2024-06-18T02:18:34.585 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi130.wwebfk smithi130 *:80 running (15m) 2s ago 15m 78.7M - 17.2.0 e1d6a67b021e 8662706b2231 2024-06-18T02:18:34.996 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:18:34.996 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": { 2024-06-18T02:18:34.996 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 3 2024-06-18T02:18:34.996 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:18:34.996 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": { 2024-06-18T02:18:34.996 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 2 2024-06-18T02:18:34.997 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:18:34.997 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": { 2024-06-18T02:18:34.997 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 8 2024-06-18T02:18:34.997 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:18:34.997 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw": { 2024-06-18T02:18:34.997 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-06-18T02:18:34.997 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:18:34.997 INFO:teuthology.orchestra.run.smithi007.stdout: "overall": { 2024-06-18T02:18:34.997 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4, 2024-06-18T02:18:34.997 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 13 2024-06-18T02:18:34.997 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-06-18T02:18:34.997 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:18:35.346 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:18:35.347 INFO:teuthology.orchestra.run.smithi007.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00", 2024-06-18T02:18:35.347 INFO:teuthology.orchestra.run.smithi007.stdout: "in_progress": true, 2024-06-18T02:18:35.347 INFO:teuthology.orchestra.run.smithi007.stdout: "which": "Upgrading all daemon types on all hosts", 2024-06-18T02:18:35.347 INFO:teuthology.orchestra.run.smithi007.stdout: "services_complete": [ 2024-06-18T02:18:35.347 INFO:teuthology.orchestra.run.smithi007.stdout: "mon", 2024-06-18T02:18:35.347 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr" 2024-06-18T02:18:35.347 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-06-18T02:18:35.347 INFO:teuthology.orchestra.run.smithi007.stdout: "progress": "12/23 daemons upgraded", 2024-06-18T02:18:35.347 INFO:teuthology.orchestra.run.smithi007.stdout: "message": "Currently upgrading osd daemons", 2024-06-18T02:18:35.347 INFO:teuthology.orchestra.run.smithi007.stdout: "is_paused": false 2024-06-18T02:18:35.347 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:18:35.348 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:35 smithi007 ceph-mon[113333]: from='client.54646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:18:35.348 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:35 smithi007 ceph-mon[113333]: pgmap v394: 161 pgs: 161 active+clean; 585 KiB data, 260 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-06-18T02:18:35.348 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:35 smithi007 ceph-mon[113333]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 59/726 objects degraded (8.127%), 14 pgs degraded) 2024-06-18T02:18:35.348 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:35 smithi007 ceph-mon[113333]: from='client.? 172.21.15.7:0/1714769469' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:35.348 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:35 smithi007 ceph-mon[99735]: from='client.54646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:18:35.348 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:35 smithi007 ceph-mon[99735]: pgmap v394: 161 pgs: 161 active+clean; 585 KiB data, 260 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-06-18T02:18:35.348 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:35 smithi007 ceph-mon[99735]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 59/726 objects degraded (8.127%), 14 pgs degraded) 2024-06-18T02:18:35.348 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:35 smithi007 ceph-mon[99735]: from='client.? 172.21.15.7:0/1714769469' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:35.413 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:35 smithi130 ceph-mon[84407]: from='client.54646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:18:35.413 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:35 smithi130 ceph-mon[84407]: pgmap v394: 161 pgs: 161 active+clean; 585 KiB data, 260 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-06-18T02:18:35.413 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:35 smithi130 ceph-mon[84407]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 59/726 objects degraded (8.127%), 14 pgs degraded) 2024-06-18T02:18:35.413 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:35 smithi130 ceph-mon[84407]: from='client.? 172.21.15.7:0/1714769469' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:35.758 INFO:teuthology.orchestra.run.smithi007.stdout:HEALTH_WARN all OSDs are running squid or later but require_osd_release < squid 2024-06-18T02:18:35.758 INFO:teuthology.orchestra.run.smithi007.stdout:[WRN] OSD_UPGRADE_FINISHED: all OSDs are running squid or later but require_osd_release < squid 2024-06-18T02:18:35.758 INFO:teuthology.orchestra.run.smithi007.stdout: all OSDs are running squid or later but require_osd_release < squid 2024-06-18T02:18:36.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:36 smithi130 ceph-mon[84407]: from='client.54652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:18:36.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:36 smithi130 ceph-mon[84407]: from='client.54658 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:18:36.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-06-18T02:18:36.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:36 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:36.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:36 smithi130 ceph-mon[84407]: from='client.? 172.21.15.7:0/1454926466' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:18:36.431 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:36 smithi007 ceph-mon[99735]: from='client.54652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:18:36.431 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:36 smithi007 ceph-mon[99735]: from='client.54658 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:18:36.431 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-06-18T02:18:36.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:36 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:36.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:36 smithi007 ceph-mon[99735]: from='client.? 172.21.15.7:0/1454926466' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:18:36.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:36 smithi007 ceph-mon[113333]: from='client.54652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:18:36.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:36 smithi007 ceph-mon[113333]: from='client.54658 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:18:36.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-06-18T02:18:36.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:36 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:36.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:36 smithi007 ceph-mon[113333]: from='client.? 172.21.15.7:0/1454926466' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:18:37.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:37 smithi007 ceph-mon[113333]: from='client.94626 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:18:37.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:37 smithi007 ceph-mon[113333]: Upgrade: Updating osd.7 2024-06-18T02:18:37.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:37 smithi007 ceph-mon[113333]: Deploying daemon osd.7 on smithi130 2024-06-18T02:18:37.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:37 smithi007 ceph-mon[113333]: pgmap v395: 161 pgs: 161 active+clean; 585 KiB data, 268 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-06-18T02:18:37.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:37 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:37.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:37 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:37.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:37 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:37.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:37 smithi007 ceph-mon[99735]: from='client.94626 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:18:37.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:37 smithi007 ceph-mon[99735]: Upgrade: Updating osd.7 2024-06-18T02:18:37.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:37 smithi007 ceph-mon[99735]: Deploying daemon osd.7 on smithi130 2024-06-18T02:18:37.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:37 smithi007 ceph-mon[99735]: pgmap v395: 161 pgs: 161 active+clean; 585 KiB data, 268 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-06-18T02:18:37.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:37 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:37.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:37 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:37.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:37 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:37.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:37 smithi130 ceph-mon[84407]: from='client.94626 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:18:37.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:37 smithi130 ceph-mon[84407]: Upgrade: Updating osd.7 2024-06-18T02:18:37.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:37 smithi130 ceph-mon[84407]: Deploying daemon osd.7 on smithi130 2024-06-18T02:18:37.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:37 smithi130 ceph-mon[84407]: pgmap v395: 161 pgs: 161 active+clean; 585 KiB data, 268 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-06-18T02:18:37.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:37 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:37.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:37 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:37.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:37 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:37.854 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:18:37 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:18:37] "GET /metrics HTTP/1.1" 200 38600 "" "Prometheus/2.33.4" 2024-06-18T02:18:39.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:39 smithi130 ceph-mon[84407]: pgmap v396: 161 pgs: 161 active+clean; 585 KiB data, 268 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-06-18T02:18:39.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:39 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:39.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:39 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:39.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:39 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:39.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:39 smithi007 ceph-mon[113333]: pgmap v396: 161 pgs: 161 active+clean; 585 KiB data, 268 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-06-18T02:18:39.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:39 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:39.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:39 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:39.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:39 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:39.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:39 smithi007 ceph-mon[99735]: pgmap v396: 161 pgs: 161 active+clean; 585 KiB data, 268 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-06-18T02:18:39.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:39 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:39.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:39 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:39.433 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:39 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:40.793 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:40 smithi130 systemd[1]: Stopping Ceph osd.7 for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:18:41.130 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:40 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[141808]: 2024-06-18T02:18:40.874+0000 7f38f9f51640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-18T02:18:41.130 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:40 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[141808]: 2024-06-18T02:18:40.874+0000 7f38f9f51640 -1 osd.7 190 *** Got signal Terminated *** 2024-06-18T02:18:41.130 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:40 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[141808]: 2024-06-18T02:18:40.874+0000 7f38f9f51640 -1 osd.7 190 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-18T02:18:41.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:41 smithi007 ceph-mon[113333]: pgmap v397: 161 pgs: 161 active+clean; 585 KiB data, 268 MiB used, 715 GiB / 715 GiB avail; 998 B/s rd, 0 op/s 2024-06-18T02:18:41.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:41 smithi007 ceph-mon[113333]: osd.7 marked itself down and dead 2024-06-18T02:18:41.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:41 smithi007 ceph-mon[99735]: pgmap v397: 161 pgs: 161 active+clean; 585 KiB data, 268 MiB used, 715 GiB / 715 GiB avail; 998 B/s rd, 0 op/s 2024-06-18T02:18:41.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:41 smithi007 ceph-mon[99735]: osd.7 marked itself down and dead 2024-06-18T02:18:41.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:41 smithi130 ceph-mon[84407]: pgmap v397: 161 pgs: 161 active+clean; 585 KiB data, 268 MiB used, 715 GiB / 715 GiB avail; 998 B/s rd, 0 op/s 2024-06-18T02:18:41.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:41 smithi130 ceph-mon[84407]: osd.7 marked itself down and dead 2024-06-18T02:18:41.907 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:41 smithi130 podman[146028]: 2024-06-18 02:18:41.629574178 +0000 UTC m=+0.877883271 container died 1e7d3da6f4b24edfa4f73ce437d51337689bbd926b27208d91004caf8b98eb11 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240612, maintainer=Guillaume Abrioux , RELEASE=squid-3781e3a, io.buildah.version=1.36.0, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-06-18T02:18:42.283 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:42 smithi130 podman[146028]: 2024-06-18 02:18:42.007948469 +0000 UTC m=+1.256257563 container cleanup 1e7d3da6f4b24edfa4f73ce437d51337689bbd926b27208d91004caf8b98eb11 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-3781e3a, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240612, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, CEPH_POINT_RELEASE=) 2024-06-18T02:18:42.284 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:42 smithi130 bash[146028]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7 2024-06-18T02:18:42.284 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:42 smithi130 ceph-mon[84407]: Health check failed: 1 osds down (OSD_DOWN) 2024-06-18T02:18:42.284 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:42 smithi130 ceph-mon[84407]: osdmap e191: 8 total, 7 up, 8 in 2024-06-18T02:18:42.284 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:42 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:42.284 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:18:42.284 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:42 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:42.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:42 smithi007 ceph-mon[99735]: Health check failed: 1 osds down (OSD_DOWN) 2024-06-18T02:18:42.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:42 smithi007 ceph-mon[99735]: osdmap e191: 8 total, 7 up, 8 in 2024-06-18T02:18:42.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:42.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:18:42.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:42.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:42 smithi007 ceph-mon[113333]: Health check failed: 1 osds down (OSD_DOWN) 2024-06-18T02:18:42.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:42 smithi007 ceph-mon[113333]: osdmap e191: 8 total, 7 up, 8 in 2024-06-18T02:18:42.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:42 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:42.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:42 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:18:42.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:42 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:42.543 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:42 smithi130 podman[146045]: 2024-06-18 02:18:42.284748755 +0000 UTC m=+0.651548088 container remove 1e7d3da6f4b24edfa4f73ce437d51337689bbd926b27208d91004caf8b98eb11 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7, org.label-schema.build-date=20240612, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3781e3a, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True) 2024-06-18T02:18:42.895 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:42 smithi130 podman[146134]: 2024-06-18 02:18:42.540753165 +0000 UTC m=+0.017476525 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:18:42.895 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:42 smithi130 podman[146134]: 2024-06-18 02:18:42.644108432 +0000 UTC m=+0.120831820 container create dbf59caf3ca56814f751b5af88a28e69f16af42e067679ec1ea56c1a071ba631 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, CEPH_POINT_RELEASE=, RELEASE=squid-3781e3a, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240612, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_CLEAN=True) 2024-06-18T02:18:42.895 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:42 smithi130 podman[146134]: 2024-06-18 02:18:42.89651758 +0000 UTC m=+0.373240941 container init dbf59caf3ca56814f751b5af88a28e69f16af42e067679ec1ea56c1a071ba631 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.36.0, RELEASE=squid-3781e3a, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_BRANCH=HEAD, org.label-schema.build-date=20240612, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-06-18T02:18:43.159 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:43 smithi130 ceph-mon[84407]: pgmap v399: 161 pgs: 9 peering, 22 stale+active+clean, 130 active+clean; 585 KiB data, 268 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-06-18T02:18:43.160 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:43 smithi130 ceph-mon[84407]: osdmap e192: 8 total, 7 up, 8 in 2024-06-18T02:18:43.160 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:43 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:43.160 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:43 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:43.160 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:43 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:43.160 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:42 smithi130 podman[146134]: 2024-06-18 02:18:42.899834938 +0000 UTC m=+0.376558293 container start dbf59caf3ca56814f751b5af88a28e69f16af42e067679ec1ea56c1a071ba631 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240612, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-3781e3a, maintainer=Guillaume Abrioux , GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, ceph=True) 2024-06-18T02:18:43.160 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:42 smithi130 podman[146134]: 2024-06-18 02:18:42.988316219 +0000 UTC m=+0.465039603 container attach dbf59caf3ca56814f751b5af88a28e69f16af42e067679ec1ea56c1a071ba631 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240612, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3781e3a, io.buildah.version=1.36.0) 2024-06-18T02:18:43.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:43 smithi007 ceph-mon[113333]: pgmap v399: 161 pgs: 9 peering, 22 stale+active+clean, 130 active+clean; 585 KiB data, 268 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-06-18T02:18:43.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:43 smithi007 ceph-mon[113333]: osdmap e192: 8 total, 7 up, 8 in 2024-06-18T02:18:43.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:43 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:43.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:43 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:43.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:43 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:43.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:43 smithi007 ceph-mon[99735]: pgmap v399: 161 pgs: 9 peering, 22 stale+active+clean, 130 active+clean; 585 KiB data, 268 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-06-18T02:18:43.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:43 smithi007 ceph-mon[99735]: osdmap e192: 8 total, 7 up, 8 in 2024-06-18T02:18:43.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:43 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:43.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:43 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:43.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:43 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:43.482 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:43 smithi130 podman[146134]: 2024-06-18 02:18:43.1610865 +0000 UTC m=+0.637809849 container died dbf59caf3ca56814f751b5af88a28e69f16af42e067679ec1ea56c1a071ba631 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, RELEASE=squid-3781e3a, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240612) 2024-06-18T02:18:44.043 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:43 smithi130 podman[146158]: 2024-06-18 02:18:43.783993055 +0000 UTC m=+0.616641764 container remove dbf59caf3ca56814f751b5af88a28e69f16af42e067679ec1ea56c1a071ba631 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.build-date=20240612, RELEASE=squid-3781e3a) 2024-06-18T02:18:44.044 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:43 smithi130 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.7.service: Deactivated successfully. 2024-06-18T02:18:44.044 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:43 smithi130 systemd[1]: Stopped Ceph osd.7 for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:18:44.044 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:43 smithi130 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.7.service: Consumed 2.029s CPU time. 2024-06-18T02:18:44.044 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:44 smithi130 systemd[1]: Starting Ceph osd.7 for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:18:44.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:44 smithi007 ceph-mon[113333]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:18:44.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:44 smithi007 ceph-mon[113333]: pgmap v401: 161 pgs: 7 active+undersized, 9 peering, 21 stale+active+clean, 6 active+undersized+degraded, 118 active+clean; 585 KiB data, 268 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 23/726 objects degraded (3.168%) 2024-06-18T02:18:44.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:44 smithi007 ceph-mon[99735]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:18:44.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:44 smithi007 ceph-mon[99735]: pgmap v401: 161 pgs: 7 active+undersized, 9 peering, 21 stale+active+clean, 6 active+undersized+degraded, 118 active+clean; 585 KiB data, 268 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 23/726 objects degraded (3.168%) 2024-06-18T02:18:44.520 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:44 smithi130 ceph-mon[84407]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:18:44.520 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:44 smithi130 ceph-mon[84407]: pgmap v401: 161 pgs: 7 active+undersized, 9 peering, 21 stale+active+clean, 6 active+undersized+degraded, 118 active+clean; 585 KiB data, 268 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 23/726 objects degraded (3.168%) 2024-06-18T02:18:44.520 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:44 smithi130 podman[146258]: 2024-06-18 02:18:44.128469575 +0000 UTC m=+0.016960020 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:18:44.520 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:44 smithi130 podman[146258]: 2024-06-18 02:18:44.243689836 +0000 UTC m=+0.132180279 container create e1631a61de8b9ebcf993f1a1d1edf8cfbec5053d94ddb054339c2027a476d5b1 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7-activate, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-3781e3a, org.label-schema.build-date=20240612, maintainer=Guillaume Abrioux ) 2024-06-18T02:18:44.793 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:44 smithi130 podman[146258]: 2024-06-18 02:18:44.521407344 +0000 UTC m=+0.409897789 container init e1631a61de8b9ebcf993f1a1d1edf8cfbec5053d94ddb054339c2027a476d5b1 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7-activate, io.buildah.version=1.36.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240612, RELEASE=squid-3781e3a, CEPH_POINT_RELEASE=) 2024-06-18T02:18:44.793 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:44 smithi130 podman[146258]: 2024-06-18 02:18:44.524798836 +0000 UTC m=+0.413289282 container start e1631a61de8b9ebcf993f1a1d1edf8cfbec5053d94ddb054339c2027a476d5b1 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7-activate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240612, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-3781e3a, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0) 2024-06-18T02:18:44.794 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:44 smithi130 podman[146258]: 2024-06-18 02:18:44.613085091 +0000 UTC m=+0.501575547 container attach e1631a61de8b9ebcf993f1a1d1edf8cfbec5053d94ddb054339c2027a476d5b1 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7-activate, RELEASE=squid-3781e3a, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240612, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-06-18T02:18:45.143 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7-activate[146274]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-06-18T02:18:45.144 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:44 smithi130 bash[146258]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-06-18T02:18:45.144 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7-activate[146274]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-7 --no-mon-config --dev /dev/mapper/vg_nvme-lv_1 2024-06-18T02:18:45.144 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:44 smithi130 bash[146258]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-7 --no-mon-config --dev /dev/mapper/vg_nvme-lv_1 2024-06-18T02:18:45.144 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7-activate[146274]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_1 2024-06-18T02:18:45.144 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:44 smithi130 bash[146258]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_1 2024-06-18T02:18:45.144 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7-activate[146274]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-06-18T02:18:45.144 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:44 smithi130 bash[146258]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-06-18T02:18:45.144 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7-activate[146274]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-7/block 2024-06-18T02:18:45.144 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:44 smithi130 bash[146258]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-7/block 2024-06-18T02:18:45.144 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7-activate[146274]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-06-18T02:18:45.144 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:44 smithi130 bash[146258]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-06-18T02:18:45.145 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7-activate[146274]: --> ceph-volume raw activate successful for osd ID: 7 2024-06-18T02:18:45.145 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:44 smithi130 bash[146258]: --> ceph-volume raw activate successful for osd ID: 7 2024-06-18T02:18:45.145 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:44 smithi130 podman[146258]: 2024-06-18 02:18:44.942240529 +0000 UTC m=+0.830730974 container died e1631a61de8b9ebcf993f1a1d1edf8cfbec5053d94ddb054339c2027a476d5b1 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240612, org.label-schema.vendor=CentOS, RELEASE=squid-3781e3a, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.36.0, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-06-18T02:18:45.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:45 smithi007 ceph-mon[113333]: Health check failed: Degraded data redundancy: 23/726 objects degraded (3.168%), 6 pgs degraded (PG_DEGRADED) 2024-06-18T02:18:45.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:45 smithi007 ceph-mon[99735]: Health check failed: Degraded data redundancy: 23/726 objects degraded (3.168%), 6 pgs degraded (PG_DEGRADED) 2024-06-18T02:18:45.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:45 smithi130 ceph-mon[84407]: Health check failed: Degraded data redundancy: 23/726 objects degraded (3.168%), 6 pgs degraded (PG_DEGRADED) 2024-06-18T02:18:45.920 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:45 smithi130 podman[146403]: 2024-06-18 02:18:45.617154487 +0000 UTC m=+0.668187800 container remove e1631a61de8b9ebcf993f1a1d1edf8cfbec5053d94ddb054339c2027a476d5b1 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7-activate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.build-date=20240612, RELEASE=squid-3781e3a, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-06-18T02:18:45.920 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:45 smithi130 podman[146463]: 2024-06-18 02:18:45.826746034 +0000 UTC m=+0.111809003 container create 315f4e6d26b8d91073c7ebf653c5e4032d0cfbd3da071aa518af8ae0ffdf131d (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-3781e3a, org.label-schema.build-date=20240612, GIT_CLEAN=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True) 2024-06-18T02:18:45.920 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:45 smithi130 podman[146463]: 2024-06-18 02:18:45.732360542 +0000 UTC m=+0.017423520 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:18:46.392 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:46 smithi130 ceph-mon[84407]: pgmap v402: 161 pgs: 33 active+undersized, 9 peering, 10 stale+active+clean, 14 active+undersized+degraded, 95 active+clean; 585 KiB data, 268 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 38/726 objects degraded (5.234%) 2024-06-18T02:18:46.392 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:46 smithi130 podman[146463]: 2024-06-18 02:18:46.062563139 +0000 UTC m=+0.347626116 container init 315f4e6d26b8d91073c7ebf653c5e4032d0cfbd3da071aa518af8ae0ffdf131d (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7, org.label-schema.build-date=20240612, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-3781e3a, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-06-18T02:18:46.392 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:46 smithi130 podman[146463]: 2024-06-18 02:18:46.065858927 +0000 UTC m=+0.350921894 container start 315f4e6d26b8d91073c7ebf653c5e4032d0cfbd3da071aa518af8ae0ffdf131d (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-3781e3a, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240612) 2024-06-18T02:18:46.392 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:46 smithi130 ceph-osd[146482]: -- 172.21.15.130:0/2253239902 <== mon.2 v2:172.21.15.130:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d402599a40 con 0x55d402577c00 2024-06-18T02:18:46.392 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:46 smithi130 bash[146463]: 315f4e6d26b8d91073c7ebf653c5e4032d0cfbd3da071aa518af8ae0ffdf131d 2024-06-18T02:18:46.392 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:46 smithi130 systemd[1]: Started Ceph osd.7 for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:18:46.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:46 smithi007 ceph-mon[113333]: pgmap v402: 161 pgs: 33 active+undersized, 9 peering, 10 stale+active+clean, 14 active+undersized+degraded, 95 active+clean; 585 KiB data, 268 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 38/726 objects degraded (5.234%) 2024-06-18T02:18:46.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:46 smithi007 ceph-mon[99735]: pgmap v402: 161 pgs: 33 active+undersized, 9 peering, 10 stale+active+clean, 14 active+undersized+degraded, 95 active+clean; 585 KiB data, 268 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 38/726 objects degraded (5.234%) 2024-06-18T02:18:46.674 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:46 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:18:46.606+0000 7f69d16fd640 -1 Falling back to public interface 2024-06-18T02:18:47.330 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:47.330 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:47.331 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:18:47.331 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:18:47.331 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:18:47.331 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:18:47.331 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:18:47.331 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:18:47.331 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:18:47.331 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:18:47.331 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:18:47.331 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:18:47.331 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:18:47.332 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:18:47.332 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:18:47.332 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:18:47.332 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:18:47.332 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:18:47.332 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: Adjusting osd_memory_target on smithi007 to 2481M 2024-06-18T02:18:47.332 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: Adjusting osd_memory_target on smithi130 to 2736M 2024-06-18T02:18:47.332 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:47.332 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:47.332 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:47.332 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:47.332 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:47.332 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:47.333 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:47.333 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:47.333 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:47.333 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:47.333 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:18:47.333 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:18:47.333 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:18:47.333 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:18:47.333 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:18:47.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:18:47.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:18:47.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:18:47.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:18:47.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:18:47.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:18:47.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:18:47.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:18:47.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:18:47.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:18:47.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:18:47.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: Adjusting osd_memory_target on smithi007 to 2481M 2024-06-18T02:18:47.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: Adjusting osd_memory_target on smithi130 to 2736M 2024-06-18T02:18:47.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:47.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:47.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:47.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:47.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:47.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:47.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:47.335 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:47.335 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:47.336 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:47.336 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:47.336 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:47.336 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:47.336 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:47.336 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:47.336 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:47.336 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:47.336 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:47.336 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:47.336 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:47.336 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:47.336 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:47.337 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:47.337 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:47.337 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:47.337 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:47.337 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:47.337 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:47.337 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:47.337 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:47.337 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:47.337 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:47.337 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:47.337 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:47.337 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:47.338 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:47.338 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:47.338 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:47.338 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:47.338 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:47.338 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:47.338 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:47.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:47.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:47.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:47.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:47.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:47.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:47.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:47.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:47.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:47.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:47.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:47.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:47.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:47.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:47.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:47.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:47.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:47.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:47.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:47.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:47.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:47.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:47.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:47.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:47.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:47.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:47.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:47.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:47.341 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:47.341 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:47.341 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:47.341 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:47.341 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:47.341 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:47.341 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:47.341 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:47.341 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:47.341 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:47.341 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:47.341 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:47.341 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:47.342 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:47.342 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:47.342 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:47.342 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:47.342 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:47.342 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:47.342 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:47.342 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:47.342 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:47.342 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:47.342 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:47.342 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:47.342 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:47.343 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:47.343 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:47 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:47.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:47.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:47.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:18:47.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:18:47.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:18:47.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:18:47.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:18:47.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:18:47.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:18:47.516 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:18:47.516 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:18:47.516 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:18:47.516 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:18:47.516 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:18:47.516 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:18:47.516 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:18:47.516 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:18:47.516 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-18T02:18:47.516 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: Adjusting osd_memory_target on smithi007 to 2481M 2024-06-18T02:18:47.516 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: Adjusting osd_memory_target on smithi130 to 2736M 2024-06-18T02:18:47.516 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:47.516 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:47.516 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:47.516 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:47.517 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:47.517 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:47.517 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:47.517 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:47.517 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:47.517 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:47.517 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:47.517 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:47.517 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:47.517 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:47.517 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:47.517 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:47.517 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:47.518 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:47.518 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:47.518 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:47.518 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:47.518 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:47.518 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:47.518 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:47.518 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:47.518 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:47.518 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:47.518 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:47.518 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:47.518 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:47.519 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:47.519 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:47.519 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:47.519 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:47.519 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:47.519 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:47.519 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:47.519 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:47.519 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:47.519 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:47.519 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:47.519 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:47.519 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:47.520 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:47.520 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:47.520 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:47.520 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:47.520 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:47.520 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:47.520 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:47.520 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:47.520 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:47.520 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:48.215 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:18:47 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:18:47] "GET /metrics HTTP/1.1" 200 38606 "" "Prometheus/2.33.4" 2024-06-18T02:18:48.390 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:48.390 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:48.391 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:48.391 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:48.391 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:48.391 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:48.391 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:48.391 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:48.391 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:48.391 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:48.391 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:48.391 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:48.391 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:48.392 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:48.392 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:48.392 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:48.392 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:48.392 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:48.392 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:48.392 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:48.392 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:48.392 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:48.392 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:48.392 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:48.392 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:48.392 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:48.393 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:48.393 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:48.393 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:48.393 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:48.393 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:48.393 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:48.393 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:48.394 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:48.394 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:48.394 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:48.394 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:48.394 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:48.394 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:48.394 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:48.394 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:48.394 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:48.395 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:48.395 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:48.395 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:48.395 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:48.395 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:48.395 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:48.395 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:48.395 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:48.395 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:48.395 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:48.395 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:48.395 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:48.395 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:48.395 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:48.395 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:48.396 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:48.396 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:48.396 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:48.396 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:48.396 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:48.396 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:48.396 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:48.396 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:48.396 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:48.397 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[99735]: pgmap v403: 161 pgs: 40 active+undersized, 26 active+undersized+degraded, 95 active+clean; 585 KiB data, 268 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 94/726 objects degraded (12.948%) 2024-06-18T02:18:48.397 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:48.397 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:48.397 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:48.397 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:48.397 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:48.397 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:48.397 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:48.397 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:48.397 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:48.397 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:48.397 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:48.397 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:48.398 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:48.398 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:48.398 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:48.398 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:48.398 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:48.398 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:48.398 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:48.398 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[113333]: pgmap v403: 161 pgs: 40 active+undersized, 26 active+undersized+degraded, 95 active+clean; 585 KiB data, 268 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 94/726 objects degraded (12.948%) 2024-06-18T02:18:48.398 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:48.398 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:48.398 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:48.398 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:48.398 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:48.399 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:48.399 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:48.399 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:48.399 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:48.399 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:48.399 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:48 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:48.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:48 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:48.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:48.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:48.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:48.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:48.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:48 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:48.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:48 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:48.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:48.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:48.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:48.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:48.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:48 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:48.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:48 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:48.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:48.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:48.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:48.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:48.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:48 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:48.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:48 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:48.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:48.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:48.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:48.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:48.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:48 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:48.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:48 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:48.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:48.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:48.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:48.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:48.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:48 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:48.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:48 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:48.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:48.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:48.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:48.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:48.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:48 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:48.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:48 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:48.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:48 smithi130 ceph-mon[84407]: pgmap v403: 161 pgs: 40 active+undersized, 26 active+undersized+degraded, 95 active+clean; 585 KiB data, 268 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 94/726 objects degraded (12.948%) 2024-06-18T02:18:48.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:48.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:48.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:48.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:48.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:48 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:48.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:48 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:48.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:48.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:48.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:48.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:48.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:48 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:49.396 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:49 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:49.396 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:49.396 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:49.396 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:49.396 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:49.396 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:49 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:49.396 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:49 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:49.396 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:49.397 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:49.397 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:49.397 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:49.397 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:49 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:49.397 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:49 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:49.397 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:49.397 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:49.397 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:49.397 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:49.397 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:49 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:49.397 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:49 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:49.397 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:49.397 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:49.397 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:49.398 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:49.398 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:49 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:49.398 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:49 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:49.398 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:49.398 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:49.398 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:49.398 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:49.398 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:49 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:49.398 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:49 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:49.398 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:49.398 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:49.398 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:49.398 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:49.398 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:49 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:49.399 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:49 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:49.399 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:49.399 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:49.399 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:49.399 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:49.399 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:49 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:49.399 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:49 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:49.399 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:49.399 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:49.399 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:49.399 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:49 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:49.399 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:49 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:49.399 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:49 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:49.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:49.629 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:49.629 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:49.629 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:49.629 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:49.629 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:49.629 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:49.629 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:49.629 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:49.629 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:49.629 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:49.629 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:49.629 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:49.629 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:49.630 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:49.630 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:49.630 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:49.630 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:49.630 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:49.630 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:49.630 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:49.630 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:49.630 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:49.630 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:49.630 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:49.631 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:49.631 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:49.631 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:49.631 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:49.631 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:49.631 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:49.631 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:49.631 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:49.631 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:49.631 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:49.631 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:49.631 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:49.631 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:49.632 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:49.632 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:49.632 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:49.632 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:49.632 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:49.632 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:49.632 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:49.632 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:49.632 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:49.632 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:49.632 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:49.633 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:49.633 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:49.633 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:49.633 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:49.633 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:49.633 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:49.633 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:49.634 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:49.634 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:49.634 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:49.634 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:49.634 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:49.634 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:49.634 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:49.634 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:49.634 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:49.634 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:49.634 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:49.634 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:49.635 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:49.635 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:49.635 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:49.635 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:49.635 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:49.635 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:49.635 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:49.635 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:49.635 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:49.635 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:49.635 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:49.635 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:49.635 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:49.635 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:49.636 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:49.636 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:49.636 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:49.636 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:49.636 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:49.636 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:49.636 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:49.636 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:49.636 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:49.636 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:49.636 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:49.636 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:49.636 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:49.637 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:49.637 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:49.637 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:49 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:49.700 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:49 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:18:49.395+0000 7f69d16fd640 -1 osd.7 190 log_to_monitors true 2024-06-18T02:18:50.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:50.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:50.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:50.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:50.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:50 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:50.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:50 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:50.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:50.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:50.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:50.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:50.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:50 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:50.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:50 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:50.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:50 smithi130 ceph-mon[84407]: from='osd.7 [v2:172.21.15.130:6824/1239875181,v1:172.21.15.130:6825/1239875181]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-18T02:18:50.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:50 smithi130 ceph-mon[84407]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-18T02:18:50.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:50.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:50.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:50.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:50.295 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:50 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:50.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:50 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:50.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:50 smithi130 ceph-mon[84407]: Health check update: Degraded data redundancy: 94/726 objects degraded (12.948%), 26 pgs degraded (PG_DEGRADED) 2024-06-18T02:18:50.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:50.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:50.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:50.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:50.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:50 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:50.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:50 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:50.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:50.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:50.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:50.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:50.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:50 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:50.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:50 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:50.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:50.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:50.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:50.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:50.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:50 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:50.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:50 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:50.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:50.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:50.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:50.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:50.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:50 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:50.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:50 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:50.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:50 smithi130 ceph-mon[84407]: pgmap v404: 161 pgs: 40 active+undersized, 26 active+undersized+degraded, 95 active+clean; 585 KiB data, 268 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 94/726 objects degraded (12.948%) 2024-06-18T02:18:50.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:50.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:50.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:50.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:50 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:50.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:50 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:50.298 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:50 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:50.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:50.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:50.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:50.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:50.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:50.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:50.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:50.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:50.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:50.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:50.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:50.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:50.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[113333]: from='osd.7 [v2:172.21.15.130:6824/1239875181,v1:172.21.15.130:6825/1239875181]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-18T02:18:50.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[113333]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-18T02:18:50.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:50.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:50.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:50.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:50.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:50.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:50.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[113333]: Health check update: Degraded data redundancy: 94/726 objects degraded (12.948%), 26 pgs degraded (PG_DEGRADED) 2024-06-18T02:18:50.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:50.433 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:50.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:50.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:50.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:50.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:50.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:50.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:50.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:50.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:50.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:50.434 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:50.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:50.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:50.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:50.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:50.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:50.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:50.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:50.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[99735]: from='osd.7 [v2:172.21.15.130:6824/1239875181,v1:172.21.15.130:6825/1239875181]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-18T02:18:50.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[99735]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-18T02:18:50.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:50.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:50.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:50.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:50.435 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:50.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:50.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[99735]: Health check update: Degraded data redundancy: 94/726 objects degraded (12.948%), 26 pgs degraded (PG_DEGRADED) 2024-06-18T02:18:50.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:50.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:50.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:50.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:50.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:50.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:50.436 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:50.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:50.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:50.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:50.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:50.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:50.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:50.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:50.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:50.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:50.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:50.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:50.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:50.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:50.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:50.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:50.437 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:50.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:50.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[113333]: pgmap v404: 161 pgs: 40 active+undersized, 26 active+undersized+degraded, 95 active+clean; 585 KiB data, 268 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 94/726 objects degraded (12.948%) 2024-06-18T02:18:50.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:50.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:50.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:50.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:50.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:50.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:50.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:50.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:50.438 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:50.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:50.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:50.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:50.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:50.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:50.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:50.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:50.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:50.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:50.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:50.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:50.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:50.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:50.439 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:50.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[99735]: pgmap v404: 161 pgs: 40 active+undersized, 26 active+undersized+degraded, 95 active+clean; 585 KiB data, 268 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 94/726 objects degraded (12.948%) 2024-06-18T02:18:50.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:50.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:50.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:50.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:50.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:50.440 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:50 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:50.793 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:18:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:18:50.400+0000 7f69c94a8640 -1 osd.7 190 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-18T02:18:51.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:51.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:51.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:51.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:51.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:51 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:51.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:51 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:51.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:51 smithi130 ceph-mon[84407]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-06-18T02:18:51.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:51 smithi130 ceph-mon[84407]: osdmap e193: 8 total, 7 up, 8 in 2024-06-18T02:18:51.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:51 smithi130 ceph-mon[84407]: from='osd.7 [v2:172.21.15.130:6824/1239875181,v1:172.21.15.130:6825/1239875181]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:18:51.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:51 smithi130 ceph-mon[84407]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:18:51.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:51.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:51.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:51.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:51.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:51 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:51.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:51 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:51.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:51.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:51.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:51.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:51.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:51 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:51.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:51 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:51.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:51.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:51.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:51.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:51.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:51 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:51.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:51 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:51.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:51.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:51.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:51.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:51.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:51 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:51.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:51 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:51.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:51.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:51.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:51.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:51.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:51 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:51.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:51 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:51.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:51.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:51.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:51.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:51.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:51 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:51.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:51 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:51.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:51.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:51.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:51.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:51 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:51.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:51 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:51.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:51.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:51.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:51.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:51.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:51.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:51.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[113333]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-06-18T02:18:51.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[113333]: osdmap e193: 8 total, 7 up, 8 in 2024-06-18T02:18:51.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[113333]: from='osd.7 [v2:172.21.15.130:6824/1239875181,v1:172.21.15.130:6825/1239875181]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:18:51.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[113333]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:18:51.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:51.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:51.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:51.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:51.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:51.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:51.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:51.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:51.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:51.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:51.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:51.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:51.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:51.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:51.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:51.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:51.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:51.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:51.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:51.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:51.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:51.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:51.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:51.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:51.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[99735]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-06-18T02:18:51.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[99735]: osdmap e193: 8 total, 7 up, 8 in 2024-06-18T02:18:51.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[99735]: from='osd.7 [v2:172.21.15.130:6824/1239875181,v1:172.21.15.130:6825/1239875181]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:18:51.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[99735]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-06-18T02:18:51.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:51.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:51.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:51.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:51.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:51.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:51.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:51.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:51.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:51.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:51.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:51.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:51.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:51.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:51.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:51.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:51.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:51.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:51.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:51.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:51.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:51.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:51.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:51.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:51.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:51.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:51.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:51.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:51.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:51.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:51.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:51.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:51.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:51.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:51.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:51.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:51.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:51.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:51.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:51.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:51.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:51.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:51.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:51.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:51.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:51.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:51.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:51.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:51.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:51.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:51.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:51.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:51.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:51.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:51.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:51.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:51.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:51.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:51.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:51.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:51.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:51.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:51.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:51.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:51 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:52.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:52.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:52.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:52.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:52.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:52.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:52.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:52.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-06-18T02:18:52.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: osd.7 [v2:172.21.15.130:6824/1239875181,v1:172.21.15.130:6825/1239875181] boot 2024-06-18T02:18:52.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: osdmap e194: 8 total, 8 up, 8 in 2024-06-18T02:18:52.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:52.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-18T02:18:52.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:52.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:52.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:52.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:52.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:52.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:52.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:52.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:52.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:52.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:52.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:52.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:52.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:52.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:52.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:52.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:52.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:52.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:52.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:52.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:52.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:52.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:52.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:52.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:52.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:52.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:52.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:52.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:52.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:52.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:52.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:52.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:52.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:52.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:52.547 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:52.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: pgmap v407: 161 pgs: 3 peering, 39 active+undersized, 24 active+undersized+degraded, 95 active+clean; 585 KiB data, 268 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 80/726 objects degraded (11.019%) 2024-06-18T02:18:52.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:52.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:52.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:52.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:52.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:52.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:52.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:52.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:52.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:52.548 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:52 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:52.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:52.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:52.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:52.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:52.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:52.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:52.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:52.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-06-18T02:18:52.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: osd.7 [v2:172.21.15.130:6824/1239875181,v1:172.21.15.130:6825/1239875181] boot 2024-06-18T02:18:52.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: osdmap e194: 8 total, 8 up, 8 in 2024-06-18T02:18:52.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:52.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-18T02:18:52.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:52.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:52.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:52.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:52.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:52.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:52.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:52.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:52.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:52.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:52.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:52.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:52.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:52.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:52.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:52.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:52.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:52.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:52.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:52.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:52.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:52.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:52.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:52.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:52.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:52.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-06-18T02:18:52.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: osd.7 [v2:172.21.15.130:6824/1239875181,v1:172.21.15.130:6825/1239875181] boot 2024-06-18T02:18:52.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: osdmap e194: 8 total, 8 up, 8 in 2024-06-18T02:18:52.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:52.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-18T02:18:52.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:52.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:52.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:52.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:52.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:52.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:52.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:52.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:52.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:52.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:52.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:52.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:52.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:52.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:52.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:52.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:52.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:52.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:52.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:52.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:52.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:52.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:52.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:52.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:52.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:52.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:52.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:52.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:52.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:52.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:52.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:52.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:52.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:52.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:52.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:52.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: pgmap v407: 161 pgs: 3 peering, 39 active+undersized, 24 active+undersized+degraded, 95 active+clean; 585 KiB data, 268 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 80/726 objects degraded (11.019%) 2024-06-18T02:18:52.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:52.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:52.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:52.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:52.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:52.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:52.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:52.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:52.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:52.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:52.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:52.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:52.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:52.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:52.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:52.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:52.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:52.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:52.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:52.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:52.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:52.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:52.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:52.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:52.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:52.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:52.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:52.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: pgmap v407: 161 pgs: 3 peering, 39 active+undersized, 24 active+undersized+degraded, 95 active+clean; 585 KiB data, 268 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 80/726 objects degraded (11.019%) 2024-06-18T02:18:52.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:52.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:52.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:52.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:52.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:52.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:52.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:52.691 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:52.691 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:52.691 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:52 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:53.392 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:53 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:53.392 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:53 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:53.392 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:53.392 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:53.392 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:53.392 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:53.392 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:53 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:53.392 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:53 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:53.393 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:53 smithi130 ceph-mon[84407]: osdmap e195: 8 total, 8 up, 8 in 2024-06-18T02:18:53.393 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:53 smithi130 ceph-mon[84407]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:18:53.393 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:53.393 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:53.393 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:53.393 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:53.393 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:53 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:53.393 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:53 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:53.393 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:53.393 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:53.393 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:53.393 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:53.393 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:53 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:53.393 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:53 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:53.393 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:53.394 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:53.394 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:53.394 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:53.394 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:53 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:53.394 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:53 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:53.394 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:53.394 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:53.394 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:53.394 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:53.394 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:53 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:53.394 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:53 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:53.394 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:53.394 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:53.395 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:53.395 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:53.395 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:53 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:53.395 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:53 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:53.395 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:53.395 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:53.395 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:53.395 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:53.395 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:53 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:53.395 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:53 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:53.395 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:53.395 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:53.395 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:53.396 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:53 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:53.396 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:53 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:53.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:53.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:53.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:53.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:53.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:53.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:53.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:53.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:53.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[113333]: osdmap e195: 8 total, 8 up, 8 in 2024-06-18T02:18:53.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[113333]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:18:53.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:53.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:53.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:53.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:53.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:53.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:53.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:53.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:53.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:53.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:53.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:53.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:53.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:53.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:53.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:53.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:53.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:53.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:53.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:53.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:53.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:53.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:53.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:53.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:53.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:53.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:53.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:53.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:53.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[99735]: osdmap e195: 8 total, 8 up, 8 in 2024-06-18T02:18:53.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[99735]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:18:53.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:53.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:53.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:53.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:53.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:53.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:53.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:53.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:53.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:53.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:53.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:53.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:53.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:53.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:53.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:53.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:53.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:53.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:53.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:53.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:53.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:53.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:53.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:53.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:53.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:53.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:53.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:53.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:53.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:53.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:53.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:53.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:53.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:53.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:53.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:53.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:53.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:53.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:53.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:53.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:53.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:53.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:53.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:53.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:53.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:53.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:53.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:53.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:53.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:53.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:53.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:53.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:53.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:53.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:53.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:53.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:53.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:53.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:53.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:53.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:53.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:53.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:53 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:54.542 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:54 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:54.542 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:54.542 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:54.542 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:54.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:54.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:54 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:54.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:54 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:54.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:54.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:54.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:54.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:54.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:54 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:54.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:54 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:54.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:54.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:54.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:54.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:54.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:54 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:54.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:54 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:54.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:54.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:54.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:54.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:54.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:54 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:54.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:54 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:54.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:54.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:54.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:54.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:54.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:54 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:54.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:54 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:54.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:54.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:54.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:54.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:54.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:54 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:54.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:54 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:54.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:54.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:54.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:54.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:54.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:54 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:54.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:54 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:54.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:54 smithi130 ceph-mon[84407]: pgmap v409: 161 pgs: 3 peering, 32 active+undersized, 19 active+undersized+degraded, 107 active+clean; 585 KiB data, 269 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 62/726 objects degraded (8.540%) 2024-06-18T02:18:54.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:54.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:54.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:54.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:54 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:54.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:54 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:54.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:54 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:54.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:54.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:54.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:54.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:54.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:54.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:54.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:54.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:54.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:54.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:54.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:54.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:54.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:54.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:54.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:54.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:54.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:54.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:54.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:54.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:54.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:54.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:54.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:54.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:54.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:54.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:54.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:54.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:54.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:54.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:54.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:54.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:54.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:54.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:54.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:54.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:54.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:54.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:54.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:54.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:54.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:54.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:54.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:54.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:54.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:54.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:54.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:54.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:54.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:54.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:54.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:54.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:54.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:54.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:54.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:54.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:54.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:54.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:54.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:54.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:54.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:54.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:54.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:54.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:54.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:54.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:54.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:54.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:54.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:54.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:54.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:54.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:54.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:54.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[113333]: pgmap v409: 161 pgs: 3 peering, 32 active+undersized, 19 active+undersized+degraded, 107 active+clean; 585 KiB data, 269 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 62/726 objects degraded (8.540%) 2024-06-18T02:18:54.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:54.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:54.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:54.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:54.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:54.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:54.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:54.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:54.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:54.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:54.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:54.691 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:54.691 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:54.691 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:54.691 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:54.691 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:54.691 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:54.691 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:54.691 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:54.691 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[99735]: pgmap v409: 161 pgs: 3 peering, 32 active+undersized, 19 active+undersized+degraded, 107 active+clean; 585 KiB data, 269 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 62/726 objects degraded (8.540%) 2024-06-18T02:18:54.691 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:54.691 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:54.691 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:54.691 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:54.691 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:54.692 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:54 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:55.425 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:55.425 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:55.426 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:55.426 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:55.426 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:55 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:55.426 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:55 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:55.426 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:55.426 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:55.426 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:55.426 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:55.426 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:55 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:55.426 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:55 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:55.426 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:55.426 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:55.427 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:55.427 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:55.427 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:55 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:55.427 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:55 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:55.427 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:55.427 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:55.427 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:55.427 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:55.427 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:55 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:55.427 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:55 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:55.427 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:55 smithi130 ceph-mon[84407]: Health check update: Degraded data redundancy: 80/726 objects degraded (11.019%), 24 pgs degraded (PG_DEGRADED) 2024-06-18T02:18:55.427 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:55.427 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:55.427 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:55.428 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:55.428 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:55 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:55.428 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:55 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:55.428 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:55.428 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:55.428 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:55.428 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:55.428 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:55 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:55.428 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:55 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:55.428 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:55.428 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:55.428 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:55.428 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:55.429 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:55 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:55.429 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:55 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:55.429 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:55.429 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:55.429 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:55.429 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:55.429 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:55 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:55.429 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:55 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:55.429 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:55.429 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:55.429 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:55.429 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:55 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:55.429 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:55 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:55.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:55.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:55.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:55.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:55.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:55.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:55.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:55.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:55.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:55.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:55.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:55.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:55.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:55.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:55.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:55.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:55.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:55.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:55.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:55.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:55.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:55.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:55.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:55.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:55.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[113333]: Health check update: Degraded data redundancy: 80/726 objects degraded (11.019%), 24 pgs degraded (PG_DEGRADED) 2024-06-18T02:18:55.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:55.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:55.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:55.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:55.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:55.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:55.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:55.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:55.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:55.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:55.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:55.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:55.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:55.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:55.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:55.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:55.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:55.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:55.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:55.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:55.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:55.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:55.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:55.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:55.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:55.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:55.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:55.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:55.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[99735]: Health check update: Degraded data redundancy: 80/726 objects degraded (11.019%), 24 pgs degraded (PG_DEGRADED) 2024-06-18T02:18:55.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:55.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:55.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:55.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:55.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:55.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:55.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:55.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:55.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:55.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:55.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:55.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:55.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:55.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:55.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:55.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:55.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:55.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:55.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:55.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:55.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:55.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:55.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:55.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:55.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:55.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:55.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:55.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:55.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:55.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:55.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:55.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:55.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:55.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:55.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:55.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:55.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:55.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:55.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:55.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:55.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:55.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:55.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:55.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:55.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:55.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:55.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:55.691 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:55.691 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:55.691 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:55.691 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:55.691 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:55.691 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:55.691 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:55 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:56.542 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:56 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:56.542 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:56.542 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:56.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:56.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:56.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:56 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:56.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:56 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:56.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:56.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:56.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:56.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:56.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:56 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:56.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:56 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:56.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:56.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:56.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:56.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:56.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:56 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:56.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:56 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:56.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:56.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:56.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:56.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:56.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:56 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:56.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:56 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:56.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:56.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:56.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:56.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:56.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:56 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:56.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:56 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:56.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:56.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:56.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:56.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:56.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:56 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:56.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:56 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:56.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:56.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:56.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:56.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:56.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:56 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:56.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:56 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:56.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:56 smithi130 ceph-mon[84407]: pgmap v410: 161 pgs: 3 peering, 3 active+undersized, 3 active+undersized+degraded, 152 active+clean; 585 KiB data, 273 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 8/726 objects degraded (1.102%) 2024-06-18T02:18:56.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:56.545 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:56.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:56.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:56.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:56 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:56.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:56 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:56.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:56 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:56.546 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:18:56.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:56.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:56.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:56.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:56.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:56.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:56.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:56.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:56.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:56.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:56.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:56.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:56.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:56.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:56.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:56.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:56.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:56.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:56.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:56.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:56.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:56.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:56.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:56.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:56.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:56.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:56.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:56.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:56.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:56.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:56.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:56.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:56.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:56.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:56.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:56.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:56.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:56.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:56.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:56.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:56.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:56.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:56.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:56.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:56.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:56.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:56.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:56.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:56.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:56.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:56.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:56.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:56.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:56.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:56.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:56.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:56.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:56.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:56.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:56.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:56.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:56.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:56.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:56.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:56.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:56.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:56.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:56.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:56.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:56.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:56.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:56.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:56.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[99735]: pgmap v410: 161 pgs: 3 peering, 3 active+undersized, 3 active+undersized+degraded, 152 active+clean; 585 KiB data, 273 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 8/726 objects degraded (1.102%) 2024-06-18T02:18:56.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:56.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:56.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:56.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:56.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:56.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:56.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:56.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:18:56.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:56.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:56.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:56.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:56.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:56.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:56.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:56.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:56.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:56.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:56.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:56.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:56.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:56.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:56.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[113333]: pgmap v410: 161 pgs: 3 peering, 3 active+undersized, 3 active+undersized+degraded, 152 active+clean; 585 KiB data, 273 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 8/726 objects degraded (1.102%) 2024-06-18T02:18:56.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:56.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:56.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:56.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:56.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:56.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:56.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:56.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:18:57.519 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:57.519 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:57.519 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:57.519 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:57.519 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:57 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:57.519 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:57 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:57.519 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:57.519 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:57.519 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:57.520 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:57.520 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:57 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:57.520 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:57 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:57.520 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:57.520 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:57.520 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:57.520 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:57.520 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:57 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:57.520 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:57 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:57.520 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:57.520 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:57.520 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:57.520 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:57.520 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:57 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:57.520 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:57 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:57.521 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:57.521 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:57.521 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:57.521 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:57.521 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:57 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:57.521 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:57 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:57.521 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:57.521 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:57.521 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:57.521 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:57.521 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:57 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:57.521 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:57 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:57.521 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:57.521 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:57.522 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:57.522 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:57.522 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:57 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:57.522 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:57 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:57.522 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:57.522 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:57.522 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:57.522 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:57.522 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:57 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:57.522 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:57 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:57.522 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:57.522 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:57.522 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:57.522 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:57 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:57.523 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:57 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:57.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:57.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:57.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:57.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:57.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:57.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:57.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:57.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:57.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:57.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:57.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:57.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:57.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:57.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:57.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:57.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:57.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:57.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:57.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:57.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:57.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:57.683 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:57.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:57.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:57.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:57.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:57.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:57.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:57.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:57.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:57.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:57.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:57.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:57.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:57.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:57.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:57.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:57.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:57.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:57.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:57.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:57.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:57.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:57.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:57.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:57.685 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:57.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:57.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:57.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:57.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:57.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:57.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:57.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:57.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:57.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:57.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:57.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:57.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:57.686 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:57.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:57.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:57.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:57.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:57.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:57.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:57.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:57.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:57.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:57.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:57.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:57.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:57.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:57.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:57.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:57.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:57.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:57.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:57.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:57.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:57.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:57.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:57.688 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:57.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:57.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:57.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:57.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:57.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:57.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:57.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:57.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:57.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:57.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:57.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:57.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:57.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:57.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:57.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:57.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:57.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:57.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:57.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:57.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:57.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:57.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:57.691 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:57.691 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:57 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:58.043 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:18:57 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:18:57] "GET /metrics HTTP/1.1" 200 38604 "" "Prometheus/2.33.4" 2024-06-18T02:18:58.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:58 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:58.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:58.515 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:58.516 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:58.516 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:58.516 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:58 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:58.516 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:58 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:58.516 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:58.516 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:58.516 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:58.516 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:58.516 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:58 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:58.516 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:58 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:58.516 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:58.516 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:58.516 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:58.516 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:58.516 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:58 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:58.517 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:58 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:58.517 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:58.517 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:58.517 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:58.517 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:58.517 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:58 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:58.517 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:58 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:58.517 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:58.517 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:58.517 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:58.517 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:58.517 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:58 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:58.517 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:58 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:58.517 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:58.517 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:58.518 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:58.518 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:58.518 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:58 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:58.518 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:58 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:58.518 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:58.518 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:58.518 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:58.518 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:58.518 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:58 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:58.518 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:58 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:58.518 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:58 smithi130 ceph-mon[84407]: pgmap v411: 161 pgs: 161 active+clean; 585 KiB data, 273 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-06-18T02:18:58.518 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:58.518 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:58.518 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:58.518 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:58 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:58.519 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:58 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:58.519 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:58 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:58.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:58.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:58.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:58.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:58.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:58.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:58.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:58.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:58.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:58.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:58.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:58.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:58.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:58.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:58.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:58.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:58.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:58.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:58.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:58.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:58.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:58.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:58.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:58.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:58.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:58.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:58.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:58.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:58.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:58.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:58.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:58.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:58.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:58.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:58.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:58.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:58.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:58.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:58.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:58.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:58.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:58.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:58.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:58.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:58.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:58.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:58.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:58.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:58.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:58.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:58.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:58.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:58.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:58.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:58.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:58.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:58.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:58.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:58.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:58.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:58.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:58.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:58.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:58.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:58.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:58.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:58.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:58.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:58.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:58.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:58.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:58.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:58.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:58.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[113333]: pgmap v411: 161 pgs: 161 active+clean; 585 KiB data, 273 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-06-18T02:18:58.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:58.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:58.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:58.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:58.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:58.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:58.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:58.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:58.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:58.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:58.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:58.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:58.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:58.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:58.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:58.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:58.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:58.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:58.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:58.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[99735]: pgmap v411: 161 pgs: 161 active+clean; 585 KiB data, 273 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-06-18T02:18:58.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:58.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:58.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:58.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:58.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:58.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:58 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:59.498 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:59.498 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:59.498 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:59.498 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:59.498 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:59 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:59.498 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:59 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:59.499 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:59.499 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:59.499 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:59.499 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:59.499 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:59 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:59.499 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:59 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:59.499 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:59.499 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:59.499 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:59.499 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:59.499 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:59 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:59.499 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:59 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:59.499 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:59 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:59.499 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:59 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:59.500 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:59 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:59.500 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:59.500 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:59.500 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:59.500 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:59.500 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:59.500 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:59 smithi130 ceph-mon[84407]: Upgrade: Setting container_image for all osd 2024-06-18T02:18:59.500 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:59 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:59.500 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-06-18T02:18:59.500 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:59 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-06-18T02:18:59.500 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:59 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-06-18T02:18:59.500 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-06-18T02:18:59.500 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:59 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-06-18T02:18:59.500 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:59 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-06-18T02:18:59.501 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-06-18T02:18:59.501 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:59 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-06-18T02:18:59.501 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:59 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-06-18T02:18:59.501 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-06-18T02:18:59.501 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:59 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-06-18T02:18:59.501 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:59 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-06-18T02:18:59.501 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-06-18T02:18:59.501 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:59 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-06-18T02:18:59.501 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:59 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-06-18T02:18:59.501 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-06-18T02:18:59.501 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:59 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-06-18T02:18:59.501 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:59 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-06-18T02:18:59.501 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2024-06-18T02:18:59.501 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:59 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2024-06-18T02:18:59.501 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:59 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]': finished 2024-06-18T02:18:59.502 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2024-06-18T02:18:59.502 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:59 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2024-06-18T02:18:59.502 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:59 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]': finished 2024-06-18T02:18:59.502 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:59 smithi130 ceph-mon[84407]: Upgrade: Setting require_osd_release to 19 squid 2024-06-18T02:18:59.502 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:59 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-06-18T02:18:59.502 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:59 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-06-18T02:18:59.502 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:18:59 smithi130 ceph-mon[84407]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 8/726 objects degraded (1.102%), 3 pgs degraded) 2024-06-18T02:18:59.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:59.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:59.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:59.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:59.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:59.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:59.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:59.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:59.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:59.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:59.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:59.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:59.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:59.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:59.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:59.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:59.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:59.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:59.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:59.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:59.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:59.683 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:59.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:59.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:59.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:59.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:59.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[113333]: Upgrade: Setting container_image for all osd 2024-06-18T02:18:59.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:59.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-06-18T02:18:59.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-06-18T02:18:59.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:59.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:59.684 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:59.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:59.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:59.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:59.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:59.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:59.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:59.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:59.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:59.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:59.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:59.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:59.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:18:59.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:18:59.685 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:59.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:18:59.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:59.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:59.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:59.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:18:59.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:59.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:59.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:59.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:18:59.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[99735]: Upgrade: Setting container_image for all osd 2024-06-18T02:18:59.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:18:59.686 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-06-18T02:18:59.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-06-18T02:18:59.687 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-06-18T02:18:59.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-06-18T02:18:59.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-06-18T02:18:59.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-06-18T02:18:59.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-06-18T02:18:59.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-06-18T02:18:59.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-06-18T02:18:59.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-06-18T02:18:59.687 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-06-18T02:18:59.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-06-18T02:18:59.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-06-18T02:18:59.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-06-18T02:18:59.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-06-18T02:18:59.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-06-18T02:18:59.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-06-18T02:18:59.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-06-18T02:18:59.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-06-18T02:18:59.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2024-06-18T02:18:59.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2024-06-18T02:18:59.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]': finished 2024-06-18T02:18:59.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2024-06-18T02:18:59.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2024-06-18T02:18:59.688 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]': finished 2024-06-18T02:18:59.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[113333]: Upgrade: Setting require_osd_release to 19 squid 2024-06-18T02:18:59.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-06-18T02:18:59.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-06-18T02:18:59.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[113333]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 8/726 objects degraded (1.102%), 3 pgs degraded) 2024-06-18T02:18:59.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-06-18T02:18:59.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-06-18T02:18:59.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-06-18T02:18:59.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-06-18T02:18:59.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-06-18T02:18:59.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-06-18T02:18:59.689 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-06-18T02:18:59.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-06-18T02:18:59.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-06-18T02:18:59.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-06-18T02:18:59.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-06-18T02:18:59.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-06-18T02:18:59.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-06-18T02:18:59.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-06-18T02:18:59.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-06-18T02:18:59.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2024-06-18T02:18:59.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2024-06-18T02:18:59.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]': finished 2024-06-18T02:18:59.690 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2024-06-18T02:18:59.691 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2024-06-18T02:18:59.691 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]': finished 2024-06-18T02:18:59.691 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[99735]: Upgrade: Setting require_osd_release to 19 squid 2024-06-18T02:18:59.691 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-06-18T02:18:59.691 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-06-18T02:18:59.691 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:18:59 smithi007 ceph-mon[99735]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 8/726 objects degraded (1.102%), 3 pgs degraded) 2024-06-18T02:19:00.378 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:00 smithi007 ceph-mon[99735]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-06-18T02:19:00.378 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:00 smithi007 ceph-mon[99735]: Cluster is now healthy 2024-06-18T02:19:00.378 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:00 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-06-18T02:19:00.378 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:00 smithi007 ceph-mon[99735]: osdmap e196: 8 total, 8 up, 8 in 2024-06-18T02:19:00.378 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:00 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:19:00.378 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:00 smithi007 ceph-mon[99735]: Upgrade: Setting container_image for all mds 2024-06-18T02:19:00.378 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:00 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:00.378 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:00 smithi007 ceph-mon[99735]: pgmap v413: 161 pgs: 161 active+clean; 585 KiB data, 273 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:19:00.379 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:00 smithi007 ceph-mon[113333]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-06-18T02:19:00.379 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:00 smithi007 ceph-mon[113333]: Cluster is now healthy 2024-06-18T02:19:00.379 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:00 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-06-18T02:19:00.379 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:00 smithi007 ceph-mon[113333]: osdmap e196: 8 total, 8 up, 8 in 2024-06-18T02:19:00.379 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:00 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:19:00.379 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:00 smithi007 ceph-mon[113333]: Upgrade: Setting container_image for all mds 2024-06-18T02:19:00.379 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:00 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:00.379 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:00 smithi007 ceph-mon[113333]: pgmap v413: 161 pgs: 161 active+clean; 585 KiB data, 273 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:19:00.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:00 smithi130 ceph-mon[84407]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-06-18T02:19:00.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:00 smithi130 ceph-mon[84407]: Cluster is now healthy 2024-06-18T02:19:00.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:00 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-06-18T02:19:00.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:00 smithi130 ceph-mon[84407]: osdmap e196: 8 total, 8 up, 8 in 2024-06-18T02:19:00.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:00 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:19:00.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:00 smithi130 ceph-mon[84407]: Upgrade: Setting container_image for all mds 2024-06-18T02:19:00.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:00 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:00.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:00 smithi130 ceph-mon[84407]: pgmap v413: 161 pgs: 161 active+clean; 585 KiB data, 273 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:19:02.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:02 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:02.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:02 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:02.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:02 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:02.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:02 smithi007 ceph-mon[113333]: Upgrade: Updating rgw.foo.smithi007.dvbvbk (1/4) 2024-06-18T02:19:02.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:02 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:02.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi007.dvbvbk", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-06-18T02:19:02.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:02 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi007.dvbvbk", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-06-18T02:19:02.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:02 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:19:02.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:02 smithi007 ceph-mon[113333]: Deploying daemon rgw.foo.smithi007.dvbvbk on smithi007 2024-06-18T02:19:02.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:02 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:02.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:02 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:02.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:02 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:02.183 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:02 smithi007 ceph-mon[113333]: pgmap v414: 161 pgs: 161 active+clean; 585 KiB data, 273 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-06-18T02:19:02.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:02 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:02.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:02 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:02.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:02 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:02.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:02 smithi007 ceph-mon[99735]: Upgrade: Updating rgw.foo.smithi007.dvbvbk (1/4) 2024-06-18T02:19:02.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:02 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:02.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi007.dvbvbk", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-06-18T02:19:02.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:02 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi007.dvbvbk", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-06-18T02:19:02.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:02 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:19:02.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:02 smithi007 ceph-mon[99735]: Deploying daemon rgw.foo.smithi007.dvbvbk on smithi007 2024-06-18T02:19:02.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:02 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:02.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:02 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:02.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:02 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:02.184 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:02 smithi007 ceph-mon[99735]: pgmap v414: 161 pgs: 161 active+clean; 585 KiB data, 273 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-06-18T02:19:02.200 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:02 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:02.200 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:02 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:02.200 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:02 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:02.201 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:02 smithi130 ceph-mon[84407]: Upgrade: Updating rgw.foo.smithi007.dvbvbk (1/4) 2024-06-18T02:19:02.201 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:02 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:02.201 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi007.dvbvbk", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-06-18T02:19:02.201 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:02 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi007.dvbvbk", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-06-18T02:19:02.201 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:02 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:19:02.201 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:02 smithi130 ceph-mon[84407]: Deploying daemon rgw.foo.smithi007.dvbvbk on smithi007 2024-06-18T02:19:02.201 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:02 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:02.201 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:02 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:02.201 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:02 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:02.201 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:02 smithi130 ceph-mon[84407]: pgmap v414: 161 pgs: 161 active+clean; 585 KiB data, 273 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-06-18T02:19:03.893 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:03 smithi007 ceph-mon[113333]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:19:03.893 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:03 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:03.893 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:03 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:03.893 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:03 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:03.894 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:03 smithi007 ceph-mon[99735]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:19:03.894 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:03 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:03.894 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:03 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:03.894 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:03 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:04.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:03 smithi130 ceph-mon[84407]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:19:04.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:03 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:04.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:03 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:04.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:03 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:05.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:04 smithi007 ceph-mon[113333]: pgmap v415: 161 pgs: 161 active+clean; 585 KiB data, 273 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-06-18T02:19:05.041 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:04 smithi007 ceph-mon[99735]: pgmap v415: 161 pgs: 161 active+clean; 585 KiB data, 273 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-06-18T02:19:05.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:04 smithi130 ceph-mon[84407]: pgmap v415: 161 pgs: 161 active+clean; 585 KiB data, 273 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-06-18T02:19:06.131 INFO:teuthology.orchestra.run.smithi007.stdout:true 2024-06-18T02:19:06.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:06 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:06.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:06 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:06.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:06 smithi130 ceph-mon[84407]: pgmap v416: 161 pgs: 161 active+clean; 585 KiB data, 273 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-06-18T02:19:06.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:06 smithi130 ceph-mon[84407]: from='client.94668 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:19:06.825 INFO:teuthology.orchestra.run.smithi007.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-18T02:19:06.825 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi007 smithi007 running 4s ago 22m - - 2024-06-18T02:19:06.825 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi130 smithi130 running 4s ago 22m - - 2024-06-18T02:19:06.826 INFO:teuthology.orchestra.run.smithi007.stdout:alertmanager.a smithi007 *:9093,9094 running (12m) 4s ago 16m 24.0M - 0.23.0 ba2b418f427c 5994e8525c64 2024-06-18T02:19:06.826 INFO:teuthology.orchestra.run.smithi007.stdout:grafana.a smithi130 *:3000 running (11m) 4s ago 16m 49.6M - 8.3.5 dad864ee21e9 70ba81d97c8e 2024-06-18T02:19:06.826 INFO:teuthology.orchestra.run.smithi007.stdout:iscsi.foo.smithi007.xvdrwd smithi007 running (10m) 4s ago 15m 64.1M - 3.5 e1d6a67b021e 94121ad2702c 2024-06-18T02:19:06.826 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.x smithi130 *:8443,9283,8765 running (11m) 4s ago 21m 537M - 19.0.0-3124-g3781e3a5 af93c036e016 01017e37bdbe 2024-06-18T02:19:06.826 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.y smithi007 *:8443,9283,8765 running (9m) 4s ago 23m 445M - 19.0.0-3124-g3781e3a5 af93c036e016 2141e131e896 2024-06-18T02:19:06.826 INFO:teuthology.orchestra.run.smithi007.stdout:mon.a smithi007 running (7m) 4s ago 23m 69.6M 2048M 19.0.0-3124-g3781e3a5 af93c036e016 7bbe646cd5b7 2024-06-18T02:19:06.826 INFO:teuthology.orchestra.run.smithi007.stdout:mon.b smithi130 running (8m) 4s ago 21m 63.6M 2048M 19.0.0-3124-g3781e3a5 af93c036e016 baacf2add994 2024-06-18T02:19:06.826 INFO:teuthology.orchestra.run.smithi007.stdout:mon.c smithi007 running (8m) 4s ago 21m 65.7M 2048M 19.0.0-3124-g3781e3a5 af93c036e016 39418356156e 2024-06-18T02:19:06.826 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.a smithi007 *:9100 running (12m) 4s ago 17m 20.6M - 1.3.1 1dbe0e931976 8128e558f099 2024-06-18T02:19:06.826 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.b smithi130 *:9100 running (11m) 4s ago 17m 16.2M - 1.3.1 1dbe0e931976 bab93b43cf16 2024-06-18T02:19:06.826 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0 smithi007 running (6m) 4s ago 21m 57.3M 2481M 19.0.0-3124-g3781e3a5 af93c036e016 07c7f4afd49a 2024-06-18T02:19:06.826 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1 smithi007 running (5m) 4s ago 20m 55.5M 2481M 19.0.0-3124-g3781e3a5 af93c036e016 e8d184614e94 2024-06-18T02:19:06.826 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2 smithi007 running (4m) 4s ago 20m 50.7M 2481M 19.0.0-3124-g3781e3a5 af93c036e016 7d9a05b4bfa5 2024-06-18T02:19:06.826 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3 smithi007 running (3m) 4s ago 19m 59.7M 2481M 19.0.0-3124-g3781e3a5 af93c036e016 7e879cda3b51 2024-06-18T02:19:06.826 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4 smithi130 running (2m) 4s ago 19m 58.1M 2736M 19.0.0-3124-g3781e3a5 af93c036e016 24f46c456c31 2024-06-18T02:19:06.827 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5 smithi130 running (115s) 4s ago 19m 56.2M 2736M 19.0.0-3124-g3781e3a5 af93c036e016 210471d14700 2024-06-18T02:19:06.827 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6 smithi130 running (71s) 4s ago 18m 52.0M 2736M 19.0.0-3124-g3781e3a5 af93c036e016 eb813977281a 2024-06-18T02:19:06.827 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7 smithi130 running (21s) 4s ago 18m 44.4M 2736M 19.0.0-3124-g3781e3a5 af93c036e016 315f4e6d26b8 2024-06-18T02:19:06.827 INFO:teuthology.orchestra.run.smithi007.stdout:prometheus.a smithi130 *:9095 running (10m) 4s ago 17m 75.9M - 2.33.4 514e6a882f6e e905fb2eb4a6 2024-06-18T02:19:06.827 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi007.dvbvbk smithi007 *:8000 starting - - - - 2024-06-18T02:19:06.827 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi130.aakmof smithi130 *:8000 running (15m) 4s ago 15m 77.1M - 17.2.0 e1d6a67b021e e257e3230c6c 2024-06-18T02:19:06.827 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi007.hgrnmk smithi007 *:80 running (15m) 4s ago 15m 77.2M - 17.2.0 e1d6a67b021e 2173947bc4d6 2024-06-18T02:19:06.827 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi130.wwebfk smithi130 *:80 running (15m) 4s ago 15m 79.1M - 17.2.0 e1d6a67b021e 8662706b2231 2024-06-18T02:19:06.827 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:06 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:06.827 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:06 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:06.827 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:06 smithi007 ceph-mon[113333]: pgmap v416: 161 pgs: 161 active+clean; 585 KiB data, 273 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-06-18T02:19:06.827 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:06 smithi007 ceph-mon[113333]: from='client.94668 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:19:06.828 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:06 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:06.828 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:06 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:06.828 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:06 smithi007 ceph-mon[99735]: pgmap v416: 161 pgs: 161 active+clean; 585 KiB data, 273 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-06-18T02:19:06.828 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:06 smithi007 ceph-mon[99735]: from='client.94668 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:19:07.251 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:19:07.251 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": { 2024-06-18T02:19:07.251 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 3 2024-06-18T02:19:07.252 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:19:07.252 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": { 2024-06-18T02:19:07.252 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 2 2024-06-18T02:19:07.252 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:19:07.252 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": { 2024-06-18T02:19:07.252 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 8 2024-06-18T02:19:07.252 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:19:07.252 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw": { 2024-06-18T02:19:07.252 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3, 2024-06-18T02:19:07.252 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 1 2024-06-18T02:19:07.252 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:19:07.252 INFO:teuthology.orchestra.run.smithi007.stdout: "overall": { 2024-06-18T02:19:07.252 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3, 2024-06-18T02:19:07.252 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 14 2024-06-18T02:19:07.252 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-06-18T02:19:07.253 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:19:07.602 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:19:07.603 INFO:teuthology.orchestra.run.smithi007.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00", 2024-06-18T02:19:07.603 INFO:teuthology.orchestra.run.smithi007.stdout: "in_progress": true, 2024-06-18T02:19:07.603 INFO:teuthology.orchestra.run.smithi007.stdout: "which": "Upgrading all daemon types on all hosts", 2024-06-18T02:19:07.603 INFO:teuthology.orchestra.run.smithi007.stdout: "services_complete": [ 2024-06-18T02:19:07.603 INFO:teuthology.orchestra.run.smithi007.stdout: "mon", 2024-06-18T02:19:07.603 INFO:teuthology.orchestra.run.smithi007.stdout: "osd", 2024-06-18T02:19:07.603 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr" 2024-06-18T02:19:07.603 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-06-18T02:19:07.603 INFO:teuthology.orchestra.run.smithi007.stdout: "progress": "13/23 daemons upgraded", 2024-06-18T02:19:07.603 INFO:teuthology.orchestra.run.smithi007.stdout: "message": "Currently upgrading rgw daemons", 2024-06-18T02:19:07.604 INFO:teuthology.orchestra.run.smithi007.stdout: "is_paused": false 2024-06-18T02:19:07.604 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:19:07.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:07 smithi130 ceph-mon[84407]: from='client.54715 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:19:07.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:07 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:07.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:07 smithi130 ceph-mon[84407]: from='client.54721 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:19:07.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:07 smithi130 ceph-mon[84407]: Upgrade: Updating rgw.smpl.smithi007.hgrnmk (2/4) 2024-06-18T02:19:07.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:07 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:07.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi007.hgrnmk", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-06-18T02:19:07.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:07 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi007.hgrnmk", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-06-18T02:19:07.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:07 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:19:07.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:07 smithi130 ceph-mon[84407]: Deploying daemon rgw.smpl.smithi007.hgrnmk on smithi007 2024-06-18T02:19:07.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:07 smithi130 ceph-mon[84407]: from='client.? 172.21.15.7:0/1282881830' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:19:07.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:07 smithi007 ceph-mon[113333]: from='client.54715 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:19:07.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:07 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:07.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:07 smithi007 ceph-mon[113333]: from='client.54721 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:19:07.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:07 smithi007 ceph-mon[113333]: Upgrade: Updating rgw.smpl.smithi007.hgrnmk (2/4) 2024-06-18T02:19:07.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:07 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:07.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi007.hgrnmk", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-06-18T02:19:07.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:07 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi007.hgrnmk", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-06-18T02:19:07.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:07 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:19:07.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:07 smithi007 ceph-mon[113333]: Deploying daemon rgw.smpl.smithi007.hgrnmk on smithi007 2024-06-18T02:19:07.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:07 smithi007 ceph-mon[113333]: from='client.? 172.21.15.7:0/1282881830' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:19:07.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:07 smithi007 ceph-mon[99735]: from='client.54715 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:19:07.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:07 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:07.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:07 smithi007 ceph-mon[99735]: from='client.54721 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:19:07.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:07 smithi007 ceph-mon[99735]: Upgrade: Updating rgw.smpl.smithi007.hgrnmk (2/4) 2024-06-18T02:19:07.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:07 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:07.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi007.hgrnmk", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-06-18T02:19:07.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:07 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi007.hgrnmk", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-06-18T02:19:07.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:07 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:19:07.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:07 smithi007 ceph-mon[99735]: Deploying daemon rgw.smpl.smithi007.hgrnmk on smithi007 2024-06-18T02:19:07.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:07 smithi007 ceph-mon[99735]: from='client.? 172.21.15.7:0/1282881830' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:19:08.023 INFO:teuthology.orchestra.run.smithi007.stdout:HEALTH_OK 2024-06-18T02:19:08.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:19:07 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:19:07] "GET /metrics HTTP/1.1" 200 38604 "" "Prometheus/2.33.4" 2024-06-18T02:19:08.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:08 smithi130 ceph-mon[84407]: from='client.94692 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:19:08.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:08 smithi130 ceph-mon[84407]: from='client.? 172.21.15.7:0/597801918' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:19:08.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:08 smithi130 ceph-mon[84407]: pgmap v417: 161 pgs: 161 active+clean; 585 KiB data, 273 MiB used, 715 GiB / 715 GiB avail; 45 KiB/s rd, 0 B/s wr, 71 op/s 2024-06-18T02:19:08.868 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:08 smithi007 ceph-mon[113333]: from='client.94692 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:19:08.868 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:08 smithi007 ceph-mon[113333]: from='client.? 172.21.15.7:0/597801918' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:19:08.868 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:08 smithi007 ceph-mon[113333]: pgmap v417: 161 pgs: 161 active+clean; 585 KiB data, 273 MiB used, 715 GiB / 715 GiB avail; 45 KiB/s rd, 0 B/s wr, 71 op/s 2024-06-18T02:19:08.868 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:08 smithi007 ceph-mon[99735]: from='client.94692 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:19:08.868 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:08 smithi007 ceph-mon[99735]: from='client.? 172.21.15.7:0/597801918' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:19:08.868 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:08 smithi007 ceph-mon[99735]: pgmap v417: 161 pgs: 161 active+clean; 585 KiB data, 273 MiB used, 715 GiB / 715 GiB avail; 45 KiB/s rd, 0 B/s wr, 71 op/s 2024-06-18T02:19:11.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:11 smithi007 ceph-mon[99735]: pgmap v418: 161 pgs: 161 active+clean; 585 KiB data, 273 MiB used, 715 GiB / 715 GiB avail; 56 KiB/s rd, 0 B/s wr, 88 op/s 2024-06-18T02:19:11.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:11 smithi007 ceph-mon[113333]: pgmap v418: 161 pgs: 161 active+clean; 585 KiB data, 273 MiB used, 715 GiB / 715 GiB avail; 56 KiB/s rd, 0 B/s wr, 88 op/s 2024-06-18T02:19:11.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:11 smithi130 ceph-mon[84407]: pgmap v418: 161 pgs: 161 active+clean; 585 KiB data, 273 MiB used, 715 GiB / 715 GiB avail; 56 KiB/s rd, 0 B/s wr, 88 op/s 2024-06-18T02:19:12.473 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:12 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:12.473 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:19:12.473 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:12 smithi007 ceph-mon[113333]: pgmap v419: 161 pgs: 161 active+clean; 585 KiB data, 273 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 85 B/s wr, 124 op/s 2024-06-18T02:19:12.473 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:12 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:12.474 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:12 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:12.474 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:12 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:12.474 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:19:12.474 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:12 smithi007 ceph-mon[99735]: pgmap v419: 161 pgs: 161 active+clean; 585 KiB data, 273 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 85 B/s wr, 124 op/s 2024-06-18T02:19:12.474 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:12 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:12.474 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:12 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:12.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:12 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:12.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:19:12.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:12 smithi130 ceph-mon[84407]: pgmap v419: 161 pgs: 161 active+clean; 585 KiB data, 273 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 85 B/s wr, 124 op/s 2024-06-18T02:19:12.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:12 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:12.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:12 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:13.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:13 smithi130 ceph-mon[84407]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:19:13.555 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:13 smithi007 ceph-mon[113333]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:19:13.555 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:13 smithi007 ceph-mon[99735]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:19:14.912 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:14 smithi130 ceph-mon[84407]: Upgrade: Updating rgw.foo.smithi130.aakmof (3/4) 2024-06-18T02:19:14.912 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:14 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:14.912 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi130.aakmof", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-06-18T02:19:14.912 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:14 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi130.aakmof", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-06-18T02:19:14.912 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:14 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:19:14.912 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:14 smithi130 ceph-mon[84407]: Deploying daemon rgw.foo.smithi130.aakmof on smithi130 2024-06-18T02:19:14.912 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:14 smithi130 ceph-mon[84407]: pgmap v420: 161 pgs: 161 active+clean; 585 KiB data, 273 MiB used, 715 GiB / 715 GiB avail; 94 KiB/s rd, 85 B/s wr, 147 op/s 2024-06-18T02:19:14.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:14 smithi007 ceph-mon[113333]: Upgrade: Updating rgw.foo.smithi130.aakmof (3/4) 2024-06-18T02:19:14.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:14 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:14.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi130.aakmof", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-06-18T02:19:14.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:14 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi130.aakmof", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-06-18T02:19:14.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:14 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:19:14.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:14 smithi007 ceph-mon[113333]: Deploying daemon rgw.foo.smithi130.aakmof on smithi130 2024-06-18T02:19:14.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:14 smithi007 ceph-mon[113333]: pgmap v420: 161 pgs: 161 active+clean; 585 KiB data, 273 MiB used, 715 GiB / 715 GiB avail; 94 KiB/s rd, 85 B/s wr, 147 op/s 2024-06-18T02:19:14.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:14 smithi007 ceph-mon[99735]: Upgrade: Updating rgw.foo.smithi130.aakmof (3/4) 2024-06-18T02:19:14.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:14 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:14.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi130.aakmof", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-06-18T02:19:14.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:14 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi130.aakmof", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-06-18T02:19:14.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:14 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:19:14.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:14 smithi007 ceph-mon[99735]: Deploying daemon rgw.foo.smithi130.aakmof on smithi130 2024-06-18T02:19:14.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:14 smithi007 ceph-mon[99735]: pgmap v420: 161 pgs: 161 active+clean; 585 KiB data, 273 MiB used, 715 GiB / 715 GiB avail; 94 KiB/s rd, 85 B/s wr, 147 op/s 2024-06-18T02:19:17.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:17 smithi130 ceph-mon[84407]: pgmap v421: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 134 KiB/s rd, 170 B/s wr, 212 op/s 2024-06-18T02:19:17.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:17 smithi007 ceph-mon[113333]: pgmap v421: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 134 KiB/s rd, 170 B/s wr, 212 op/s 2024-06-18T02:19:17.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:17 smithi007 ceph-mon[99735]: pgmap v421: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 134 KiB/s rd, 170 B/s wr, 212 op/s 2024-06-18T02:19:17.907 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:19:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:19:17] "GET /metrics HTTP/1.1" 200 38601 "" "Prometheus/2.33.4" 2024-06-18T02:19:18.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:18 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:18.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:18 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:18.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:18 smithi130 ceph-mon[84407]: pgmap v422: 161 pgs: 161 active+clean; 585 KiB data, 281 MiB used, 715 GiB / 715 GiB avail; 172 KiB/s rd, 170 B/s wr, 271 op/s 2024-06-18T02:19:18.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:18 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:18.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:18 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:18.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:18 smithi007 ceph-mon[113333]: pgmap v422: 161 pgs: 161 active+clean; 585 KiB data, 281 MiB used, 715 GiB / 715 GiB avail; 172 KiB/s rd, 170 B/s wr, 271 op/s 2024-06-18T02:19:18.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:18 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:18.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:18 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:18.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:18 smithi007 ceph-mon[99735]: pgmap v422: 161 pgs: 161 active+clean; 585 KiB data, 281 MiB used, 715 GiB / 715 GiB avail; 172 KiB/s rd, 170 B/s wr, 271 op/s 2024-06-18T02:19:20.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:19 smithi007 ceph-mon[113333]: Upgrade: Updating rgw.smpl.smithi130.wwebfk (4/4) 2024-06-18T02:19:20.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:19 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:20.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:19 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi130.wwebfk", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-06-18T02:19:20.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:19 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi130.wwebfk", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-06-18T02:19:20.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:19 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:19:20.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:19 smithi007 ceph-mon[113333]: Deploying daemon rgw.smpl.smithi130.wwebfk on smithi130 2024-06-18T02:19:20.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:19 smithi007 ceph-mon[99735]: Upgrade: Updating rgw.smpl.smithi130.wwebfk (4/4) 2024-06-18T02:19:20.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:19 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:20.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:19 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi130.wwebfk", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-06-18T02:19:20.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:19 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi130.wwebfk", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-06-18T02:19:20.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:19 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:19:20.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:19 smithi007 ceph-mon[99735]: Deploying daemon rgw.smpl.smithi130.wwebfk on smithi130 2024-06-18T02:19:20.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:19 smithi130 ceph-mon[84407]: Upgrade: Updating rgw.smpl.smithi130.wwebfk (4/4) 2024-06-18T02:19:20.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:19 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:20.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:19 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi130.wwebfk", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-06-18T02:19:20.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:19 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi130.wwebfk", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-06-18T02:19:20.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:19 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:19:20.264 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:19 smithi130 ceph-mon[84407]: Deploying daemon rgw.smpl.smithi130.wwebfk on smithi130 2024-06-18T02:19:21.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:20 smithi007 ceph-mon[113333]: pgmap v423: 161 pgs: 161 active+clean; 585 KiB data, 281 MiB used, 715 GiB / 715 GiB avail; 145 KiB/s rd, 170 B/s wr, 229 op/s 2024-06-18T02:19:21.181 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:20 smithi007 ceph-mon[99735]: pgmap v423: 161 pgs: 161 active+clean; 585 KiB data, 281 MiB used, 715 GiB / 715 GiB avail; 145 KiB/s rd, 170 B/s wr, 229 op/s 2024-06-18T02:19:21.260 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:20 smithi130 ceph-mon[84407]: pgmap v423: 161 pgs: 161 active+clean; 585 KiB data, 281 MiB used, 715 GiB / 715 GiB avail; 145 KiB/s rd, 170 B/s wr, 229 op/s 2024-06-18T02:19:23.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:23 smithi007 ceph-mon[113333]: pgmap v424: 161 pgs: 161 active+clean; 585 KiB data, 285 MiB used, 715 GiB / 715 GiB avail; 187 KiB/s rd, 255 B/s wr, 295 op/s 2024-06-18T02:19:23.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:23 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:23.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:23 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:23.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:23 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:23.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:23 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:23.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:23 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:23.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:23 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:23.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:23 smithi007 ceph-mon[99735]: pgmap v424: 161 pgs: 161 active+clean; 585 KiB data, 285 MiB used, 715 GiB / 715 GiB avail; 187 KiB/s rd, 255 B/s wr, 295 op/s 2024-06-18T02:19:23.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:23 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:23.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:23 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:23.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:23 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:23.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:23 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:23.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:23 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:23.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:23 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:23.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:23 smithi130 ceph-mon[84407]: pgmap v424: 161 pgs: 161 active+clean; 585 KiB data, 285 MiB used, 715 GiB / 715 GiB avail; 187 KiB/s rd, 255 B/s wr, 295 op/s 2024-06-18T02:19:23.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:23 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:23.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:23 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:23.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:23 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:23.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:23 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:23.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:23 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:23.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:23 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:24.197 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:24 smithi130 ceph-mon[84407]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:19:24.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:24 smithi007 ceph-mon[113333]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:19:24.431 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:24 smithi007 ceph-mon[99735]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:19:25.172 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:25 smithi130 ceph-mon[84407]: pgmap v425: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 157 KiB/s rd, 170 B/s wr, 248 op/s 2024-06-18T02:19:25.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:25 smithi007 ceph-mon[113333]: pgmap v425: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 157 KiB/s rd, 170 B/s wr, 248 op/s 2024-06-18T02:19:25.181 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:25 smithi007 ceph-mon[99735]: pgmap v425: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 157 KiB/s rd, 170 B/s wr, 248 op/s 2024-06-18T02:19:26.519 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:26.519 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:26.519 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:26.519 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:26 smithi130 ceph-mon[84407]: pgmap v426: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 142 KiB/s rd, 170 B/s wr, 224 op/s 2024-06-18T02:19:26.519 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:26.519 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:26.519 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:19:26.519 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:19:26.519 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:26.519 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:26 smithi130 ceph-mon[84407]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:19:26.519 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:19:26.520 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:26.520 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:26.520 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:26.520 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:19:26.520 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:19:26.520 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:19:26.520 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:19:26.520 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:19:26.520 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:19:26.520 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:19:26.520 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:26.520 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi007.dvbvbk"}]: dispatch 2024-06-18T02:19:26.520 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi007.dvbvbk"}]: dispatch 2024-06-18T02:19:26.520 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi007.dvbvbk"}]': finished 2024-06-18T02:19:26.520 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi130.aakmof"}]: dispatch 2024-06-18T02:19:26.521 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi130.aakmof"}]: dispatch 2024-06-18T02:19:26.521 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi130.aakmof"}]': finished 2024-06-18T02:19:26.521 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi007.hgrnmk"}]: dispatch 2024-06-18T02:19:26.521 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi007.hgrnmk"}]: dispatch 2024-06-18T02:19:26.521 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi007.hgrnmk"}]': finished 2024-06-18T02:19:26.521 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi130.wwebfk"}]: dispatch 2024-06-18T02:19:26.521 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi130.wwebfk"}]: dispatch 2024-06-18T02:19:26.521 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi130.wwebfk"}]': finished 2024-06-18T02:19:26.521 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:19:26.521 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:26.521 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:19:26.521 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:19:26.521 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:26 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:26.854 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:26.854 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:26.854 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:26.855 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[113333]: pgmap v426: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 142 KiB/s rd, 170 B/s wr, 224 op/s 2024-06-18T02:19:26.855 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:26.855 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:26.855 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:19:26.855 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:19:26.855 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:26.855 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[113333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:19:26.855 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:19:26.855 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:26.855 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:26.855 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:26.855 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:19:26.855 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:19:26.856 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:19:26.856 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:19:26.856 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:19:26.856 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:19:26.856 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:19:26.856 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:26.856 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi007.dvbvbk"}]: dispatch 2024-06-18T02:19:26.856 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi007.dvbvbk"}]: dispatch 2024-06-18T02:19:26.856 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi007.dvbvbk"}]': finished 2024-06-18T02:19:26.856 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi130.aakmof"}]: dispatch 2024-06-18T02:19:26.856 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi130.aakmof"}]: dispatch 2024-06-18T02:19:26.856 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi130.aakmof"}]': finished 2024-06-18T02:19:26.856 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi007.hgrnmk"}]: dispatch 2024-06-18T02:19:26.857 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:26.857 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:26.857 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:26.857 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[99735]: pgmap v426: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 142 KiB/s rd, 170 B/s wr, 224 op/s 2024-06-18T02:19:26.857 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:26.857 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:26.857 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:19:26.857 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:19:26.857 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:26.857 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[99735]: Metadata not up to date on all hosts. Skipping non agent specs 2024-06-18T02:19:26.857 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:19:26.857 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:26.858 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:26.858 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:26.858 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-18T02:19:26.858 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:19:26.858 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:19:26.858 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:19:26.858 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:19:26.858 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:19:26.858 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:19:26.858 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:26.858 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi007.dvbvbk"}]: dispatch 2024-06-18T02:19:26.859 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi007.dvbvbk"}]: dispatch 2024-06-18T02:19:26.859 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi007.dvbvbk"}]': finished 2024-06-18T02:19:26.859 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi130.aakmof"}]: dispatch 2024-06-18T02:19:26.859 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi130.aakmof"}]: dispatch 2024-06-18T02:19:26.859 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi130.aakmof"}]': finished 2024-06-18T02:19:26.859 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi007.hgrnmk"}]: dispatch 2024-06-18T02:19:26.859 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi007.hgrnmk"}]: dispatch 2024-06-18T02:19:26.859 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi007.hgrnmk"}]': finished 2024-06-18T02:19:26.859 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi130.wwebfk"}]: dispatch 2024-06-18T02:19:26.859 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi130.wwebfk"}]: dispatch 2024-06-18T02:19:26.860 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi130.wwebfk"}]': finished 2024-06-18T02:19:26.860 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:19:26.860 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:26.860 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:19:26.860 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:19:26.860 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:26.860 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi007.hgrnmk"}]: dispatch 2024-06-18T02:19:26.860 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi007.hgrnmk"}]': finished 2024-06-18T02:19:26.860 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi130.wwebfk"}]: dispatch 2024-06-18T02:19:26.860 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi130.wwebfk"}]: dispatch 2024-06-18T02:19:26.860 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi130.wwebfk"}]': finished 2024-06-18T02:19:26.860 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:19:26.860 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:26.860 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:19:26.861 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:19:26.861 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:26 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:27.710 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:27 smithi130 ceph-mon[84407]: pgmap v427: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 119 KiB/s rd, 100 B/s wr, 188 op/s 2024-06-18T02:19:27.710 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:27 smithi130 ceph-mon[84407]: Upgrade: Setting container_image for all rgw 2024-06-18T02:19:27.710 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:27 smithi130 ceph-mon[84407]: Upgrade: Setting container_image for all rbd-mirror 2024-06-18T02:19:27.710 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:27 smithi130 ceph-mon[84407]: Upgrade: Setting container_image for all ceph-exporter 2024-06-18T02:19:27.710 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:27 smithi130 ceph-mon[84407]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-06-18T02:19:27.752 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:27 smithi007 ceph-mon[113333]: pgmap v427: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 119 KiB/s rd, 100 B/s wr, 188 op/s 2024-06-18T02:19:27.752 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:27 smithi007 ceph-mon[113333]: Upgrade: Setting container_image for all rgw 2024-06-18T02:19:27.752 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:27 smithi007 ceph-mon[113333]: Upgrade: Setting container_image for all rbd-mirror 2024-06-18T02:19:27.753 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:27 smithi007 ceph-mon[113333]: Upgrade: Setting container_image for all ceph-exporter 2024-06-18T02:19:27.753 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:27 smithi007 ceph-mon[113333]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-06-18T02:19:27.753 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:27 smithi007 ceph-mon[99735]: pgmap v427: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 119 KiB/s rd, 100 B/s wr, 188 op/s 2024-06-18T02:19:27.753 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:27 smithi007 ceph-mon[99735]: Upgrade: Setting container_image for all rgw 2024-06-18T02:19:27.753 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:27 smithi007 ceph-mon[99735]: Upgrade: Setting container_image for all rbd-mirror 2024-06-18T02:19:27.753 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:27 smithi007 ceph-mon[99735]: Upgrade: Setting container_image for all ceph-exporter 2024-06-18T02:19:27.753 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:27 smithi007 ceph-mon[99735]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-06-18T02:19:28.011 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:19:27 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:19:27] "GET /metrics HTTP/1.1" 200 38637 "" "Prometheus/2.33.4" 2024-06-18T02:19:29.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:28 smithi130 ceph-mon[84407]: Upgrade: Updating iscsi.foo.smithi007.xvdrwd 2024-06-18T02:19:29.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:28 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:29.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi007.xvdrwd", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-06-18T02:19:29.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:28 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi007.xvdrwd", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-06-18T02:19:29.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:28 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:19:29.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:28 smithi130 ceph-mon[84407]: Deploying daemon iscsi.foo.smithi007.xvdrwd on smithi007 2024-06-18T02:19:29.067 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:28 smithi007 ceph-mon[113333]: Upgrade: Updating iscsi.foo.smithi007.xvdrwd 2024-06-18T02:19:29.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:28 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:29.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi007.xvdrwd", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-06-18T02:19:29.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:28 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi007.xvdrwd", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-06-18T02:19:29.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:28 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:19:29.068 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:28 smithi007 ceph-mon[113333]: Deploying daemon iscsi.foo.smithi007.xvdrwd on smithi007 2024-06-18T02:19:29.068 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:28 smithi007 ceph-mon[99735]: Upgrade: Updating iscsi.foo.smithi007.xvdrwd 2024-06-18T02:19:29.068 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:28 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:29.068 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi007.xvdrwd", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-06-18T02:19:29.068 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:28 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi007.xvdrwd", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-06-18T02:19:29.068 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:28 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:19:29.068 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:28 smithi007 ceph-mon[99735]: Deploying daemon iscsi.foo.smithi007.xvdrwd on smithi007 2024-06-18T02:19:30.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:29 smithi007 ceph-mon[113333]: pgmap v428: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 117 KiB/s rd, 100 B/s wr, 185 op/s 2024-06-18T02:19:30.034 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:29 smithi007 ceph-mon[99735]: pgmap v428: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 117 KiB/s rd, 100 B/s wr, 185 op/s 2024-06-18T02:19:30.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:29 smithi130 ceph-mon[84407]: pgmap v428: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 117 KiB/s rd, 100 B/s wr, 185 op/s 2024-06-18T02:19:32.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:31 smithi007 ceph-mon[113333]: pgmap v429: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 138 KiB/s rd, 200 B/s wr, 217 op/s 2024-06-18T02:19:32.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:31 smithi007 ceph-mon[99735]: pgmap v429: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 138 KiB/s rd, 200 B/s wr, 217 op/s 2024-06-18T02:19:32.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:31 smithi130 ceph-mon[84407]: pgmap v429: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 138 KiB/s rd, 200 B/s wr, 217 op/s 2024-06-18T02:19:34.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:33 smithi007 ceph-mon[113333]: pgmap v430: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 93 KiB/s rd, 100 B/s wr, 146 op/s 2024-06-18T02:19:34.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:33 smithi007 ceph-mon[113333]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:19:34.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:33 smithi007 ceph-mon[99735]: pgmap v430: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 93 KiB/s rd, 100 B/s wr, 146 op/s 2024-06-18T02:19:34.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:33 smithi007 ceph-mon[99735]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:19:34.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:33 smithi130 ceph-mon[84407]: pgmap v430: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 93 KiB/s rd, 100 B/s wr, 146 op/s 2024-06-18T02:19:34.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:33 smithi130 ceph-mon[84407]: from='client.25394 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:19:36.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:35 smithi007 ceph-mon[113333]: pgmap v431: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 93 KiB/s rd, 100 B/s wr, 146 op/s 2024-06-18T02:19:36.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:35 smithi007 ceph-mon[99735]: pgmap v431: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 93 KiB/s rd, 100 B/s wr, 146 op/s 2024-06-18T02:19:36.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:35 smithi130 ceph-mon[84407]: pgmap v431: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 93 KiB/s rd, 100 B/s wr, 146 op/s 2024-06-18T02:19:38.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:37 smithi007 ceph-mon[113333]: pgmap v432: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 93 KiB/s rd, 100 B/s wr, 146 op/s 2024-06-18T02:19:38.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:37 smithi007 ceph-mon[99735]: pgmap v432: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 93 KiB/s rd, 100 B/s wr, 146 op/s 2024-06-18T02:19:38.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:37 smithi130 ceph-mon[84407]: pgmap v432: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 93 KiB/s rd, 100 B/s wr, 146 op/s 2024-06-18T02:19:38.294 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:19:37 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:19:37] "GET /metrics HTTP/1.1" 200 38637 "" "Prometheus/2.33.4" 2024-06-18T02:19:38.400 INFO:teuthology.orchestra.run.smithi007.stdout:true 2024-06-18T02:19:39.080 INFO:teuthology.orchestra.run.smithi007.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-18T02:19:39.081 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi007 smithi007 running 13s ago 22m - - 2024-06-18T02:19:39.081 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi130 smithi130 running 12s ago 22m - - 2024-06-18T02:19:39.081 INFO:teuthology.orchestra.run.smithi007.stdout:alertmanager.a smithi007 *:9093,9094 running (12m) 13s ago 17m 24.0M - 0.23.0 ba2b418f427c 5994e8525c64 2024-06-18T02:19:39.081 INFO:teuthology.orchestra.run.smithi007.stdout:grafana.a smithi130 *:3000 running (12m) 12s ago 17m 50.0M - 8.3.5 dad864ee21e9 70ba81d97c8e 2024-06-18T02:19:39.081 INFO:teuthology.orchestra.run.smithi007.stdout:iscsi.foo.smithi007.xvdrwd smithi007 running (10m) 13s ago 16m 64.1M - 3.5 e1d6a67b021e 94121ad2702c 2024-06-18T02:19:39.081 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.x smithi130 *:8443,9283,8765 running (11m) 12s ago 22m 538M - 19.0.0-3124-g3781e3a5 af93c036e016 01017e37bdbe 2024-06-18T02:19:39.081 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.y smithi007 *:8443,9283,8765 running (9m) 13s ago 23m 445M - 19.0.0-3124-g3781e3a5 af93c036e016 2141e131e896 2024-06-18T02:19:39.081 INFO:teuthology.orchestra.run.smithi007.stdout:mon.a smithi007 running (7m) 13s ago 23m 70.9M 2048M 19.0.0-3124-g3781e3a5 af93c036e016 7bbe646cd5b7 2024-06-18T02:19:39.081 INFO:teuthology.orchestra.run.smithi007.stdout:mon.b smithi130 running (8m) 12s ago 22m 65.1M 2048M 19.0.0-3124-g3781e3a5 af93c036e016 baacf2add994 2024-06-18T02:19:39.081 INFO:teuthology.orchestra.run.smithi007.stdout:mon.c smithi007 running (9m) 13s ago 22m 66.9M 2048M 19.0.0-3124-g3781e3a5 af93c036e016 39418356156e 2024-06-18T02:19:39.081 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.a smithi007 *:9100 running (12m) 13s ago 18m 17.5M - 1.3.1 1dbe0e931976 8128e558f099 2024-06-18T02:19:39.081 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.b smithi130 *:9100 running (12m) 12s ago 17m 16.1M - 1.3.1 1dbe0e931976 bab93b43cf16 2024-06-18T02:19:39.081 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0 smithi007 running (6m) 13s ago 21m 59.9M 2481M 19.0.0-3124-g3781e3a5 af93c036e016 07c7f4afd49a 2024-06-18T02:19:39.082 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1 smithi007 running (6m) 13s ago 21m 58.8M 2481M 19.0.0-3124-g3781e3a5 af93c036e016 e8d184614e94 2024-06-18T02:19:39.082 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2 smithi007 running (5m) 13s ago 20m 52.5M 2481M 19.0.0-3124-g3781e3a5 af93c036e016 7d9a05b4bfa5 2024-06-18T02:19:39.082 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3 smithi007 running (4m) 13s ago 20m 63.7M 2481M 19.0.0-3124-g3781e3a5 af93c036e016 7e879cda3b51 2024-06-18T02:19:39.082 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4 smithi130 running (2m) 12s ago 20m 64.0M 2736M 19.0.0-3124-g3781e3a5 af93c036e016 24f46c456c31 2024-06-18T02:19:39.082 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5 smithi130 running (2m) 12s ago 19m 59.6M 2736M 19.0.0-3124-g3781e3a5 af93c036e016 210471d14700 2024-06-18T02:19:39.082 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6 smithi130 running (103s) 12s ago 19m 55.9M 2736M 19.0.0-3124-g3781e3a5 af93c036e016 eb813977281a 2024-06-18T02:19:39.082 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7 smithi130 running (53s) 12s ago 18m 48.3M 2736M 19.0.0-3124-g3781e3a5 af93c036e016 315f4e6d26b8 2024-06-18T02:19:39.082 INFO:teuthology.orchestra.run.smithi007.stdout:prometheus.a smithi130 *:9095 running (11m) 12s ago 18m 75.9M - 2.33.4 514e6a882f6e e905fb2eb4a6 2024-06-18T02:19:39.082 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi007.dvbvbk smithi007 *:8000 running (34s) 13s ago 16m 79.2M - 19.0.0-3124-g3781e3a5 af93c036e016 dab0a098ae9c 2024-06-18T02:19:39.082 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi130.aakmof smithi130 *:8000 running (22s) 12s ago 16m 75.9M - 19.0.0-3124-g3781e3a5 af93c036e016 70814d40f95d 2024-06-18T02:19:39.082 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi007.hgrnmk smithi007 *:80 running (27s) 13s ago 16m 75.9M - 19.0.0-3124-g3781e3a5 af93c036e016 b36d62aa6da2 2024-06-18T02:19:39.083 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi130.wwebfk smithi130 *:80 unknown 12s ago 16m - - 19.0.0-3124-g3781e3a5 af93c036e016 1441378e1002 2024-06-18T02:19:39.494 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:19:39.494 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": { 2024-06-18T02:19:39.494 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 3 2024-06-18T02:19:39.494 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:19:39.494 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": { 2024-06-18T02:19:39.494 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 2 2024-06-18T02:19:39.494 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:19:39.495 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": { 2024-06-18T02:19:39.495 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 8 2024-06-18T02:19:39.495 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:19:39.495 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw": { 2024-06-18T02:19:39.495 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 4 2024-06-18T02:19:39.495 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:19:39.495 INFO:teuthology.orchestra.run.smithi007.stdout: "overall": { 2024-06-18T02:19:39.495 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 17 2024-06-18T02:19:39.495 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-06-18T02:19:39.495 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:19:39.849 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:19:39.849 INFO:teuthology.orchestra.run.smithi007.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00", 2024-06-18T02:19:39.849 INFO:teuthology.orchestra.run.smithi007.stdout: "in_progress": true, 2024-06-18T02:19:39.850 INFO:teuthology.orchestra.run.smithi007.stdout: "which": "Upgrading all daemon types on all hosts", 2024-06-18T02:19:39.850 INFO:teuthology.orchestra.run.smithi007.stdout: "services_complete": [ 2024-06-18T02:19:39.850 INFO:teuthology.orchestra.run.smithi007.stdout: "mon", 2024-06-18T02:19:39.850 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw", 2024-06-18T02:19:39.850 INFO:teuthology.orchestra.run.smithi007.stdout: "osd", 2024-06-18T02:19:39.850 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr" 2024-06-18T02:19:39.850 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-06-18T02:19:39.850 INFO:teuthology.orchestra.run.smithi007.stdout: "progress": "17/23 daemons upgraded", 2024-06-18T02:19:39.850 INFO:teuthology.orchestra.run.smithi007.stdout: "message": "Currently upgrading iscsi daemons", 2024-06-18T02:19:39.850 INFO:teuthology.orchestra.run.smithi007.stdout: "is_paused": false 2024-06-18T02:19:39.850 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:19:40.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:39 smithi007 ceph-mon[113333]: pgmap v433: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 85 B/s wr, 124 op/s 2024-06-18T02:19:40.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:39 smithi007 ceph-mon[113333]: from='client.54805 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:19:40.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:39 smithi007 ceph-mon[113333]: from='client.94770 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:19:40.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:39 smithi007 ceph-mon[113333]: from='client.94776 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:19:40.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:39 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:40.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:39 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:40.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:39 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:40.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:39 smithi007 ceph-mon[113333]: from='client.? 172.21.15.7:0/1272630464' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:19:40.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:39 smithi007 ceph-mon[99735]: pgmap v433: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 85 B/s wr, 124 op/s 2024-06-18T02:19:40.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:39 smithi007 ceph-mon[99735]: from='client.54805 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:19:40.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:39 smithi007 ceph-mon[99735]: from='client.94770 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:19:40.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:39 smithi007 ceph-mon[99735]: from='client.94776 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:19:40.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:39 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:40.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:39 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:40.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:39 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:40.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:39 smithi007 ceph-mon[99735]: from='client.? 172.21.15.7:0/1272630464' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:19:40.266 INFO:teuthology.orchestra.run.smithi007.stdout:HEALTH_WARN 1 failed cephadm daemon(s) 2024-06-18T02:19:40.266 INFO:teuthology.orchestra.run.smithi007.stdout:[WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2024-06-18T02:19:40.266 INFO:teuthology.orchestra.run.smithi007.stdout: daemon rgw.smpl.smithi130.wwebfk on smithi130 is in unknown state 2024-06-18T02:19:40.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:39 smithi130 ceph-mon[84407]: pgmap v433: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 85 B/s wr, 124 op/s 2024-06-18T02:19:40.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:39 smithi130 ceph-mon[84407]: from='client.54805 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:19:40.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:39 smithi130 ceph-mon[84407]: from='client.94770 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:19:40.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:39 smithi130 ceph-mon[84407]: from='client.94776 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:19:40.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:39 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:40.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:39 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:40.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:39 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:40.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:39 smithi130 ceph-mon[84407]: from='client.? 172.21.15.7:0/1272630464' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:19:40.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:40 smithi007 ceph-mon[113333]: pgmap v434: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 47 KiB/s rd, 91 B/s wr, 73 op/s 2024-06-18T02:19:40.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:40 smithi007 ceph-mon[113333]: from='client.54829 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:19:40.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:40 smithi007 ceph-mon[113333]: from='client.? 172.21.15.7:0/1536729547' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:19:40.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:40 smithi007 ceph-mon[113333]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-06-18T02:19:40.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:40 smithi007 ceph-mon[113333]: Cluster is now healthy 2024-06-18T02:19:40.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:40 smithi007 ceph-mon[99735]: pgmap v434: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 47 KiB/s rd, 91 B/s wr, 73 op/s 2024-06-18T02:19:40.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:40 smithi007 ceph-mon[99735]: from='client.54829 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:19:40.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:40 smithi007 ceph-mon[99735]: from='client.? 172.21.15.7:0/1536729547' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:19:40.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:40 smithi007 ceph-mon[99735]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-06-18T02:19:40.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:40 smithi007 ceph-mon[99735]: Cluster is now healthy 2024-06-18T02:19:41.100 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:40 smithi130 ceph-mon[84407]: pgmap v434: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 47 KiB/s rd, 91 B/s wr, 73 op/s 2024-06-18T02:19:41.101 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:40 smithi130 ceph-mon[84407]: from='client.54829 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:19:41.101 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:40 smithi130 ceph-mon[84407]: from='client.? 172.21.15.7:0/1536729547' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:19:41.101 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:40 smithi130 ceph-mon[84407]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-06-18T02:19:41.101 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:40 smithi130 ceph-mon[84407]: Cluster is now healthy 2024-06-18T02:19:41.543 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:19:41 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:19:41.101+0000 7f680195c640 -1 log_channel(cephadm) log [ERR] : Upgrade: Paused due to UPGRADE_REDEPLOY_DAEMON: Upgrading daemon iscsi.foo.smithi007.xvdrwd on host smithi007 failed. 2024-06-18T02:19:42.369 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:42 smithi007 ceph-mon[113333]: Upgrade: Paused due to UPGRADE_REDEPLOY_DAEMON: Upgrading daemon iscsi.foo.smithi007.xvdrwd on host smithi007 failed. 2024-06-18T02:19:42.369 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:42 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:42.370 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:42 smithi007 ceph-mon[113333]: pgmap v435: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 25 op/s 2024-06-18T02:19:42.370 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:42 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:19:42.370 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:42 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:19:42.370 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:42 smithi007 ceph-mon[113333]: Checking dashboard <-> RGW credentials 2024-06-18T02:19:42.370 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:42 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:19:42.370 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:42 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:42.370 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:42 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:19:42.370 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:42 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:19:42.370 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:42 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:42.370 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:42 smithi007 ceph-mon[99735]: Upgrade: Paused due to UPGRADE_REDEPLOY_DAEMON: Upgrading daemon iscsi.foo.smithi007.xvdrwd on host smithi007 failed. 2024-06-18T02:19:42.370 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:42.371 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:42 smithi007 ceph-mon[99735]: pgmap v435: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 25 op/s 2024-06-18T02:19:42.371 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:19:42.371 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:19:42.371 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:42 smithi007 ceph-mon[99735]: Checking dashboard <-> RGW credentials 2024-06-18T02:19:42.371 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:19:42.371 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:42.371 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:19:42.371 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:19:42.371 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:42 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:42.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:42 smithi130 ceph-mon[84407]: Upgrade: Paused due to UPGRADE_REDEPLOY_DAEMON: Upgrading daemon iscsi.foo.smithi007.xvdrwd on host smithi007 failed. 2024-06-18T02:19:42.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:42 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:42.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:42 smithi130 ceph-mon[84407]: pgmap v435: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 25 op/s 2024-06-18T02:19:42.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:19:42.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:19:42.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:42 smithi130 ceph-mon[84407]: Checking dashboard <-> RGW credentials 2024-06-18T02:19:42.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:19:42.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:42 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:42.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:19:42.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:19:42.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:42 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:43.386 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:43 smithi007 ceph-mon[113333]: Health check failed: Upgrading daemon iscsi.foo.smithi007.xvdrwd on host smithi007 failed. (UPGRADE_REDEPLOY_DAEMON) 2024-06-18T02:19:43.387 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:43 smithi007 ceph-mon[99735]: Health check failed: Upgrading daemon iscsi.foo.smithi007.xvdrwd on host smithi007 failed. (UPGRADE_REDEPLOY_DAEMON) 2024-06-18T02:19:43.396 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:43 smithi130 ceph-mon[84407]: Health check failed: Upgrading daemon iscsi.foo.smithi007.xvdrwd on host smithi007 failed. (UPGRADE_REDEPLOY_DAEMON) 2024-06-18T02:19:44.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:44 smithi007 ceph-mon[113333]: pgmap v436: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-06-18T02:19:44.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:44 smithi007 ceph-mon[99735]: pgmap v436: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-06-18T02:19:44.433 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:44 smithi130 ceph-mon[84407]: pgmap v436: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-06-18T02:19:45.654 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:45 smithi007 ceph-mon[113333]: pgmap v437: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-06-18T02:19:45.655 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:45 smithi007 ceph-mon[99735]: pgmap v437: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-06-18T02:19:46.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:45 smithi130 ceph-mon[84407]: pgmap v437: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-06-18T02:19:46.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:46 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:46.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:46 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:46.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:46 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:46.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:46 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:46.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:46 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:46.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:46 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:47.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:46 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:47.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:46 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:47.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:46 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:47.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:47 smithi007 ceph-mon[113333]: pgmap v438: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-06-18T02:19:47.931 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:47 smithi007 ceph-mon[99735]: pgmap v438: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-06-18T02:19:48.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:47 smithi130 ceph-mon[84407]: pgmap v438: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-06-18T02:19:48.043 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:19:47 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:19:47] "GET /metrics HTTP/1.1" 200 38669 "" "Prometheus/2.33.4" 2024-06-18T02:19:48.945 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:48 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:48.945 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:48 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:48.945 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:48 smithi130 ceph-mon[84407]: pgmap v439: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-06-18T02:19:48.945 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:19:48.945 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:48 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:48.945 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:48 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:19:48.945 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:48 smithi130 ceph-mon[84407]: pgmap v440: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 2.8 KiB/s rd, 3 op/s 2024-06-18T02:19:48.945 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:48 smithi130 ceph-mon[84407]: pgmap v441: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 3 op/s 2024-06-18T02:19:48.945 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:48 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:49.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:48 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:49.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:48 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:49.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:48 smithi007 ceph-mon[113333]: pgmap v439: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-06-18T02:19:49.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:19:49.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:48 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:49.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:48 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:19:49.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:48 smithi007 ceph-mon[113333]: pgmap v440: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 2.8 KiB/s rd, 3 op/s 2024-06-18T02:19:49.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:48 smithi007 ceph-mon[113333]: pgmap v441: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 3 op/s 2024-06-18T02:19:49.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:48 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:49.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:48 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:49.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:48 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:49.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:48 smithi007 ceph-mon[99735]: pgmap v439: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-06-18T02:19:49.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:19:49.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:48 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:49.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:48 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:19:49.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:48 smithi007 ceph-mon[99735]: pgmap v440: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 2.8 KiB/s rd, 3 op/s 2024-06-18T02:19:49.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:48 smithi007 ceph-mon[99735]: pgmap v441: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 3 op/s 2024-06-18T02:19:49.183 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:48 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:50.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:49 smithi130 ceph-mon[84407]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-06-18T02:19:50.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:49 smithi007 ceph-mon[113333]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-06-18T02:19:50.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:49 smithi007 ceph-mon[99735]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-06-18T02:19:51.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:50 smithi130 ceph-mon[84407]: pgmap v442: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-06-18T02:19:51.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:50 smithi007 ceph-mon[113333]: pgmap v442: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-06-18T02:19:51.181 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:50 smithi007 ceph-mon[99735]: pgmap v442: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-06-18T02:19:53.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:52 smithi130 ceph-mon[84407]: pgmap v443: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-06-18T02:19:53.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:52 smithi130 ceph-mon[84407]: from='client.? 172.21.15.7:0/1257111941' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-18T02:19:53.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:52 smithi007 ceph-mon[113333]: pgmap v443: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-06-18T02:19:53.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:52 smithi007 ceph-mon[113333]: from='client.? 172.21.15.7:0/1257111941' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-18T02:19:53.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:52 smithi007 ceph-mon[99735]: pgmap v443: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-06-18T02:19:53.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:52 smithi007 ceph-mon[99735]: from='client.? 172.21.15.7:0/1257111941' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-18T02:19:55.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:54 smithi130 ceph-mon[84407]: pgmap v444: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 155 B/s rd, 0 op/s 2024-06-18T02:19:55.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:54 smithi007 ceph-mon[113333]: pgmap v444: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 155 B/s rd, 0 op/s 2024-06-18T02:19:55.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:54 smithi007 ceph-mon[99735]: pgmap v444: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 155 B/s rd, 0 op/s 2024-06-18T02:19:56.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:56 smithi007 ceph-mon[99735]: pgmap v445: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 127 B/s rd, 0 op/s 2024-06-18T02:19:56.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:56 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:56.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:19:56.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:56 smithi007 ceph-mon[113333]: pgmap v445: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 127 B/s rd, 0 op/s 2024-06-18T02:19:56.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:56 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:56.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:19:57.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:56 smithi130 ceph-mon[84407]: pgmap v445: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 127 B/s rd, 0 op/s 2024-06-18T02:19:57.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:56 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:19:57.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:19:58.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:19:57 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:19:57] "GET /metrics HTTP/1.1" 200 38749 "" "Prometheus/2.33.4" 2024-06-18T02:19:58.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:19:58 smithi007 ceph-mon[113333]: pgmap v446: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 102 B/s rd, 0 op/s 2024-06-18T02:19:58.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:19:58 smithi007 ceph-mon[99735]: pgmap v446: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 102 B/s rd, 0 op/s 2024-06-18T02:19:59.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:19:58 smithi130 ceph-mon[84407]: pgmap v446: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 102 B/s rd, 0 op/s 2024-06-18T02:20:00.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:00 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:00.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:00 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:00.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:00 smithi130 ceph-mon[84407]: pgmap v447: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 519 B/s rd, 0 op/s 2024-06-18T02:20:00.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:00 smithi130 ceph-mon[84407]: pgmap v448: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 625 B/s rd, 0 op/s 2024-06-18T02:20:00.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:00 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:00.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:00 smithi130 ceph-mon[84407]: Health detail: HEALTH_WARN 1 failed cephadm daemon(s); Upgrading daemon iscsi.foo.smithi007.xvdrwd on host smithi007 failed. 2024-06-18T02:20:00.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:00 smithi130 ceph-mon[84407]: [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2024-06-18T02:20:00.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:00 smithi130 ceph-mon[84407]: daemon iscsi.foo.smithi007.xvdrwd on smithi007 is in unknown state 2024-06-18T02:20:00.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:00 smithi130 ceph-mon[84407]: [WRN] UPGRADE_REDEPLOY_DAEMON: Upgrading daemon iscsi.foo.smithi007.xvdrwd on host smithi007 failed. 2024-06-18T02:20:00.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:00 smithi130 ceph-mon[84407]: Upgrade daemon: iscsi.foo.smithi007.xvdrwd: cephadm exited with an error code: 1, stderr: Redeploy daemon iscsi.foo.smithi007.xvdrwd ... 2024-06-18T02:20:00.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:00 smithi130 ceph-mon[84407]: Creating ceph-iscsi config... 2024-06-18T02:20:00.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:00 smithi130 ceph-mon[84407]: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/iscsi-gateway.cfg 2024-06-18T02:20:00.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:00 smithi130 ceph-mon[84407]: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/tcmu-runner-entrypoint.sh 2024-06-18T02:20:00.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:00 smithi130 ceph-mon[84407]: Failed to trim old cgroups /sys/fs/cgroup/system.slice/system-ceph\x2dcd9a3408\x2d2d15\x2d11ef\x2dbc9d\x2dc7b262605968.slice/ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service 2024-06-18T02:20:00.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:00 smithi130 ceph-mon[84407]: Non-zero exit code 1 from systemctl start ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd 2024-06-18T02:20:00.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:00 smithi130 ceph-mon[84407]: systemctl: stderr Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:20:00.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:00 smithi130 ceph-mon[84407]: systemctl: stderr See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:20:00.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:00 smithi130 ceph-mon[84407]: Traceback (most recent call last): 2024-06-18T02:20:00.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:00 smithi130 ceph-mon[84407]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-06-18T02:20:00.795 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:00 smithi130 ceph-mon[84407]: return _run_code(code, main_globals, None, 2024-06-18T02:20:00.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:00 smithi130 ceph-mon[84407]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-06-18T02:20:00.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:00 smithi130 ceph-mon[84407]: exec(code, run_globals) 2024-06-18T02:20:00.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:00 smithi130 ceph-mon[84407]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5618, in 2024-06-18T02:20:00.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:00 smithi130 ceph-mon[84407]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5606, in main 2024-06-18T02:20:00.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:00 smithi130 ceph-mon[84407]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3096, in command_deploy_from 2024-06-18T02:20:00.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:00 smithi130 ceph-mon[84407]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3131, in _common_deploy 2024-06-18T02:20:00.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:00 smithi130 ceph-mon[84407]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3151, in _deploy_daemon_container 2024-06-18T02:20:00.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:00 smithi130 ceph-mon[84407]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 1087, in deploy_daemon 2024-06-18T02:20:00.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:00 smithi130 ceph-mon[84407]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 1223, in deploy_daemon_units 2024-06-18T02:20:00.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:00 smithi130 ceph-mon[84407]: File "/tmp/tmp3vdsh41i.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-06-18T02:20:00.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:00 smithi130 ceph-mon[84407]: RuntimeError: Failed command: systemctl start ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd: Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:20:00.796 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:00 smithi130 ceph-mon[84407]: See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:20:00.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:00.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:00.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[113333]: pgmap v447: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 519 B/s rd, 0 op/s 2024-06-18T02:20:00.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[113333]: pgmap v448: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 625 B/s rd, 0 op/s 2024-06-18T02:20:00.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:00.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[113333]: Health detail: HEALTH_WARN 1 failed cephadm daemon(s); Upgrading daemon iscsi.foo.smithi007.xvdrwd on host smithi007 failed. 2024-06-18T02:20:00.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[113333]: [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2024-06-18T02:20:00.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[113333]: daemon iscsi.foo.smithi007.xvdrwd on smithi007 is in unknown state 2024-06-18T02:20:00.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[113333]: [WRN] UPGRADE_REDEPLOY_DAEMON: Upgrading daemon iscsi.foo.smithi007.xvdrwd on host smithi007 failed. 2024-06-18T02:20:00.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[113333]: Upgrade daemon: iscsi.foo.smithi007.xvdrwd: cephadm exited with an error code: 1, stderr: Redeploy daemon iscsi.foo.smithi007.xvdrwd ... 2024-06-18T02:20:00.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[113333]: Creating ceph-iscsi config... 2024-06-18T02:20:00.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[113333]: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/iscsi-gateway.cfg 2024-06-18T02:20:00.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[113333]: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/tcmu-runner-entrypoint.sh 2024-06-18T02:20:00.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[113333]: Failed to trim old cgroups /sys/fs/cgroup/system.slice/system-ceph\x2dcd9a3408\x2d2d15\x2d11ef\x2dbc9d\x2dc7b262605968.slice/ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service 2024-06-18T02:20:00.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[113333]: Non-zero exit code 1 from systemctl start ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd 2024-06-18T02:20:00.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[113333]: systemctl: stderr Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:20:00.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[113333]: systemctl: stderr See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:20:00.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[113333]: Traceback (most recent call last): 2024-06-18T02:20:00.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[113333]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-06-18T02:20:00.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[113333]: return _run_code(code, main_globals, None, 2024-06-18T02:20:00.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[113333]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-06-18T02:20:00.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[113333]: exec(code, run_globals) 2024-06-18T02:20:00.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[113333]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5618, in 2024-06-18T02:20:00.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[113333]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5606, in main 2024-06-18T02:20:00.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[113333]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3096, in command_deploy_from 2024-06-18T02:20:00.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[113333]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3131, in _common_deploy 2024-06-18T02:20:00.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[113333]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3151, in _deploy_daemon_container 2024-06-18T02:20:00.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[113333]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 1087, in deploy_daemon 2024-06-18T02:20:00.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[113333]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 1223, in deploy_daemon_units 2024-06-18T02:20:00.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[113333]: File "/tmp/tmp3vdsh41i.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-06-18T02:20:00.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[113333]: RuntimeError: Failed command: systemctl start ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd: Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:20:00.934 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[113333]: See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:20:00.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:00.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:00.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[99735]: pgmap v447: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 519 B/s rd, 0 op/s 2024-06-18T02:20:00.935 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[99735]: pgmap v448: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 625 B/s rd, 0 op/s 2024-06-18T02:20:00.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:00.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[99735]: Health detail: HEALTH_WARN 1 failed cephadm daemon(s); Upgrading daemon iscsi.foo.smithi007.xvdrwd on host smithi007 failed. 2024-06-18T02:20:00.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[99735]: [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2024-06-18T02:20:00.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[99735]: daemon iscsi.foo.smithi007.xvdrwd on smithi007 is in unknown state 2024-06-18T02:20:00.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[99735]: [WRN] UPGRADE_REDEPLOY_DAEMON: Upgrading daemon iscsi.foo.smithi007.xvdrwd on host smithi007 failed. 2024-06-18T02:20:00.936 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[99735]: Upgrade daemon: iscsi.foo.smithi007.xvdrwd: cephadm exited with an error code: 1, stderr: Redeploy daemon iscsi.foo.smithi007.xvdrwd ... 2024-06-18T02:20:00.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[99735]: Creating ceph-iscsi config... 2024-06-18T02:20:00.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[99735]: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/iscsi-gateway.cfg 2024-06-18T02:20:00.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[99735]: Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/tcmu-runner-entrypoint.sh 2024-06-18T02:20:00.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[99735]: Failed to trim old cgroups /sys/fs/cgroup/system.slice/system-ceph\x2dcd9a3408\x2d2d15\x2d11ef\x2dbc9d\x2dc7b262605968.slice/ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service 2024-06-18T02:20:00.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[99735]: Non-zero exit code 1 from systemctl start ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd 2024-06-18T02:20:00.937 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[99735]: systemctl: stderr Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:20:00.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[99735]: systemctl: stderr See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:20:00.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[99735]: Traceback (most recent call last): 2024-06-18T02:20:00.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[99735]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-06-18T02:20:00.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[99735]: return _run_code(code, main_globals, None, 2024-06-18T02:20:00.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[99735]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-06-18T02:20:00.938 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[99735]: exec(code, run_globals) 2024-06-18T02:20:00.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[99735]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5618, in 2024-06-18T02:20:00.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[99735]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5606, in main 2024-06-18T02:20:00.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[99735]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3096, in command_deploy_from 2024-06-18T02:20:00.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[99735]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3131, in _common_deploy 2024-06-18T02:20:00.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[99735]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3151, in _deploy_daemon_container 2024-06-18T02:20:00.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[99735]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 1087, in deploy_daemon 2024-06-18T02:20:00.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[99735]: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 1223, in deploy_daemon_units 2024-06-18T02:20:00.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[99735]: File "/tmp/tmp3vdsh41i.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-06-18T02:20:00.939 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[99735]: RuntimeError: Failed command: systemctl start ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd: Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:20:00.940 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:00 smithi007 ceph-mon[99735]: See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:20:02.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:02 smithi130 ceph-mon[84407]: pgmap v449: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 625 B/s rd, 0 op/s 2024-06-18T02:20:02.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:02 smithi130 ceph-mon[84407]: from='client.54883 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:20:02.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:02 smithi007 ceph-mon[113333]: pgmap v449: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 625 B/s rd, 0 op/s 2024-06-18T02:20:02.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:02 smithi007 ceph-mon[113333]: from='client.54883 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:20:02.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:02 smithi007 ceph-mon[99735]: pgmap v449: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 625 B/s rd, 0 op/s 2024-06-18T02:20:02.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:02 smithi007 ceph-mon[99735]: from='client.54883 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:20:04.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:04 smithi007 ceph-mon[113333]: pgmap v450: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-06-18T02:20:04.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:04 smithi007 ceph-mon[99735]: pgmap v450: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-06-18T02:20:04.989 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:04 smithi130 ceph-mon[84407]: pgmap v450: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-06-18T02:20:06.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:06 smithi007 ceph-mon[113333]: pgmap v451: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-06-18T02:20:06.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:06 smithi007 ceph-mon[99735]: pgmap v451: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-06-18T02:20:07.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:06 smithi130 ceph-mon[84407]: pgmap v451: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-06-18T02:20:08.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:20:07 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:20:07] "GET /metrics HTTP/1.1" 200 38749 "" "Prometheus/2.33.4" 2024-06-18T02:20:09.094 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:08 smithi007 ceph-mon[99735]: pgmap v452: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-06-18T02:20:09.094 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:08 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:09.094 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:08 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:09.094 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:08 smithi007 ceph-mon[99735]: pgmap v453: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 616 B/s rd, 0 op/s 2024-06-18T02:20:09.094 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:08 smithi007 ceph-mon[99735]: pgmap v454: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 616 B/s rd, 0 op/s 2024-06-18T02:20:09.094 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:08 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:09.094 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:08 smithi007 ceph-mon[113333]: pgmap v452: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-06-18T02:20:09.095 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:08 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:09.095 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:08 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:09.095 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:08 smithi007 ceph-mon[113333]: pgmap v453: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 616 B/s rd, 0 op/s 2024-06-18T02:20:09.095 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:08 smithi007 ceph-mon[113333]: pgmap v454: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 616 B/s rd, 0 op/s 2024-06-18T02:20:09.095 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:08 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:09.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:08 smithi130 ceph-mon[84407]: pgmap v452: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-06-18T02:20:09.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:08 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:09.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:08 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:09.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:08 smithi130 ceph-mon[84407]: pgmap v453: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 616 B/s rd, 0 op/s 2024-06-18T02:20:09.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:08 smithi130 ceph-mon[84407]: pgmap v454: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 616 B/s rd, 0 op/s 2024-06-18T02:20:09.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:08 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:10.649 INFO:teuthology.orchestra.run.smithi007.stdout:true 2024-06-18T02:20:10.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:10 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:10.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:10 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:10.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:10 smithi130 ceph-mon[84407]: pgmap v455: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-06-18T02:20:10.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:20:10.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:10 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:10.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:20:10.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:10 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:10.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:10 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:10.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:10 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:10.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:10 smithi007 ceph-mon[113333]: pgmap v455: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-06-18T02:20:10.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:20:10.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:10 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:10.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:20:10.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:10 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:10.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:10 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:10.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:10 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:10.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:10 smithi007 ceph-mon[99735]: pgmap v455: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-06-18T02:20:10.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:20:10.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:10 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:10.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:20:10.933 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:10 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:10.998 INFO:teuthology.orchestra.run.smithi007.stdout:"Error: UPGRADE_REDEPLOY_DAEMON: Upgrading daemon iscsi.foo.smithi007.xvdrwd on host smithi007 failed." 2024-06-18T02:20:11.680 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:11 smithi007 ceph-mon[113333]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-06-18T02:20:11.680 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:11 smithi007 ceph-mon[113333]: from='client.94857 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:20:11.680 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:11 smithi007 ceph-mon[113333]: from='client.54901 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:20:11.680 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:11 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:11.680 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:11 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:20:11.681 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:11 smithi007 ceph-mon[99735]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-06-18T02:20:11.681 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:11 smithi007 ceph-mon[99735]: from='client.94857 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:20:11.681 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:11 smithi007 ceph-mon[99735]: from='client.54901 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:20:11.681 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:11 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:11.681 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:11 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:20:11.707 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -e sha1=3781e3a592387d16e8020f5db99cdee4198f6d00 -- bash -c 'ceph orch ps' 2024-06-18T02:20:11.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:11 smithi130 ceph-mon[84407]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-06-18T02:20:11.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:11 smithi130 ceph-mon[84407]: from='client.94857 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:20:11.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:11 smithi130 ceph-mon[84407]: from='client.54901 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:20:11.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:11 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:11.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:11 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:20:12.611 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:12 smithi007 ceph-mon[113333]: pgmap v456: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 643 B/s rd, 0 op/s 2024-06-18T02:20:12.612 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:12 smithi007 ceph-mon[113333]: from='client.54883 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:20:12.612 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:12 smithi007 ceph-mon[99735]: pgmap v456: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 643 B/s rd, 0 op/s 2024-06-18T02:20:12.612 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:12 smithi007 ceph-mon[99735]: from='client.54883 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:20:12.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:12 smithi130 ceph-mon[84407]: pgmap v456: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 643 B/s rd, 0 op/s 2024-06-18T02:20:12.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:12 smithi130 ceph-mon[84407]: from='client.54883 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:20:14.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:14 smithi130 ceph-mon[84407]: pgmap v457: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-06-18T02:20:14.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:14 smithi007 ceph-mon[113333]: pgmap v457: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-06-18T02:20:14.819 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:14 smithi007 ceph-mon[99735]: pgmap v457: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-06-18T02:20:15.078 INFO:teuthology.orchestra.run.smithi007.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-18T02:20:15.079 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi007 smithi007 running 5s ago 23m - - 2024-06-18T02:20:15.079 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi130 smithi130 running 15s ago 23m - - 2024-06-18T02:20:15.079 INFO:teuthology.orchestra.run.smithi007.stdout:alertmanager.a smithi007 *:9093,9094 running (13m) 5s ago 18m - - 0.23.0 ba2b418f427c 5994e8525c64 2024-06-18T02:20:15.079 INFO:teuthology.orchestra.run.smithi007.stdout:grafana.a smithi130 *:3000 running (12m) 15s ago 17m 50.9M - 8.3.5 dad864ee21e9 70ba81d97c8e 2024-06-18T02:20:15.079 INFO:teuthology.orchestra.run.smithi007.stdout:iscsi.foo.smithi007.xvdrwd smithi007 running (23s) 5s ago 16m - - 3.8 af93c036e016 2704f5806238 2024-06-18T02:20:15.079 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.x smithi130 *:8443,9283,8765 running (12m) 15s ago 22m 539M - 19.0.0-3124-g3781e3a5 af93c036e016 01017e37bdbe 2024-06-18T02:20:15.079 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.y smithi007 *:8443,9283,8765 running (10m) 5s ago 24m - - 19.0.0-3124-g3781e3a5 af93c036e016 2141e131e896 2024-06-18T02:20:15.079 INFO:teuthology.orchestra.run.smithi007.stdout:mon.a smithi007 running (8m) 5s ago 24m - 2048M 19.0.0-3124-g3781e3a5 af93c036e016 7bbe646cd5b7 2024-06-18T02:20:15.079 INFO:teuthology.orchestra.run.smithi007.stdout:mon.b smithi130 running (9m) 15s ago 22m 67.2M 2048M 19.0.0-3124-g3781e3a5 af93c036e016 baacf2add994 2024-06-18T02:20:15.079 INFO:teuthology.orchestra.run.smithi007.stdout:mon.c smithi007 running (9m) 5s ago 23m - 2048M 19.0.0-3124-g3781e3a5 af93c036e016 39418356156e 2024-06-18T02:20:15.079 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.a smithi007 *:9100 running (13m) 5s ago 18m - - 1.3.1 1dbe0e931976 8128e558f099 2024-06-18T02:20:15.080 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.b smithi130 *:9100 running (12m) 15s ago 18m 16.2M - 1.3.1 1dbe0e931976 bab93b43cf16 2024-06-18T02:20:15.080 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0 smithi007 running (7m) 5s ago 22m - 2481M 19.0.0-3124-g3781e3a5 af93c036e016 07c7f4afd49a 2024-06-18T02:20:15.080 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1 smithi007 running (6m) 5s ago 21m - 2481M 19.0.0-3124-g3781e3a5 af93c036e016 e8d184614e94 2024-06-18T02:20:15.080 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2 smithi007 running (5m) 5s ago 21m - 2481M 19.0.0-3124-g3781e3a5 af93c036e016 7d9a05b4bfa5 2024-06-18T02:20:15.080 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3 smithi007 running (4m) 5s ago 21m - 2481M 19.0.0-3124-g3781e3a5 af93c036e016 7e879cda3b51 2024-06-18T02:20:15.080 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4 smithi130 running (3m) 15s ago 20m 65.0M 2736M 19.0.0-3124-g3781e3a5 af93c036e016 24f46c456c31 2024-06-18T02:20:15.080 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5 smithi130 running (3m) 15s ago 20m 59.5M 2736M 19.0.0-3124-g3781e3a5 af93c036e016 210471d14700 2024-06-18T02:20:15.080 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6 smithi130 running (2m) 15s ago 19m 58.5M 2736M 19.0.0-3124-g3781e3a5 af93c036e016 eb813977281a 2024-06-18T02:20:15.080 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7 smithi130 running (89s) 15s ago 19m 50.3M 2736M 19.0.0-3124-g3781e3a5 af93c036e016 315f4e6d26b8 2024-06-18T02:20:15.080 INFO:teuthology.orchestra.run.smithi007.stdout:prometheus.a smithi130 *:9095 running (11m) 15s ago 18m 75.9M - 2.33.4 514e6a882f6e e905fb2eb4a6 2024-06-18T02:20:15.080 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi007.dvbvbk smithi007 *:8000 running (70s) 5s ago 17m - - 19.0.0-3124-g3781e3a5 af93c036e016 dab0a098ae9c 2024-06-18T02:20:15.080 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi130.aakmof smithi130 *:8000 running (58s) 15s ago 17m 76.5M - 19.0.0-3124-g3781e3a5 af93c036e016 70814d40f95d 2024-06-18T02:20:15.081 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi007.hgrnmk smithi007 *:80 running (63s) 5s ago 16m - - 19.0.0-3124-g3781e3a5 af93c036e016 b36d62aa6da2 2024-06-18T02:20:15.081 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi130.wwebfk smithi130 *:80 running (50s) 15s ago 16m 79.5M - 19.0.0-3124-g3781e3a5 af93c036e016 1441378e1002 2024-06-18T02:20:15.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:15 smithi130 ceph-mon[84407]: from='client.94869 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:20:15.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:15 smithi007 ceph-mon[113333]: from='client.94869 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:20:15.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:15 smithi007 ceph-mon[99735]: from='client.94869 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:20:16.055 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -e sha1=3781e3a592387d16e8020f5db99cdee4198f6d00 -- bash -c 'ceph versions' 2024-06-18T02:20:16.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:16 smithi007 ceph-mon[99735]: pgmap v458: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-06-18T02:20:16.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:16 smithi007 ceph-mon[113333]: pgmap v458: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-06-18T02:20:16.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:16 smithi130 ceph-mon[84407]: pgmap v458: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-06-18T02:20:18.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:20:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:20:17] "GET /metrics HTTP/1.1" 200 38744 "" "Prometheus/2.33.4" 2024-06-18T02:20:18.563 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:20:18.563 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": { 2024-06-18T02:20:18.563 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 3 2024-06-18T02:20:18.563 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:20:18.563 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": { 2024-06-18T02:20:18.563 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 2 2024-06-18T02:20:18.563 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:20:18.563 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": { 2024-06-18T02:20:18.563 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 8 2024-06-18T02:20:18.563 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:20:18.563 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw": { 2024-06-18T02:20:18.564 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 4 2024-06-18T02:20:18.564 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:20:18.564 INFO:teuthology.orchestra.run.smithi007.stdout: "overall": { 2024-06-18T02:20:18.564 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 17 2024-06-18T02:20:18.564 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-06-18T02:20:18.564 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:20:18.859 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:18 smithi007 ceph-mon[113333]: pgmap v459: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-06-18T02:20:18.860 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:18 smithi007 ceph-mon[99735]: pgmap v459: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-06-18T02:20:19.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:18 smithi130 ceph-mon[84407]: pgmap v459: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-06-18T02:20:19.186 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -e sha1=3781e3a592387d16e8020f5db99cdee4198f6d00 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-06-18T02:20:19.753 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:19 smithi007 ceph-mon[113333]: from='client.? 172.21.15.7:0/191035426' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:20:19.754 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:19 smithi007 ceph-mon[99735]: from='client.? 172.21.15.7:0/191035426' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:20:19.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:19 smithi130 ceph-mon[84407]: from='client.? 172.21.15.7:0/191035426' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:20:20.751 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:20 smithi007 ceph-mon[113333]: pgmap v460: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-06-18T02:20:20.751 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:20 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:20.751 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:20 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:20.751 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:20 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:20.751 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:20 smithi007 ceph-mon[99735]: pgmap v460: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-06-18T02:20:20.751 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:20 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:20.751 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:20 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:20.751 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:20 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:20.960 INFO:teuthology.orchestra.run.smithi007.stdout:wait for servicemap items w/ changing names to refresh 2024-06-18T02:20:21.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:20 smithi130 ceph-mon[84407]: pgmap v460: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-06-18T02:20:21.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:20 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:21.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:20 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:21.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:20 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:21.767 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -e sha1=3781e3a592387d16e8020f5db99cdee4198f6d00 -- bash -c 'sleep 60' 2024-06-18T02:20:22.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:22 smithi130 ceph-mon[84407]: pgmap v461: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:20:22.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:22 smithi130 ceph-mon[84407]: from='client.54883 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:20:22.931 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:22 smithi007 ceph-mon[99735]: pgmap v461: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:20:22.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:22 smithi007 ceph-mon[99735]: from='client.54883 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:20:22.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:22 smithi007 ceph-mon[113333]: pgmap v461: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:20:22.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:22 smithi007 ceph-mon[113333]: from='client.54883 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:20:24.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:24 smithi007 ceph-mon[113333]: pgmap v462: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:20:24.931 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:24 smithi007 ceph-mon[99735]: pgmap v462: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:20:25.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:24 smithi130 ceph-mon[84407]: pgmap v462: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:20:26.758 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:26 smithi007 ceph-mon[113333]: pgmap v463: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:20:26.759 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:26 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:20:26.759 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:26 smithi007 ceph-mon[99735]: pgmap v463: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:20:26.759 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:26 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:20:27.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:26 smithi130 ceph-mon[84407]: pgmap v463: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:20:27.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:26 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:20:28.043 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:20:27 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:20:27] "GET /metrics HTTP/1.1" 200 38745 "" "Prometheus/2.33.4" 2024-06-18T02:20:28.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:27 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:28.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:27 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:28.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:27 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:28.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:27 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:28.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:27 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:28.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:27 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:28.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:27 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:28.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:27 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:28.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:27 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:29.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:28 smithi130 ceph-mon[84407]: pgmap v464: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:20:29.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:28 smithi007 ceph-mon[113333]: pgmap v464: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:20:29.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:28 smithi007 ceph-mon[99735]: pgmap v464: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:20:31.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:30 smithi130 ceph-mon[84407]: pgmap v465: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:20:31.092 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:30 smithi007 ceph-mon[113333]: pgmap v465: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:20:31.092 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:30 smithi007 ceph-mon[99735]: pgmap v465: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:20:32.931 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:32 smithi007 ceph-mon[99735]: pgmap v466: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:20:32.932 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:32 smithi007 ceph-mon[99735]: from='client.54883 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:20:32.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:32 smithi007 ceph-mon[113333]: pgmap v466: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:20:32.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:32 smithi007 ceph-mon[113333]: from='client.54883 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:20:33.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:32 smithi130 ceph-mon[84407]: pgmap v466: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:20:33.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:32 smithi130 ceph-mon[84407]: from='client.54883 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:20:35.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:34 smithi130 ceph-mon[84407]: pgmap v467: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:20:35.181 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:34 smithi007 ceph-mon[99735]: pgmap v467: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:20:35.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:34 smithi007 ceph-mon[113333]: pgmap v467: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:20:37.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:36 smithi130 ceph-mon[84407]: pgmap v468: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:20:37.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:36 smithi007 ceph-mon[113333]: pgmap v468: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:20:37.181 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:36 smithi007 ceph-mon[99735]: pgmap v468: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:20:38.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:20:37 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:20:37] "GET /metrics HTTP/1.1" 200 38745 "" "Prometheus/2.33.4" 2024-06-18T02:20:39.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:38 smithi130 ceph-mon[84407]: pgmap v469: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:20:39.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:38 smithi007 ceph-mon[113333]: pgmap v469: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:20:39.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:38 smithi007 ceph-mon[99735]: pgmap v469: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:20:41.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:40 smithi130 ceph-mon[84407]: pgmap v470: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:20:41.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:40 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:41.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:40 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:41.044 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:40 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:41.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:40 smithi007 ceph-mon[113333]: pgmap v470: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:20:41.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:40 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:41.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:40 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:41.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:40 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:41.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:40 smithi007 ceph-mon[99735]: pgmap v470: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:20:41.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:40 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:41.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:40 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:41.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:40 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:42.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:41 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:20:42.073 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:41 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:20:42.073 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:41 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:20:42.992 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:42 smithi130 ceph-mon[84407]: pgmap v471: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:20:42.992 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:42 smithi130 ceph-mon[84407]: from='client.54883 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:20:43.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:42 smithi007 ceph-mon[113333]: pgmap v471: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:20:43.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:42 smithi007 ceph-mon[113333]: from='client.54883 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:20:43.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:42 smithi007 ceph-mon[99735]: pgmap v471: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:20:43.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:42 smithi007 ceph-mon[99735]: from='client.54883 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:20:45.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:44 smithi130 ceph-mon[84407]: pgmap v472: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:20:45.181 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:44 smithi007 ceph-mon[99735]: pgmap v472: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:20:45.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:44 smithi007 ceph-mon[113333]: pgmap v472: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:20:47.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:46 smithi130 ceph-mon[84407]: pgmap v473: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:20:47.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:46 smithi007 ceph-mon[113333]: pgmap v473: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:20:47.181 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:46 smithi007 ceph-mon[99735]: pgmap v473: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:20:48.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:47 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:48.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:47 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:48.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:47 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:48.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:47 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:48.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:47 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:48.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:47 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:48.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:47 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:48.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:47 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:48.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:47 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:20:48.294 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:20:47 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:20:47] "GET /metrics HTTP/1.1" 200 38746 "" "Prometheus/2.33.4" 2024-06-18T02:20:49.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:48 smithi007 ceph-mon[113333]: pgmap v474: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:20:49.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:48 smithi007 ceph-mon[99735]: pgmap v474: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:20:49.194 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:48 smithi130 ceph-mon[84407]: pgmap v474: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:20:51.006 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:50 smithi007 ceph-mon[113333]: pgmap v475: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:20:51.006 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:50 smithi007 ceph-mon[99735]: pgmap v475: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:20:51.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:50 smithi130 ceph-mon[84407]: pgmap v475: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:20:53.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:52 smithi007 ceph-mon[113333]: pgmap v476: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:20:53.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:52 smithi007 ceph-mon[113333]: from='client.54883 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:20:53.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:52 smithi007 ceph-mon[99735]: pgmap v476: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:20:53.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:52 smithi007 ceph-mon[99735]: from='client.54883 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:20:53.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:52 smithi130 ceph-mon[84407]: pgmap v476: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:20:53.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:52 smithi130 ceph-mon[84407]: from='client.54883 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:20:55.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:54 smithi130 ceph-mon[84407]: pgmap v477: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:20:55.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:54 smithi007 ceph-mon[113333]: pgmap v477: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:20:55.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:54 smithi007 ceph-mon[99735]: pgmap v477: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:20:57.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:56 smithi007 ceph-mon[113333]: pgmap v478: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:20:57.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:20:57.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:56 smithi007 ceph-mon[99735]: pgmap v478: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:20:57.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:20:57.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:56 smithi130 ceph-mon[84407]: pgmap v478: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:20:57.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:20:58.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:20:57 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:20:57] "GET /metrics HTTP/1.1" 200 38750 "" "Prometheus/2.33.4" 2024-06-18T02:20:59.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:20:58 smithi007 ceph-mon[113333]: pgmap v479: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:20:59.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:20:58 smithi007 ceph-mon[99735]: pgmap v479: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:20:59.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:20:58 smithi130 ceph-mon[84407]: pgmap v479: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:21:01.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:00 smithi007 ceph-mon[113333]: pgmap v480: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:21:01.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:00 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:21:01.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:00 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:21:01.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:00 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:21:01.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:00 smithi007 ceph-mon[99735]: pgmap v480: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:21:01.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:00 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:21:01.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:00 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:21:01.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:00 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:21:01.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:00 smithi130 ceph-mon[84407]: pgmap v480: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:21:01.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:00 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:21:01.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:00 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:21:01.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:00 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:21:03.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:02 smithi007 ceph-mon[99735]: pgmap v481: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:21:03.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:02 smithi007 ceph-mon[99735]: from='client.54883 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:21:03.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:02 smithi007 ceph-mon[113333]: pgmap v481: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:21:03.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:02 smithi007 ceph-mon[113333]: from='client.54883 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:21:03.194 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:02 smithi130 ceph-mon[84407]: pgmap v481: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:21:03.194 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:02 smithi130 ceph-mon[84407]: from='client.54883 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:21:05.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:04 smithi007 ceph-mon[113333]: pgmap v482: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:21:05.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:04 smithi007 ceph-mon[99735]: pgmap v482: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:21:05.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:04 smithi130 ceph-mon[84407]: pgmap v482: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:21:07.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:06 smithi007 ceph-mon[113333]: pgmap v483: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:21:07.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:06 smithi007 ceph-mon[99735]: pgmap v483: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:21:07.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:06 smithi130 ceph-mon[84407]: pgmap v483: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:21:08.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:08 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:21:08.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:08 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:21:08.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:08 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:21:08.294 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:21:07 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:21:07] "GET /metrics HTTP/1.1" 200 38750 "" "Prometheus/2.33.4" 2024-06-18T02:21:08.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:08 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:21:08.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:08 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:21:08.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:08 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:21:08.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:08 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:21:08.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:08 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:21:08.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:08 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:21:09.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:09 smithi130 ceph-mon[84407]: pgmap v484: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:21:09.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:09 smithi007 ceph-mon[113333]: pgmap v484: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:21:09.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:09 smithi007 ceph-mon[99735]: pgmap v484: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:21:10.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:21:10.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:10 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:21:10.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:10 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:21:10.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:21:10.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:10 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:21:10.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:10 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:21:10.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-18T02:21:10.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:10 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-18T02:21:10.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:10 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:21:11.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:11 smithi007 ceph-mon[113333]: pgmap v485: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:21:11.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:11 smithi007 ceph-mon[99735]: pgmap v485: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:21:11.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:11 smithi130 ceph-mon[84407]: pgmap v485: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:21:12.338 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:12 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:21:12.338 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:12 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:21:12.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:12 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:21:13.431 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:13 smithi007 ceph-mon[99735]: pgmap v486: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:21:13.431 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:13 smithi007 ceph-mon[99735]: from='client.54883 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:21:13.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:13 smithi007 ceph-mon[113333]: pgmap v486: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:21:13.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:13 smithi007 ceph-mon[113333]: from='client.54883 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:21:13.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:13 smithi130 ceph-mon[84407]: pgmap v486: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:21:13.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:13 smithi130 ceph-mon[84407]: from='client.54883 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:21:15.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:15 smithi007 ceph-mon[113333]: pgmap v487: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:21:15.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:15 smithi007 ceph-mon[99735]: pgmap v487: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:21:15.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:15 smithi130 ceph-mon[84407]: pgmap v487: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:21:17.431 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:17 smithi007 ceph-mon[99735]: pgmap v488: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:21:17.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:17 smithi007 ceph-mon[113333]: pgmap v488: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:21:17.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:17 smithi130 ceph-mon[84407]: pgmap v488: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:21:18.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:21:17 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:21:17] "GET /metrics HTTP/1.1" 200 38750 "" "Prometheus/2.33.4" 2024-06-18T02:21:19.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:19 smithi007 ceph-mon[113333]: pgmap v489: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:21:19.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:19 smithi007 ceph-mon[99735]: pgmap v489: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:21:19.435 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:19 smithi130 ceph-mon[84407]: pgmap v489: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:21:21.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:21 smithi130 ceph-mon[84407]: pgmap v490: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:21:21.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:21 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:21:21.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:21 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:21:21.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:21 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:21:21.431 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:21 smithi007 ceph-mon[99735]: pgmap v490: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:21:21.431 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:21 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:21:21.431 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:21 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:21:21.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:21 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:21:21.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:21 smithi007 ceph-mon[113333]: pgmap v490: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:21:21.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:21 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:21:21.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:21 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:21:21.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:21 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:21:23.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:23 smithi130 ceph-mon[84407]: pgmap v491: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:21:23.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:23 smithi130 ceph-mon[84407]: from='client.54883 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:21:23.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:23 smithi007 ceph-mon[113333]: pgmap v491: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:21:23.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:23 smithi007 ceph-mon[113333]: from='client.54883 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:21:23.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:23 smithi007 ceph-mon[99735]: pgmap v491: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:21:23.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:23 smithi007 ceph-mon[99735]: from='client.54883 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:21:24.256 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -e sha1=3781e3a592387d16e8020f5db99cdee4198f6d00 -- bash -c 'ceph orch ps' 2024-06-18T02:21:25.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:25 smithi007 ceph-mon[113333]: pgmap v492: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:21:25.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:25 smithi007 ceph-mon[99735]: pgmap v492: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:21:25.184 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:25 smithi130 ceph-mon[84407]: pgmap v492: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:21:26.333 INFO:teuthology.orchestra.run.smithi007.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-18T02:21:26.333 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi007 smithi007 running 19s ago 24m - - 2024-06-18T02:21:26.333 INFO:teuthology.orchestra.run.smithi007.stdout:agent.smithi130 smithi130 running 6s ago 24m - - 2024-06-18T02:21:26.333 INFO:teuthology.orchestra.run.smithi007.stdout:alertmanager.a smithi007 *:9093,9094 running (14m) 19s ago 19m - - 0.23.0 ba2b418f427c 5994e8525c64 2024-06-18T02:21:26.333 INFO:teuthology.orchestra.run.smithi007.stdout:grafana.a smithi130 *:3000 running (13m) 6s ago 19m 49.7M - 8.3.5 dad864ee21e9 70ba81d97c8e 2024-06-18T02:21:26.333 INFO:teuthology.orchestra.run.smithi007.stdout:iscsi.foo.smithi007.xvdrwd smithi007 running (94s) 19s ago 17m - - 3.8 af93c036e016 2704f5806238 2024-06-18T02:21:26.333 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.x smithi130 *:8443,9283,8765 running (13m) 6s ago 23m 540M - 19.0.0-3124-g3781e3a5 af93c036e016 01017e37bdbe 2024-06-18T02:21:26.334 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.y smithi007 *:8443,9283,8765 running (11m) 19s ago 25m - - 19.0.0-3124-g3781e3a5 af93c036e016 2141e131e896 2024-06-18T02:21:26.334 INFO:teuthology.orchestra.run.smithi007.stdout:mon.a smithi007 running (9m) 19s ago 25m - 2048M 19.0.0-3124-g3781e3a5 af93c036e016 7bbe646cd5b7 2024-06-18T02:21:26.334 INFO:teuthology.orchestra.run.smithi007.stdout:mon.b smithi130 running (10m) 6s ago 24m 66.7M 2048M 19.0.0-3124-g3781e3a5 af93c036e016 baacf2add994 2024-06-18T02:21:26.334 INFO:teuthology.orchestra.run.smithi007.stdout:mon.c smithi007 running (10m) 19s ago 24m - 2048M 19.0.0-3124-g3781e3a5 af93c036e016 39418356156e 2024-06-18T02:21:26.334 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.a smithi007 *:9100 running (14m) 19s ago 19m - - 1.3.1 1dbe0e931976 8128e558f099 2024-06-18T02:21:26.334 INFO:teuthology.orchestra.run.smithi007.stdout:node-exporter.b smithi130 *:9100 running (14m) 6s ago 19m 17.1M - 1.3.1 1dbe0e931976 bab93b43cf16 2024-06-18T02:21:26.334 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0 smithi007 running (8m) 19s ago 23m - 2481M 19.0.0-3124-g3781e3a5 af93c036e016 07c7f4afd49a 2024-06-18T02:21:26.334 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1 smithi007 running (7m) 19s ago 23m - 2481M 19.0.0-3124-g3781e3a5 af93c036e016 e8d184614e94 2024-06-18T02:21:26.334 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2 smithi007 running (7m) 19s ago 22m - 2481M 19.0.0-3124-g3781e3a5 af93c036e016 7d9a05b4bfa5 2024-06-18T02:21:26.334 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3 smithi007 running (5m) 19s ago 22m - 2481M 19.0.0-3124-g3781e3a5 af93c036e016 7e879cda3b51 2024-06-18T02:21:26.334 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4 smithi130 running (4m) 6s ago 21m 66.1M 2736M 19.0.0-3124-g3781e3a5 af93c036e016 24f46c456c31 2024-06-18T02:21:26.334 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5 smithi130 running (4m) 6s ago 21m 60.6M 2736M 19.0.0-3124-g3781e3a5 af93c036e016 210471d14700 2024-06-18T02:21:26.334 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6 smithi130 running (3m) 6s ago 21m 59.0M 2736M 19.0.0-3124-g3781e3a5 af93c036e016 eb813977281a 2024-06-18T02:21:26.335 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7 smithi130 running (2m) 6s ago 20m 51.1M 2736M 19.0.0-3124-g3781e3a5 af93c036e016 315f4e6d26b8 2024-06-18T02:21:26.335 INFO:teuthology.orchestra.run.smithi007.stdout:prometheus.a smithi130 *:9095 running (12m) 6s ago 20m 75.9M - 2.33.4 514e6a882f6e e905fb2eb4a6 2024-06-18T02:21:26.335 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi007.dvbvbk smithi007 *:8000 running (2m) 19s ago 18m - - 19.0.0-3124-g3781e3a5 af93c036e016 dab0a098ae9c 2024-06-18T02:21:26.335 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.foo.smithi130.aakmof smithi130 *:8000 running (2m) 6s ago 18m 77.5M - 19.0.0-3124-g3781e3a5 af93c036e016 70814d40f95d 2024-06-18T02:21:26.335 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi007.hgrnmk smithi007 *:80 running (2m) 19s ago 18m - - 19.0.0-3124-g3781e3a5 af93c036e016 b36d62aa6da2 2024-06-18T02:21:26.335 INFO:teuthology.orchestra.run.smithi007.stdout:rgw.smpl.smithi130.wwebfk smithi130 *:80 running (2m) 6s ago 18m 80.5M - 19.0.0-3124-g3781e3a5 af93c036e016 1441378e1002 2024-06-18T02:21:26.945 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -e sha1=3781e3a592387d16e8020f5db99cdee4198f6d00 -- bash -c 'ceph versions' 2024-06-18T02:21:27.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:27 smithi007 ceph-mon[113333]: pgmap v493: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:21:27.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:27 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:21:27.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:27 smithi007 ceph-mon[99735]: pgmap v493: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:21:27.182 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:27 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:21:27.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:27 smithi130 ceph-mon[84407]: pgmap v493: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:21:27.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:27 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:21:28.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:21:27 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:21:27] "GET /metrics HTTP/1.1" 200 38746 "" "Prometheus/2.33.4" 2024-06-18T02:21:28.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:28 smithi130 ceph-mon[84407]: from='client.94881 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:21:28.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:28 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:21:28.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:28 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:21:28.294 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:28 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:21:28.294 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:28 smithi007 ceph-mon[113333]: from='client.94881 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:21:28.294 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:28 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:21:28.294 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:28 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:21:28.294 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:28 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:21:28.294 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:28 smithi007 ceph-mon[99735]: from='client.94881 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:21:28.295 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:28 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:21:28.295 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:28 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:21:28.295 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:28 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:21:29.131 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:21:29.132 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": { 2024-06-18T02:21:29.132 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 3 2024-06-18T02:21:29.132 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:21:29.132 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": { 2024-06-18T02:21:29.132 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 2 2024-06-18T02:21:29.132 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:21:29.132 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": { 2024-06-18T02:21:29.132 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 8 2024-06-18T02:21:29.132 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:21:29.132 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw": { 2024-06-18T02:21:29.132 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 4 2024-06-18T02:21:29.132 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-06-18T02:21:29.133 INFO:teuthology.orchestra.run.smithi007.stdout: "overall": { 2024-06-18T02:21:29.133 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)": 17 2024-06-18T02:21:29.133 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-06-18T02:21:29.133 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:21:29.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:29 smithi130 ceph-mon[84407]: pgmap v494: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:21:29.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:29 smithi007 ceph-mon[113333]: pgmap v494: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:21:29.431 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:29 smithi007 ceph-mon[99735]: pgmap v494: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:21:29.733 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -e sha1=3781e3a592387d16e8020f5db99cdee4198f6d00 -- bash -c 'ceph orch upgrade status' 2024-06-18T02:21:30.293 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:30 smithi130 ceph-mon[84407]: from='client.? 172.21.15.7:0/2089178326' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:21:30.362 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:30 smithi007 ceph-mon[113333]: from='client.? 172.21.15.7:0/2089178326' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:21:30.362 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:30 smithi007 ceph-mon[99735]: from='client.? 172.21.15.7:0/2089178326' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:21:31.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:31 smithi007 ceph-mon[113333]: pgmap v495: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:21:31.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:31 smithi007 ceph-mon[99735]: pgmap v495: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:21:31.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:31 smithi130 ceph-mon[84407]: pgmap v495: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:21:33.151 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:21:33.151 INFO:teuthology.orchestra.run.smithi007.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00", 2024-06-18T02:21:33.151 INFO:teuthology.orchestra.run.smithi007.stdout: "in_progress": true, 2024-06-18T02:21:33.151 INFO:teuthology.orchestra.run.smithi007.stdout: "which": "Upgrading all daemon types on all hosts", 2024-06-18T02:21:33.151 INFO:teuthology.orchestra.run.smithi007.stdout: "services_complete": [ 2024-06-18T02:21:33.152 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr", 2024-06-18T02:21:33.152 INFO:teuthology.orchestra.run.smithi007.stdout: "iscsi", 2024-06-18T02:21:33.152 INFO:teuthology.orchestra.run.smithi007.stdout: "osd", 2024-06-18T02:21:33.152 INFO:teuthology.orchestra.run.smithi007.stdout: "mon", 2024-06-18T02:21:33.152 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw" 2024-06-18T02:21:33.152 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-06-18T02:21:33.152 INFO:teuthology.orchestra.run.smithi007.stdout: "progress": "18/23 daemons upgraded", 2024-06-18T02:21:33.152 INFO:teuthology.orchestra.run.smithi007.stdout: "message": "Error: UPGRADE_REDEPLOY_DAEMON: Upgrading daemon iscsi.foo.smithi007.xvdrwd on host smithi007 failed.", 2024-06-18T02:21:33.152 INFO:teuthology.orchestra.run.smithi007.stdout: "is_paused": true 2024-06-18T02:21:33.152 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:21:33.153 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:33 smithi007 ceph-mon[113333]: pgmap v496: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:21:33.153 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:33 smithi007 ceph-mon[113333]: from='client.54883 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:21:33.153 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:33 smithi007 ceph-mon[99735]: pgmap v496: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:21:33.153 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:33 smithi007 ceph-mon[99735]: from='client.54883 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:21:33.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:33 smithi130 ceph-mon[84407]: pgmap v496: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:21:33.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:33 smithi130 ceph-mon[84407]: from='client.54883 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:21:34.379 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:34 smithi007 ceph-mon[113333]: from='client.94893 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:21:34.380 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:34 smithi007 ceph-mon[99735]: from='client.94893 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:21:34.409 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -e sha1=3781e3a592387d16e8020f5db99cdee4198f6d00 -- bash -c 'ceph health detail' 2024-06-18T02:21:34.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:34 smithi130 ceph-mon[84407]: from='client.94893 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:21:35.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:35 smithi007 ceph-mon[113333]: pgmap v497: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:21:35.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:35 smithi007 ceph-mon[99735]: pgmap v497: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:21:35.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:35 smithi130 ceph-mon[84407]: pgmap v497: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:21:36.495 INFO:teuthology.orchestra.run.smithi007.stdout:HEALTH_WARN Upgrading daemon iscsi.foo.smithi007.xvdrwd on host smithi007 failed. 2024-06-18T02:21:36.495 INFO:teuthology.orchestra.run.smithi007.stdout:[WRN] UPGRADE_REDEPLOY_DAEMON: Upgrading daemon iscsi.foo.smithi007.xvdrwd on host smithi007 failed. 2024-06-18T02:21:36.495 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrade daemon: iscsi.foo.smithi007.xvdrwd: cephadm exited with an error code: 1, stderr: Redeploy daemon iscsi.foo.smithi007.xvdrwd ... 2024-06-18T02:21:36.495 INFO:teuthology.orchestra.run.smithi007.stdout:Creating ceph-iscsi config... 2024-06-18T02:21:36.495 INFO:teuthology.orchestra.run.smithi007.stdout:Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/iscsi-gateway.cfg 2024-06-18T02:21:36.495 INFO:teuthology.orchestra.run.smithi007.stdout:Write file: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/iscsi.foo.smithi007.xvdrwd/tcmu-runner-entrypoint.sh 2024-06-18T02:21:36.495 INFO:teuthology.orchestra.run.smithi007.stdout:Failed to trim old cgroups /sys/fs/cgroup/system.slice/system-ceph\x2dcd9a3408\x2d2d15\x2d11ef\x2dbc9d\x2dc7b262605968.slice/ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service 2024-06-18T02:21:36.495 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl start ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd 2024-06-18T02:21:36.495 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:21:36.495 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:21:36.495 INFO:teuthology.orchestra.run.smithi007.stdout:Traceback (most recent call last): 2024-06-18T02:21:36.496 INFO:teuthology.orchestra.run.smithi007.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-06-18T02:21:36.496 INFO:teuthology.orchestra.run.smithi007.stdout: return _run_code(code, main_globals, None, 2024-06-18T02:21:36.496 INFO:teuthology.orchestra.run.smithi007.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-06-18T02:21:36.496 INFO:teuthology.orchestra.run.smithi007.stdout: exec(code, run_globals) 2024-06-18T02:21:36.496 INFO:teuthology.orchestra.run.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5618, in 2024-06-18T02:21:36.496 INFO:teuthology.orchestra.run.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 5606, in main 2024-06-18T02:21:36.496 INFO:teuthology.orchestra.run.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3096, in command_deploy_from 2024-06-18T02:21:36.496 INFO:teuthology.orchestra.run.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3131, in _common_deploy 2024-06-18T02:21:36.496 INFO:teuthology.orchestra.run.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 3151, in _deploy_daemon_container 2024-06-18T02:21:36.496 INFO:teuthology.orchestra.run.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 1087, in deploy_daemon 2024-06-18T02:21:36.496 INFO:teuthology.orchestra.run.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/__main__.py", line 1223, in deploy_daemon_units 2024-06-18T02:21:36.496 INFO:teuthology.orchestra.run.smithi007.stdout: File "/tmp/tmp3vdsh41i.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-06-18T02:21:36.496 INFO:teuthology.orchestra.run.smithi007.stdout:RuntimeError: Failed command: systemctl start ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd: Job for ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service failed because the control process exited with error code. 2024-06-18T02:21:36.496 INFO:teuthology.orchestra.run.smithi007.stdout:See "systemctl status ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" and "journalctl -xeu ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@iscsi.foo.smithi007.xvdrwd.service" for details. 2024-06-18T02:21:37.111 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:37 smithi007 ceph-mon[113333]: pgmap v498: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:21:37.111 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:37 smithi007 ceph-mon[113333]: from='client.? 172.21.15.7:0/1936876812' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:21:37.111 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:37 smithi007 ceph-mon[99735]: pgmap v498: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:21:37.111 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:37 smithi007 ceph-mon[99735]: from='client.? 172.21.15.7:0/1936876812' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:21:37.140 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -e sha1=3781e3a592387d16e8020f5db99cdee4198f6d00 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-06-18T02:21:37.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:37 smithi130 ceph-mon[84407]: pgmap v498: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:21:37.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:37 smithi130 ceph-mon[84407]: from='client.? 172.21.15.7:0/1936876812' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-06-18T02:21:38.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:21:37 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:21:37] "GET /metrics HTTP/1.1" 200 38746 "" "Prometheus/2.33.4" 2024-06-18T02:21:39.233 INFO:teuthology.orchestra.run.smithi007.stdout:true 2024-06-18T02:21:39.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:39 smithi007 ceph-mon[113333]: pgmap v499: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:21:39.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:39 smithi007 ceph-mon[99735]: pgmap v499: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:21:39.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:39 smithi130 ceph-mon[84407]: pgmap v499: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:21:39.840 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -e sha1=3781e3a592387d16e8020f5db99cdee4198f6d00 -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-06-18T02:21:40.153 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:40 smithi007 ceph-mon[113333]: from='client.? 172.21.15.7:0/985068702' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:21:40.153 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:40 smithi007 ceph-mon[99735]: from='client.? 172.21.15.7:0/985068702' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:21:40.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:40 smithi130 ceph-mon[84407]: from='client.? 172.21.15.7:0/985068702' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:21:41.431 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:41 smithi007 ceph-mon[99735]: pgmap v500: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:21:41.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:41 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:21:41.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:41 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:21:41.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:41 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:21:41.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:41 smithi007 ceph-mon[113333]: pgmap v500: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:21:41.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:41 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:21:41.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:41 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:21:41.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:41 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:21:41.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:41 smithi130 ceph-mon[84407]: pgmap v500: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:21:41.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:41 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:21:41.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:41 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:21:41.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:41 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:21:41.900 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph version 19.0.0-3124-g3781e3a5 (3781e3a592387d16e8020f5db99cdee4198f6d00) squid (rc)" 2024-06-18T02:21:42.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:42 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:21:42.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:42 smithi007 ceph-mon[113333]: from='client.? 172.21.15.7:0/1646410483' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:21:42.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:42 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:21:42.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:42 smithi007 ceph-mon[99735]: from='client.? 172.21.15.7:0/1646410483' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:21:42.499 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -e sha1=3781e3a592387d16e8020f5db99cdee4198f6d00 -- bash -c 'ceph orch ls | grep '"'"'^osd '"'"'' 2024-06-18T02:21:42.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:42 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:21:42.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:42 smithi130 ceph-mon[84407]: from='client.? 172.21.15.7:0/1646410483' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-06-18T02:21:43.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:43 smithi007 ceph-mon[113333]: pgmap v501: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:21:43.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:43 smithi007 ceph-mon[113333]: from='client.54883 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:21:43.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:43 smithi007 ceph-mon[99735]: pgmap v501: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:21:43.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:43 smithi007 ceph-mon[99735]: from='client.54883 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:21:43.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:43 smithi130 ceph-mon[84407]: pgmap v501: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:21:43.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:43 smithi130 ceph-mon[84407]: from='client.54883 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:21:44.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:44 smithi007 ceph-mon[113333]: pgmap v502: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:21:44.432 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:44 smithi007 ceph-mon[99735]: pgmap v502: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:21:44.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:44 smithi130 ceph-mon[84407]: pgmap v502: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:21:44.618 INFO:teuthology.orchestra.run.smithi007.stdout:osd 8 17s ago - 2024-06-18T02:21:45.287 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-06-18T02:21:45.298 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi007.front.sepia.ceph.com 2024-06-18T02:21:45.298 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- bash -c 'ceph orch upgrade ls' 2024-06-18T02:21:45.922 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:45 smithi007 ceph-mon[113333]: from='client.54955 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:21:45.923 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:45 smithi007 ceph-mon[99735]: from='client.54955 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:21:46.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:45 smithi130 ceph-mon[84407]: from='client.54955 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:21:46.878 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:46 smithi007 ceph-mon[113333]: pgmap v503: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:21:46.878 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:46 smithi007 ceph-mon[99735]: pgmap v503: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:21:46.971 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:46 smithi130 ceph-mon[84407]: pgmap v503: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:21:48.043 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:21:47 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:21:47] "GET /metrics HTTP/1.1" 200 38746 "" "Prometheus/2.33.4" 2024-06-18T02:21:48.067 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-06-18T02:21:48.067 INFO:teuthology.orchestra.run.smithi007.stdout: "image": "quay.io/ceph/ceph", 2024-06-18T02:21:48.067 INFO:teuthology.orchestra.run.smithi007.stdout: "registry": "quay.io", 2024-06-18T02:21:48.067 INFO:teuthology.orchestra.run.smithi007.stdout: "bare_image": "ceph/ceph", 2024-06-18T02:21:48.067 INFO:teuthology.orchestra.run.smithi007.stdout: "versions": [] 2024-06-18T02:21:48.067 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-06-18T02:21:48.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:48 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:21:48.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:48 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:21:48.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:48 smithi007 ceph-mon[113333]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:21:48.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:48 smithi007 ceph-mon[113333]: from='client.94923 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:21:48.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:48 smithi007 ceph-mon[113333]: pgmap v504: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:21:48.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:48 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:21:48.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:48 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:21:48.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:48 smithi007 ceph-mon[99735]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:21:48.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:48 smithi007 ceph-mon[99735]: from='client.94923 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:21:48.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:48 smithi007 ceph-mon[99735]: pgmap v504: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:21:48.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:48 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:21:48.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:48 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:21:48.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:48 smithi130 ceph-mon[84407]: from='mgr.25310 ' entity='mgr.x' 2024-06-18T02:21:48.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:48 smithi130 ceph-mon[84407]: from='client.94923 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:21:48.794 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:48 smithi130 ceph-mon[84407]: pgmap v504: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:21:48.812 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- bash -c 'ceph orch upgrade ls --image quay.io/ceph/ceph --show-all-versions | grep 16.2.0' 2024-06-18T02:21:50.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:50 smithi007 ceph-mon[113333]: pgmap v505: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:21:50.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:50 smithi007 ceph-mon[99735]: pgmap v505: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:21:51.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:50 smithi130 ceph-mon[84407]: pgmap v505: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:21:51.611 INFO:teuthology.orchestra.run.smithi007.stdout: "16.2.0", 2024-06-18T02:21:51.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:51 smithi007 ceph-mon[113333]: from='client.54967 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "image": "quay.io/ceph/ceph", "show_all_versions": true, "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:21:51.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:51 smithi007 ceph-mon[99735]: from='client.54967 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "image": "quay.io/ceph/ceph", "show_all_versions": true, "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:21:51.843 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:51 smithi130 ceph-mon[84407]: from='client.54967 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "image": "quay.io/ceph/ceph", "show_all_versions": true, "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:21:52.300 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 -- bash -c 'ceph orch upgrade ls --image quay.io/ceph/ceph --tags | grep v16.2.2' 2024-06-18T02:21:52.852 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:52 smithi007 ceph-mon[113333]: pgmap v506: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:21:52.852 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:52 smithi007 ceph-mon[113333]: from='client.54883 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:21:52.852 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:52 smithi007 ceph-mon[99735]: pgmap v506: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:21:52.853 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:52 smithi007 ceph-mon[99735]: from='client.54883 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:21:53.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:52 smithi130 ceph-mon[84407]: pgmap v506: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:21:53.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:52 smithi130 ceph-mon[84407]: from='client.54883 -' entity='client.iscsi.foo.smithi007.xvdrwd' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-06-18T02:21:54.776 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:54 smithi007 ceph-mon[113333]: pgmap v507: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:21:54.776 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:54 smithi007 ceph-mon[99735]: pgmap v507: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:21:55.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:54 smithi130 ceph-mon[84407]: pgmap v507: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-06-18T02:21:55.848 INFO:teuthology.orchestra.run.smithi007.stdout: "v16.2.2", 2024-06-18T02:21:55.848 INFO:teuthology.orchestra.run.smithi007.stdout: "v16.2.2-20210505", 2024-06-18T02:21:55.849 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:55 smithi007 ceph-mon[113333]: from='client.54973 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "image": "quay.io/ceph/ceph", "tags": true, "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:21:55.849 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:55 smithi007 ceph-mon[99735]: from='client.54973 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "image": "quay.io/ceph/ceph", "tags": true, "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:21:56.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:55 smithi130 ceph-mon[84407]: from='client.54973 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "image": "quay.io/ceph/ceph", "tags": true, "target": ["mon-mgr", ""]}]: dispatch 2024-06-18T02:21:56.445 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-06-18T02:21:56.456 INFO:tasks.cephadm:Teardown begin 2024-06-18T02:21:56.457 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-18T02:21:56.489 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-18T02:21:56.523 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-06-18T02:21:56.523 DEBUG:teuthology.orchestra.run.smithi007:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-06-18T02:21:56.547 DEBUG:teuthology.orchestra.run.smithi130:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-06-18T02:21:56.579 INFO:tasks.cephadm:Stopping all daemons... 2024-06-18T02:21:56.580 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-06-18T02:21:56.580 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mon.a 2024-06-18T02:21:56.681 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:56 smithi007 ceph-mon[99735]: pgmap v508: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:21:56.682 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:56 smithi007 ceph-mon[99735]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:21:56.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:56 smithi007 ceph-mon[113333]: pgmap v508: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:21:56.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:56 smithi007 ceph-mon[113333]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:21:56.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:56 smithi007 systemd[1]: Stopping Ceph mon.a for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:21:56.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:56 smithi130 ceph-mon[84407]: pgmap v508: 161 pgs: 161 active+clean; 585 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-06-18T02:21:56.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:56 smithi130 ceph-mon[84407]: from='mgr.25310 172.21.15.130:0/1955986049' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-06-18T02:21:57.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:56 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-a[113329]: 2024-06-18T02:21:56.884+0000 7f3b18025640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-06-18T02:21:57.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:56 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-a[113329]: 2024-06-18T02:21:56.884+0000 7f3b18025640 -1 mon.a@0(leader) e4 *** Got Signal Terminated *** 2024-06-18T02:21:57.181 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:57 smithi007 podman[188919]: 2024-06-18 02:21:57.079536673 +0000 UTC m=+0.293703043 container died 7bbe646cd5b70575ab99b276f779bc3de110ae8df5abfe7c6cc37a2172dadf22 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-a, org.label-schema.vendor=CentOS, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240612, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_CLEAN=True, RELEASE=squid-3781e3a) 2024-06-18T02:21:57.681 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:57 smithi007 podman[188919]: 2024-06-18 02:21:57.443114393 +0000 UTC m=+0.657280766 container cleanup 7bbe646cd5b70575ab99b276f779bc3de110ae8df5abfe7c6cc37a2172dadf22 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-a, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-3781e3a, GIT_BRANCH=HEAD, org.label-schema.build-date=20240612) 2024-06-18T02:21:57.682 INFO:journalctl@ceph.mon.a.smithi007.stdout:Jun 18 02:21:57 smithi007 bash[188919]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-a 2024-06-18T02:21:57.874 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mon.a.service' 2024-06-18T02:21:57.924 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-18T02:21:57.924 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-06-18T02:21:57.924 INFO:tasks.cephadm.mon.b:Stopping mon.c... 2024-06-18T02:21:57.924 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mon.c 2024-06-18T02:21:58.221 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:57 smithi007 systemd[1]: Stopping Ceph mon.c for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:21:58.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:21:57 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: ::ffff:172.21.15.130 - - [18/Jun/2024:02:21:57] "GET /metrics HTTP/1.1" 200 38749 "" "Prometheus/2.33.4" 2024-06-18T02:21:58.648 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-c[99731]: 2024-06-18T02:21:58.221+0000 7fd95015a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-06-18T02:21:58.648 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:58 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-c[99731]: 2024-06-18T02:21:58.221+0000 7fd95015a640 -1 mon.c@1(peon) e4 *** Got Signal Terminated *** 2024-06-18T02:21:58.648 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:58 smithi007 podman[189040]: 2024-06-18 02:21:58.407033268 +0000 UTC m=+0.292543825 container died 39418356156e8a41c4d75ad20e8fe50303fa00ea6f1c4c7d9a220d8de30e13bf (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-c, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240612, ceph=True, RELEASE=squid-3781e3a, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, io.buildah.version=1.36.0) 2024-06-18T02:21:58.931 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:58 smithi007 podman[189040]: 2024-06-18 02:21:58.739326364 +0000 UTC m=+0.624836918 container cleanup 39418356156e8a41c4d75ad20e8fe50303fa00ea6f1c4c7d9a220d8de30e13bf (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-c, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240612, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-3781e3a, ceph=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.name=CentOS Stream 9 Base Image) 2024-06-18T02:21:58.931 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:58 smithi007 bash[189040]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-c 2024-06-18T02:21:59.207 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mon.c.service' 2024-06-18T02:21:59.230 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:58 smithi007 podman[189054]: 2024-06-18 02:21:58.975154212 +0000 UTC m=+0.558180299 container remove 39418356156e8a41c4d75ad20e8fe50303fa00ea6f1c4c7d9a220d8de30e13bf (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-c, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, ceph=True, org.label-schema.build-date=20240612, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-3781e3a, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47) 2024-06-18T02:21:59.230 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:59 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mon.c.service: Deactivated successfully. 2024-06-18T02:21:59.230 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:59 smithi007 systemd[1]: Stopped Ceph mon.c for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:21:59.230 INFO:journalctl@ceph.mon.c.smithi007.stdout:Jun 18 02:21:59 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mon.c.service: Consumed 13.332s CPU time. 2024-06-18T02:21:59.244 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-18T02:21:59.245 INFO:tasks.cephadm.mon.b:Stopped mon.c 2024-06-18T02:21:59.245 INFO:tasks.cephadm.mon.b:Stopping mon.b... 2024-06-18T02:21:59.245 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mon.b 2024-06-18T02:21:59.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:59 smithi130 systemd[1]: Stopping Ceph mon.b for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:22:00.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:59 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-b[84402]: 2024-06-18T02:21:59.636+0000 7f965b081640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-06-18T02:22:00.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:59 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-b[84402]: 2024-06-18T02:21:59.636+0000 7f965b081640 -1 mon.b@2(peon) e4 *** Got Signal Terminated *** 2024-06-18T02:22:00.043 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:21:59 smithi130 podman[157515]: 2024-06-18 02:21:59.872393586 +0000 UTC m=+0.430269754 container died baacf2add994e89cba2a7722dc5b0adcbabc1935ed9b1e00c060f803e5cb01e5 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-b, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240612, ceph=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, RELEASE=squid-3781e3a, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0) 2024-06-18T02:22:00.543 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:22:00 smithi130 podman[157515]: 2024-06-18 02:22:00.382949918 +0000 UTC m=+0.940826090 container cleanup baacf2add994e89cba2a7722dc5b0adcbabc1935ed9b1e00c060f803e5cb01e5 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-b, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, GIT_CLEAN=True, RELEASE=squid-3781e3a, ceph=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240612) 2024-06-18T02:22:00.544 INFO:journalctl@ceph.mon.b.smithi130.stdout:Jun 18 02:22:00 smithi130 bash[157515]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mon-b 2024-06-18T02:22:00.762 DEBUG:teuthology.orchestra.run.smithi130:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mon.b.service' 2024-06-18T02:22:00.818 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-18T02:22:00.818 INFO:tasks.cephadm.mon.b:Stopped mon.b 2024-06-18T02:22:00.819 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-06-18T02:22:00.819 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mgr.y 2024-06-18T02:22:01.149 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:22:00 smithi007 systemd[1]: Stopping Ceph mgr.y for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:22:01.431 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:22:01 smithi007 podman[189161]: 2024-06-18 02:22:01.150921805 +0000 UTC m=+0.132059422 container died 2141e131e89678ef21692327f7ec7a11557741da08a20ec389a7587ee7bc83ba (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y, RELEASE=squid-3781e3a, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240612, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, ceph=True) 2024-06-18T02:22:01.778 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:22:01 smithi007 podman[189161]: 2024-06-18 02:22:01.519999069 +0000 UTC m=+0.501136691 container cleanup 2141e131e89678ef21692327f7ec7a11557741da08a20ec389a7587ee7bc83ba (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-3781e3a, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, ceph=True, org.label-schema.build-date=20240612, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-06-18T02:22:01.778 INFO:journalctl@ceph.mgr.y.smithi007.stdout:Jun 18 02:22:01 smithi007 bash[189161]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-y 2024-06-18T02:22:01.957 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mgr.y.service' 2024-06-18T02:22:01.992 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-18T02:22:01.992 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-06-18T02:22:01.992 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-06-18T02:22:01.992 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mgr.x 2024-06-18T02:22:02.293 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:22:02 smithi130 systemd[1]: Stopping Ceph mgr.x for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:22:02.658 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:22:02 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x[59534]: 2024-06-18T02:22:02.316+0000 7f686c191640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-18T02:22:02.659 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:22:02 smithi130 podman[157661]: 2024-06-18 02:22:02.348510021 +0000 UTC m=+0.152140699 container died 01017e37bdbe757cfdd7f13646a7c8fe201fa1f456269b4d94e5c485062c26b5 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, RELEASE=squid-3781e3a, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240612, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-06-18T02:22:03.043 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:22:02 smithi130 podman[157661]: 2024-06-18 02:22:02.867957227 +0000 UTC m=+0.671587904 container cleanup 01017e37bdbe757cfdd7f13646a7c8fe201fa1f456269b4d94e5c485062c26b5 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240612, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_CLEAN=True, io.buildah.version=1.36.0, RELEASE=squid-3781e3a, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-06-18T02:22:03.043 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:22:02 smithi130 bash[157661]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x 2024-06-18T02:22:03.302 DEBUG:teuthology.orchestra.run.smithi130:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mgr.x.service' 2024-06-18T02:22:03.323 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:22:03 smithi130 podman[157676]: 2024-06-18 02:22:03.061417181 +0000 UTC m=+0.707257790 container remove 01017e37bdbe757cfdd7f13646a7c8fe201fa1f456269b4d94e5c485062c26b5 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-mgr-x, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240612, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, RELEASE=squid-3781e3a, org.label-schema.vendor=CentOS, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-06-18T02:22:03.323 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:22:03 smithi130 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mgr.x.service: Deactivated successfully. 2024-06-18T02:22:03.323 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:22:03 smithi130 systemd[1]: Stopped Ceph mgr.x for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:22:03.324 INFO:journalctl@ceph.mgr.x.smithi130.stdout:Jun 18 02:22:03 smithi130 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@mgr.x.service: Consumed 6min 10.692s CPU time. 2024-06-18T02:22:03.337 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-18T02:22:03.338 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-06-18T02:22:03.338 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-06-18T02:22:03.338 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.0 2024-06-18T02:22:03.648 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:22:03 smithi007 systemd[1]: Stopping Ceph osd.0 for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:22:03.932 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:22:03 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0[124130]: 2024-06-18T02:22:03.648+0000 7f108e8d6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-18T02:22:03.932 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:22:03 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0[124130]: 2024-06-18T02:22:03.648+0000 7f108e8d6640 -1 osd.0 196 *** Got signal Terminated *** 2024-06-18T02:22:03.932 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:22:03 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0[124130]: 2024-06-18T02:22:03.648+0000 7f108e8d6640 -1 osd.0 196 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-18T02:22:09.428 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:22:09 smithi007 podman[189283]: 2024-06-18 02:22:09.181405206 +0000 UTC m=+5.632576514 container died 07c7f4afd49aa44e8d75511e8e277438e8637858ff92c22e746f1138f0e910d8 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0, org.label-schema.build-date=20240612, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-3781e3a, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-06-18T02:22:09.681 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:22:09 smithi007 podman[189283]: 2024-06-18 02:22:09.570100595 +0000 UTC m=+6.021271899 container cleanup 07c7f4afd49aa44e8d75511e8e277438e8637858ff92c22e746f1138f0e910d8 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0, org.label-schema.schema-version=1.0, RELEASE=squid-3781e3a, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.build-date=20240612, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-06-18T02:22:09.681 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:22:09 smithi007 bash[189283]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0 2024-06-18T02:22:10.126 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:22:09 smithi007 podman[189945]: 2024-06-18 02:22:09.788014283 +0000 UTC m=+0.601304170 container remove 07c7f4afd49aa44e8d75511e8e277438e8637858ff92c22e746f1138f0e910d8 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-3781e3a, ceph=True, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.build-date=20240612, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-06-18T02:22:10.377 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:22:10 smithi007 podman[190034]: 2024-06-18 02:22:10.030369236 +0000 UTC m=+0.017732420 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:22:10.377 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:22:10 smithi007 podman[190034]: 2024-06-18 02:22:10.16405109 +0000 UTC m=+0.151414316 container create 7bd5be557a80ff9e8924c8dee8f7749e1ee578f235fa5be438df59173ce11d1b (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0-deactivate, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240612, maintainer=Guillaume Abrioux , GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.vendor=CentOS, RELEASE=squid-3781e3a, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-06-18T02:22:10.377 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:22:10 smithi007 podman[190034]: 2024-06-18 02:22:10.375036409 +0000 UTC m=+0.362399594 container init 7bd5be557a80ff9e8924c8dee8f7749e1ee578f235fa5be438df59173ce11d1b (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0-deactivate, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , RELEASE=squid-3781e3a, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240612, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-06-18T02:22:10.644 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:22:10 smithi007 podman[190034]: 2024-06-18 02:22:10.378666483 +0000 UTC m=+0.366029677 container start 7bd5be557a80ff9e8924c8dee8f7749e1ee578f235fa5be438df59173ce11d1b (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240612, RELEASE=squid-3781e3a, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-06-18T02:22:10.645 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:22:10 smithi007 podman[190034]: 2024-06-18 02:22:10.47520784 +0000 UTC m=+0.462571024 container attach 7bd5be557a80ff9e8924c8dee8f7749e1ee578f235fa5be438df59173ce11d1b (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240612, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-3781e3a, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-06-18T02:22:10.931 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:22:10 smithi007 podman[190034]: 2024-06-18 02:22:10.646564816 +0000 UTC m=+0.633928013 container died 7bd5be557a80ff9e8924c8dee8f7749e1ee578f235fa5be438df59173ce11d1b (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, RELEASE=squid-3781e3a, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240612, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux ) 2024-06-18T02:22:11.180 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.0.service' 2024-06-18T02:22:11.206 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:22:11 smithi007 podman[190057]: 2024-06-18 02:22:11.162438504 +0000 UTC m=+0.507629046 container remove 7bd5be557a80ff9e8924c8dee8f7749e1ee578f235fa5be438df59173ce11d1b (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-0-deactivate, ceph=True, RELEASE=squid-3781e3a, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.build-date=20240612, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-18T02:22:11.206 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:22:11 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.0.service: Deactivated successfully. 2024-06-18T02:22:11.206 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:22:11 smithi007 systemd[1]: Stopped Ceph osd.0 for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:22:11.206 INFO:journalctl@ceph.osd.0.smithi007.stdout:Jun 18 02:22:11 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.0.service: Consumed 9.031s CPU time. 2024-06-18T02:22:11.223 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-18T02:22:11.224 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-06-18T02:22:11.224 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-06-18T02:22:11.224 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.1 2024-06-18T02:22:11.598 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:22:11 smithi007 systemd[1]: Stopping Ceph osd.1 for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:22:11.931 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:22:11 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1[136159]: 2024-06-18T02:22:11.598+0000 7f6bfed57640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-18T02:22:11.931 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:22:11 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1[136159]: 2024-06-18T02:22:11.598+0000 7f6bfed57640 -1 osd.1 196 *** Got signal Terminated *** 2024-06-18T02:22:11.931 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:22:11 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1[136159]: 2024-06-18T02:22:11.598+0000 7f6bfed57640 -1 osd.1 196 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-18T02:22:17.387 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:22:17 smithi007 podman[190136]: 2024-06-18 02:22:17.090262601 +0000 UTC m=+5.612449555 container died e8d184614e94605360ee2acdcd3c304e962010c3e12689e8b625570af76c663a (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240612, RELEASE=squid-3781e3a, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=) 2024-06-18T02:22:17.681 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:22:17 smithi007 podman[190136]: 2024-06-18 02:22:17.478481504 +0000 UTC m=+6.000668456 container cleanup e8d184614e94605360ee2acdcd3c304e962010c3e12689e8b625570af76c663a (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240612, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-3781e3a, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0) 2024-06-18T02:22:17.681 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:22:17 smithi007 bash[190136]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1 2024-06-18T02:22:18.046 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:22:17 smithi007 podman[190279]: 2024-06-18 02:22:17.721250522 +0000 UTC m=+0.627135181 container remove e8d184614e94605360ee2acdcd3c304e962010c3e12689e8b625570af76c663a (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, RELEASE=squid-3781e3a, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.build-date=20240612, org.label-schema.license=GPLv2) 2024-06-18T02:22:18.367 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:22:18 smithi007 podman[190368]: 2024-06-18 02:22:17.950812713 +0000 UTC m=+0.018119355 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:22:18.367 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:22:18 smithi007 podman[190368]: 2024-06-18 02:22:18.055692169 +0000 UTC m=+0.122998807 container create 78b9dcec3cc5d572b1375634724f77059f378315ce81d9904a9b4f97d96a6b27 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1-deactivate, RELEASE=squid-3781e3a, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240612, io.buildah.version=1.36.0) 2024-06-18T02:22:18.367 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:22:18 smithi007 podman[190368]: 2024-06-18 02:22:18.27730067 +0000 UTC m=+0.344607316 container init 78b9dcec3cc5d572b1375634724f77059f378315ce81d9904a9b4f97d96a6b27 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-3781e3a, org.label-schema.build-date=20240612, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47) 2024-06-18T02:22:18.368 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:22:18 smithi007 podman[190368]: 2024-06-18 02:22:18.280789976 +0000 UTC m=+0.348096615 container start 78b9dcec3cc5d572b1375634724f77059f378315ce81d9904a9b4f97d96a6b27 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1-deactivate, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, RELEASE=squid-3781e3a, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.build-date=20240612, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-06-18T02:22:18.368 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:22:18 smithi007 podman[190368]: 2024-06-18 02:22:18.368953638 +0000 UTC m=+0.436260298 container attach 78b9dcec3cc5d572b1375634724f77059f378315ce81d9904a9b4f97d96a6b27 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1-deactivate, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-3781e3a, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240612, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-06-18T02:22:18.681 INFO:journalctl@ceph.osd.1.smithi007.stdout:Jun 18 02:22:18 smithi007 podman[190368]: 2024-06-18 02:22:18.548584153 +0000 UTC m=+0.615890795 container died 78b9dcec3cc5d572b1375634724f77059f378315ce81d9904a9b4f97d96a6b27 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-1-deactivate, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-3781e3a, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240612, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-06-18T02:22:19.159 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.1.service' 2024-06-18T02:22:19.202 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-18T02:22:19.202 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-06-18T02:22:19.202 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-06-18T02:22:19.202 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.2 2024-06-18T02:22:19.431 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:22:19 smithi007 systemd[1]: Stopping Ceph osd.2 for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:22:19.932 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:22:19 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2[148212]: 2024-06-18T02:22:19.551+0000 7f6c1b53b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-18T02:22:19.932 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:22:19 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2[148212]: 2024-06-18T02:22:19.551+0000 7f6c1b53b640 -1 osd.2 196 *** Got signal Terminated *** 2024-06-18T02:22:19.932 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:22:19 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2[148212]: 2024-06-18T02:22:19.551+0000 7f6c1b53b640 -1 osd.2 196 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-18T02:22:25.431 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:22:25 smithi007 podman[190472]: 2024-06-18 02:22:25.095481244 +0000 UTC m=+5.665714773 container died 7d9a05b4bfa5a510c442e580913595af7bbbfc76f5d5ae86e4a7466329366530 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240612, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-3781e3a, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.license=GPLv2) 2024-06-18T02:22:25.931 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:22:25 smithi007 podman[190472]: 2024-06-18 02:22:25.501395088 +0000 UTC m=+6.071628613 container cleanup 7d9a05b4bfa5a510c442e580913595af7bbbfc76f5d5ae86e4a7466329366530 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2, io.buildah.version=1.36.0, ceph=True, org.label-schema.build-date=20240612, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3781e3a, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.name=CentOS Stream 9 Base Image) 2024-06-18T02:22:25.931 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:22:25 smithi007 bash[190472]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2 2024-06-18T02:22:25.932 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:22:25 smithi007 podman[190491]: 2024-06-18 02:22:25.712326241 +0000 UTC m=+0.616655818 container remove 7d9a05b4bfa5a510c442e580913595af7bbbfc76f5d5ae86e4a7466329366530 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2, GIT_CLEAN=True, org.label-schema.build-date=20240612, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-3781e3a, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47) 2024-06-18T02:22:26.424 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:22:26 smithi007 podman[190583]: 2024-06-18 02:22:26.04762298 +0000 UTC m=+0.017381649 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:22:26.424 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:22:26 smithi007 podman[190583]: 2024-06-18 02:22:26.156368209 +0000 UTC m=+0.126126916 container create 2f082b28e3f56fe3899bc143522bbbaa54865a3ae51e195c35c7c96308d57a5d (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, RELEASE=squid-3781e3a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.build-date=20240612, GIT_BRANCH=HEAD) 2024-06-18T02:22:26.424 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:22:26 smithi007 podman[190583]: 2024-06-18 02:22:26.36713745 +0000 UTC m=+0.336896122 container init 2f082b28e3f56fe3899bc143522bbbaa54865a3ae51e195c35c7c96308d57a5d (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2-deactivate, RELEASE=squid-3781e3a, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240612, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-06-18T02:22:26.424 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:22:26 smithi007 podman[190583]: 2024-06-18 02:22:26.370687465 +0000 UTC m=+0.340446126 container start 2f082b28e3f56fe3899bc143522bbbaa54865a3ae51e195c35c7c96308d57a5d (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240612, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-3781e3a, io.buildah.version=1.36.0, GIT_CLEAN=True) 2024-06-18T02:22:26.424 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:22:26 smithi007 podman[190583]: 2024-06-18 02:22:26.425243915 +0000 UTC m=+0.395002580 container attach 2f082b28e3f56fe3899bc143522bbbaa54865a3ae51e195c35c7c96308d57a5d (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240612, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, RELEASE=squid-3781e3a, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True) 2024-06-18T02:22:26.681 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:22:26 smithi007 podman[190583]: 2024-06-18 02:22:26.648040739 +0000 UTC m=+0.617799406 container died 2f082b28e3f56fe3899bc143522bbbaa54865a3ae51e195c35c7c96308d57a5d (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240612, ceph=True, RELEASE=squid-3781e3a, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, GIT_BRANCH=HEAD) 2024-06-18T02:22:27.140 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.2.service' 2024-06-18T02:22:27.165 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:22:27 smithi007 podman[190606]: 2024-06-18 02:22:27.12055702 +0000 UTC m=+0.466562445 container remove 2f082b28e3f56fe3899bc143522bbbaa54865a3ae51e195c35c7c96308d57a5d (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-2-deactivate, RELEASE=squid-3781e3a, org.label-schema.build-date=20240612, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-06-18T02:22:27.165 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:22:27 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.2.service: Deactivated successfully. 2024-06-18T02:22:27.165 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:22:27 smithi007 systemd[1]: Stopped Ceph osd.2 for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:22:27.165 INFO:journalctl@ceph.osd.2.smithi007.stdout:Jun 18 02:22:27 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.2.service: Consumed 5.785s CPU time. 2024-06-18T02:22:27.183 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-18T02:22:27.183 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-06-18T02:22:27.183 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-06-18T02:22:27.183 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.3 2024-06-18T02:22:27.431 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:22:27 smithi007 systemd[1]: Stopping Ceph osd.3 for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:22:27.931 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:22:27 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3[159937]: 2024-06-18T02:22:27.523+0000 7f0657b2c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-18T02:22:27.932 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:22:27 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3[159937]: 2024-06-18T02:22:27.523+0000 7f0657b2c640 -1 osd.3 196 *** Got signal Terminated *** 2024-06-18T02:22:27.932 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:22:27 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3[159937]: 2024-06-18T02:22:27.523+0000 7f0657b2c640 -1 osd.3 196 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-18T02:22:29.931 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:22:29 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3[159937]: 2024-06-18T02:22:29.534+0000 7f065013a640 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:06.927808+0000 front 2024-06-18T02:22:06.927847+0000 (oldest deadline 2024-06-18T02:22:29.227978+0000) 2024-06-18T02:22:30.544 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:22:30 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:22:30.271Z caller=refresh.go:98 level=error component="discovery manager notify" discovery=http msg="Unable to refresh target groups" err="Get \"http://172.21.15.130:8765/sd/prometheus/sd-config?service=alertmanager\": dial tcp 172.21.15.130:8765: connect: connection refused" 2024-06-18T02:22:30.544 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:22:30 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:22:30.273Z caller=refresh.go:98 level=error component="discovery manager scrape" discovery=http msg="Unable to refresh target groups" err="Get \"http://172.21.15.130:8765/sd/prometheus/sd-config?service=ceph-exporter\": dial tcp 172.21.15.130:8765: connect: connection refused" 2024-06-18T02:22:30.544 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:22:30 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:22:30.275Z caller=refresh.go:98 level=error component="discovery manager scrape" discovery=http msg="Unable to refresh target groups" err="Get \"http://172.21.15.130:8765/sd/prometheus/sd-config?service=node-exporter\": dial tcp 172.21.15.130:8765: connect: connection refused" 2024-06-18T02:22:30.544 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:22:30 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:22:30.275Z caller=refresh.go:98 level=error component="discovery manager scrape" discovery=http msg="Unable to refresh target groups" err="Get \"http://172.21.15.130:8765/sd/prometheus/sd-config?service=nvmeof\": dial tcp 172.21.15.130:8765: connect: connection refused" 2024-06-18T02:22:30.545 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:22:30 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:22:30.275Z caller=refresh.go:98 level=error component="discovery manager scrape" discovery=http msg="Unable to refresh target groups" err="Get \"http://172.21.15.130:8765/sd/prometheus/sd-config?service=mgr-prometheus\": dial tcp 172.21.15.130:8765: connect: connection refused" 2024-06-18T02:22:30.639 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:22:30 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3[159937]: 2024-06-18T02:22:30.579+0000 7f065013a640 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:06.927808+0000 front 2024-06-18T02:22:06.927847+0000 (oldest deadline 2024-06-18T02:22:29.227978+0000) 2024-06-18T02:22:31.543 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:22:31 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4[127338]: 2024-06-18T02:22:31.183+0000 7f8e7bf55640 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:07.461603+0000 front 2024-06-18T02:22:07.461523+0000 (oldest deadline 2024-06-18T02:22:30.361513+0000) 2024-06-18T02:22:31.896 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:22:31 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3[159937]: 2024-06-18T02:22:31.599+0000 7f065013a640 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:06.927808+0000 front 2024-06-18T02:22:06.927847+0000 (oldest deadline 2024-06-18T02:22:29.227978+0000) 2024-06-18T02:22:32.043 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:31 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:31.737+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:07.225607+0000 front 2024-06-18T02:22:07.225544+0000 (oldest deadline 2024-06-18T02:22:31.325614+0000) 2024-06-18T02:22:32.543 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:22:32 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4[127338]: 2024-06-18T02:22:32.195+0000 7f8e7bf55640 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:07.461603+0000 front 2024-06-18T02:22:07.461523+0000 (oldest deadline 2024-06-18T02:22:30.361513+0000) 2024-06-18T02:22:33.043 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:32 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:32.749+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:07.225607+0000 front 2024-06-18T02:22:07.225544+0000 (oldest deadline 2024-06-18T02:22:31.325614+0000) 2024-06-18T02:22:33.181 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:22:32 smithi007 podman[190685]: 2024-06-18 02:22:32.923422729 +0000 UTC m=+5.511717323 container died 7e879cda3b51bea60341d15fa9ed4aba268f14066e66b22a3d665f0bcbea4098 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, RELEASE=squid-3781e3a, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240612, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-06-18T02:22:33.543 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:22:33 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4[127338]: 2024-06-18T02:22:33.186+0000 7f8e7bf55640 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:07.461603+0000 front 2024-06-18T02:22:07.461523+0000 (oldest deadline 2024-06-18T02:22:30.361513+0000) 2024-06-18T02:22:33.572 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:22:33 smithi007 podman[190685]: 2024-06-18 02:22:33.372635183 +0000 UTC m=+5.960929816 container cleanup 7e879cda3b51bea60341d15fa9ed4aba268f14066e66b22a3d665f0bcbea4098 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-3781e3a, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.build-date=20240612, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-06-18T02:22:33.572 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:22:33 smithi007 bash[190685]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3 2024-06-18T02:22:33.916 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:22:33 smithi007 podman[191385]: 2024-06-18 02:22:33.573961459 +0000 UTC m=+0.707871453 container remove 7e879cda3b51bea60341d15fa9ed4aba268f14066e66b22a3d665f0bcbea4098 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.build-date=20240612, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3781e3a, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0) 2024-06-18T02:22:34.043 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:33 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:33.744+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:07.225607+0000 front 2024-06-18T02:22:07.225544+0000 (oldest deadline 2024-06-18T02:22:31.325614+0000) 2024-06-18T02:22:34.543 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:22:34 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4[127338]: 2024-06-18T02:22:34.152+0000 7f8e7bf55640 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:07.461603+0000 front 2024-06-18T02:22:07.461523+0000 (oldest deadline 2024-06-18T02:22:30.361513+0000) 2024-06-18T02:22:34.543 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:34 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:34.301+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:08.180293+0000 front 2024-06-18T02:22:08.180335+0000 (oldest deadline 2024-06-18T02:22:33.480100+0000) 2024-06-18T02:22:35.043 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:34 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:34.757+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:07.225607+0000 front 2024-06-18T02:22:07.225544+0000 (oldest deadline 2024-06-18T02:22:31.325614+0000) 2024-06-18T02:22:35.432 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:22:35 smithi007 podman[191550]: 2024-06-18 02:22:35.046901101 +0000 UTC m=+0.021007002 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:22:35.432 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:22:35 smithi007 podman[191550]: 2024-06-18 02:22:35.165880878 +0000 UTC m=+0.139986750 container create e28745f02470e4a75f98f31475f0248d8609a2672abc8aa0dfc1799951b95b9a (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.build-date=20240612, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-3781e3a, GIT_BRANCH=HEAD, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-18T02:22:35.432 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:22:35 smithi007 podman[191550]: 2024-06-18 02:22:35.368411028 +0000 UTC m=+0.342516911 container init e28745f02470e4a75f98f31475f0248d8609a2672abc8aa0dfc1799951b95b9a (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, RELEASE=squid-3781e3a, org.label-schema.build-date=20240612, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-06-18T02:22:35.432 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:22:35 smithi007 podman[191550]: 2024-06-18 02:22:35.371800194 +0000 UTC m=+0.345906068 container start e28745f02470e4a75f98f31475f0248d8609a2672abc8aa0dfc1799951b95b9a (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240612, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-3781e3a, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47) 2024-06-18T02:22:35.543 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:22:35 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4[127338]: 2024-06-18T02:22:35.116+0000 7f8e7bf55640 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:07.461603+0000 front 2024-06-18T02:22:07.461523+0000 (oldest deadline 2024-06-18T02:22:30.361513+0000) 2024-06-18T02:22:35.544 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:22:35 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5[130377]: 2024-06-18T02:22:35.189+0000 7f62d58ba640 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:06.789991+0000 front 2024-06-18T02:22:06.790086+0000 (oldest deadline 2024-06-18T02:22:34.390462+0000) 2024-06-18T02:22:35.544 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:35 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:35.288+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:08.180293+0000 front 2024-06-18T02:22:08.180335+0000 (oldest deadline 2024-06-18T02:22:33.480100+0000) 2024-06-18T02:22:35.930 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:22:35 smithi007 podman[191550]: 2024-06-18 02:22:35.462049633 +0000 UTC m=+0.436155514 container attach e28745f02470e4a75f98f31475f0248d8609a2672abc8aa0dfc1799951b95b9a (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-3781e3a, org.label-schema.build-date=20240612, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, io.buildah.version=1.36.0) 2024-06-18T02:22:35.930 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:22:35 smithi007 podman[191550]: 2024-06-18 02:22:35.696109704 +0000 UTC m=+0.670215580 container died e28745f02470e4a75f98f31475f0248d8609a2672abc8aa0dfc1799951b95b9a (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3-deactivate, RELEASE=squid-3781e3a, org.label-schema.build-date=20240612, GIT_BRANCH=HEAD, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-06-18T02:22:36.155 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:35 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:35.795+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:07.225607+0000 front 2024-06-18T02:22:07.225544+0000 (oldest deadline 2024-06-18T02:22:31.325614+0000) 2024-06-18T02:22:36.181 INFO:journalctl@ceph.osd.3.smithi007.stdout:Jun 18 02:22:36 smithi007 podman[191616]: 2024-06-18 02:22:36.16465814 +0000 UTC m=+0.512814519 container remove e28745f02470e4a75f98f31475f0248d8609a2672abc8aa0dfc1799951b95b9a (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-3-deactivate, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240612, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3781e3a, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux ) 2024-06-18T02:22:36.192 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.3.service' 2024-06-18T02:22:36.234 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-18T02:22:36.234 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-06-18T02:22:36.234 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-06-18T02:22:36.234 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.4 2024-06-18T02:22:36.537 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:22:36 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5[130377]: 2024-06-18T02:22:36.236+0000 7f62d58ba640 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:06.789991+0000 front 2024-06-18T02:22:06.790086+0000 (oldest deadline 2024-06-18T02:22:34.390462+0000) 2024-06-18T02:22:36.538 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:36 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:36.285+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:08.180293+0000 front 2024-06-18T02:22:08.180335+0000 (oldest deadline 2024-06-18T02:22:33.480100+0000) 2024-06-18T02:22:36.538 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:22:36 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4[127338]: 2024-06-18T02:22:36.155+0000 7f8e7bf55640 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:07.461603+0000 front 2024-06-18T02:22:07.461523+0000 (oldest deadline 2024-06-18T02:22:30.361513+0000) 2024-06-18T02:22:36.538 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:22:36 smithi130 systemd[1]: Stopping Ceph osd.4 for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:22:36.538 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:22:36 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4[127338]: 2024-06-18T02:22:36.537+0000 7f8e83947640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-18T02:22:36.538 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:22:36 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4[127338]: 2024-06-18T02:22:36.537+0000 7f8e83947640 -1 osd.4 196 *** Got signal Terminated *** 2024-06-18T02:22:36.538 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:22:36 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4[127338]: 2024-06-18T02:22:36.537+0000 7f8e83947640 -1 osd.4 196 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-18T02:22:36.793 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:36 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:36.781+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:07.225607+0000 front 2024-06-18T02:22:07.225544+0000 (oldest deadline 2024-06-18T02:22:31.325614+0000) 2024-06-18T02:22:37.543 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:22:37 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5[130377]: 2024-06-18T02:22:37.283+0000 7f62d58ba640 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:06.789991+0000 front 2024-06-18T02:22:06.790086+0000 (oldest deadline 2024-06-18T02:22:34.390462+0000) 2024-06-18T02:22:37.543 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:37 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:37.298+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:08.180293+0000 front 2024-06-18T02:22:08.180335+0000 (oldest deadline 2024-06-18T02:22:33.480100+0000) 2024-06-18T02:22:37.544 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:22:37 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4[127338]: 2024-06-18T02:22:37.161+0000 7f8e7bf55640 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:07.461603+0000 front 2024-06-18T02:22:07.461523+0000 (oldest deadline 2024-06-18T02:22:30.361513+0000) 2024-06-18T02:22:38.171 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:37 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:37.821+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:07.225607+0000 front 2024-06-18T02:22:07.225544+0000 (oldest deadline 2024-06-18T02:22:31.325614+0000) 2024-06-18T02:22:38.543 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:22:38 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4[127338]: 2024-06-18T02:22:38.170+0000 7f8e7bf55640 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:07.461603+0000 front 2024-06-18T02:22:07.461523+0000 (oldest deadline 2024-06-18T02:22:30.361513+0000) 2024-06-18T02:22:38.543 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:22:38 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5[130377]: 2024-06-18T02:22:38.236+0000 7f62d58ba640 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:06.789991+0000 front 2024-06-18T02:22:06.790086+0000 (oldest deadline 2024-06-18T02:22:34.390462+0000) 2024-06-18T02:22:38.544 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:22:38 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5[130377]: 2024-06-18T02:22:38.236+0000 7f62d58ba640 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:14.391116+0000 front 2024-06-18T02:22:14.391099+0000 (oldest deadline 2024-06-18T02:22:37.290866+0000) 2024-06-18T02:22:38.544 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:38 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:38.278+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:08.180293+0000 front 2024-06-18T02:22:08.180335+0000 (oldest deadline 2024-06-18T02:22:33.480100+0000) 2024-06-18T02:22:38.544 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:38 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:38.278+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:16.381270+0000 front 2024-06-18T02:22:16.381110+0000 (oldest deadline 2024-06-18T02:22:37.481038+0000) 2024-06-18T02:22:39.043 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:38 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:38.790+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:07.225607+0000 front 2024-06-18T02:22:07.225544+0000 (oldest deadline 2024-06-18T02:22:31.325614+0000) 2024-06-18T02:22:39.456 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:22:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4[127338]: 2024-06-18T02:22:39.191+0000 7f8e7bf55640 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:07.461603+0000 front 2024-06-18T02:22:07.461523+0000 (oldest deadline 2024-06-18T02:22:30.361513+0000) 2024-06-18T02:22:39.457 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:22:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4[127338]: 2024-06-18T02:22:39.191+0000 7f8e7bf55640 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:15.562722+0000 front 2024-06-18T02:22:15.562783+0000 (oldest deadline 2024-06-18T02:22:38.462684+0000) 2024-06-18T02:22:39.457 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:22:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5[130377]: 2024-06-18T02:22:39.279+0000 7f62d58ba640 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:06.789991+0000 front 2024-06-18T02:22:06.790086+0000 (oldest deadline 2024-06-18T02:22:34.390462+0000) 2024-06-18T02:22:39.457 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:22:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5[130377]: 2024-06-18T02:22:39.279+0000 7f62d58ba640 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:14.391116+0000 front 2024-06-18T02:22:14.391099+0000 (oldest deadline 2024-06-18T02:22:37.290866+0000) 2024-06-18T02:22:39.457 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:39.235+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:08.180293+0000 front 2024-06-18T02:22:08.180335+0000 (oldest deadline 2024-06-18T02:22:33.480100+0000) 2024-06-18T02:22:39.457 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:39.235+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:16.381270+0000 front 2024-06-18T02:22:16.381110+0000 (oldest deadline 2024-06-18T02:22:37.481038+0000) 2024-06-18T02:22:40.038 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:39 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:39.777+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:07.225607+0000 front 2024-06-18T02:22:07.225544+0000 (oldest deadline 2024-06-18T02:22:31.325614+0000) 2024-06-18T02:22:40.289 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:22:40 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4[127338]: 2024-06-18T02:22:40.198+0000 7f8e7bf55640 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:07.461603+0000 front 2024-06-18T02:22:07.461523+0000 (oldest deadline 2024-06-18T02:22:30.361513+0000) 2024-06-18T02:22:40.289 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:22:40 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4[127338]: 2024-06-18T02:22:40.198+0000 7f8e7bf55640 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:15.562722+0000 front 2024-06-18T02:22:15.562783+0000 (oldest deadline 2024-06-18T02:22:38.462684+0000) 2024-06-18T02:22:40.289 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:40 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:40.261+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:08.180293+0000 front 2024-06-18T02:22:08.180335+0000 (oldest deadline 2024-06-18T02:22:33.480100+0000) 2024-06-18T02:22:40.289 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:40 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:40.261+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:16.381270+0000 front 2024-06-18T02:22:16.381110+0000 (oldest deadline 2024-06-18T02:22:37.481038+0000) 2024-06-18T02:22:40.543 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:22:40 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5[130377]: 2024-06-18T02:22:40.289+0000 7f62d58ba640 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:06.789991+0000 front 2024-06-18T02:22:06.790086+0000 (oldest deadline 2024-06-18T02:22:34.390462+0000) 2024-06-18T02:22:40.543 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:22:40 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5[130377]: 2024-06-18T02:22:40.289+0000 7f62d58ba640 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:14.391116+0000 front 2024-06-18T02:22:14.391099+0000 (oldest deadline 2024-06-18T02:22:37.290866+0000) 2024-06-18T02:22:41.043 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:40 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:40.790+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:07.225607+0000 front 2024-06-18T02:22:07.225544+0000 (oldest deadline 2024-06-18T02:22:31.325614+0000) 2024-06-18T02:22:41.461 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:22:41 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5[130377]: 2024-06-18T02:22:41.277+0000 7f62d58ba640 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:06.789991+0000 front 2024-06-18T02:22:06.790086+0000 (oldest deadline 2024-06-18T02:22:34.390462+0000) 2024-06-18T02:22:41.462 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:22:41 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5[130377]: 2024-06-18T02:22:41.277+0000 7f62d58ba640 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:14.391116+0000 front 2024-06-18T02:22:14.391099+0000 (oldest deadline 2024-06-18T02:22:37.290866+0000) 2024-06-18T02:22:41.462 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:22:41 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4[127338]: 2024-06-18T02:22:41.169+0000 7f8e7bf55640 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:07.461603+0000 front 2024-06-18T02:22:07.461523+0000 (oldest deadline 2024-06-18T02:22:30.361513+0000) 2024-06-18T02:22:41.462 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:22:41 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4[127338]: 2024-06-18T02:22:41.169+0000 7f8e7bf55640 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:15.562722+0000 front 2024-06-18T02:22:15.562783+0000 (oldest deadline 2024-06-18T02:22:38.462684+0000) 2024-06-18T02:22:41.462 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:41 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:41.265+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:08.180293+0000 front 2024-06-18T02:22:08.180335+0000 (oldest deadline 2024-06-18T02:22:33.480100+0000) 2024-06-18T02:22:41.462 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:41 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:41.265+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:16.381270+0000 front 2024-06-18T02:22:16.381110+0000 (oldest deadline 2024-06-18T02:22:37.481038+0000) 2024-06-18T02:22:42.043 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:22:41 smithi130 podman[158619]: 2024-06-18 02:22:41.938592295 +0000 UTC m=+5.505679744 container died 24f46c456c319796a9a9e912a7bf09c4a969dcf642ab43c87e152255ad63668d (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4, RELEASE=squid-3781e3a, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240612, org.label-schema.vendor=CentOS, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-06-18T02:22:42.043 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:41 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:41.765+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:07.225607+0000 front 2024-06-18T02:22:07.225544+0000 (oldest deadline 2024-06-18T02:22:31.325614+0000) 2024-06-18T02:22:42.043 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:41 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:41.765+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:15.927068+0000 front 2024-06-18T02:22:15.927019+0000 (oldest deadline 2024-06-18T02:22:41.226937+0000) 2024-06-18T02:22:42.543 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:22:42 smithi130 podman[158619]: 2024-06-18 02:22:42.434514335 +0000 UTC m=+6.001601779 container cleanup 24f46c456c319796a9a9e912a7bf09c4a969dcf642ab43c87e152255ad63668d (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, RELEASE=squid-3781e3a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240612, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.36.0, GIT_BRANCH=HEAD) 2024-06-18T02:22:42.543 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:22:42 smithi130 bash[158619]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4 2024-06-18T02:22:42.544 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:22:42 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5[130377]: 2024-06-18T02:22:42.318+0000 7f62d58ba640 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:06.789991+0000 front 2024-06-18T02:22:06.790086+0000 (oldest deadline 2024-06-18T02:22:34.390462+0000) 2024-06-18T02:22:42.544 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:22:42 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5[130377]: 2024-06-18T02:22:42.318+0000 7f62d58ba640 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:14.391116+0000 front 2024-06-18T02:22:14.391099+0000 (oldest deadline 2024-06-18T02:22:37.290866+0000) 2024-06-18T02:22:42.544 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:42 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:42.224+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:08.180293+0000 front 2024-06-18T02:22:08.180335+0000 (oldest deadline 2024-06-18T02:22:33.480100+0000) 2024-06-18T02:22:42.544 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:42 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:42.224+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:16.381270+0000 front 2024-06-18T02:22:16.381110+0000 (oldest deadline 2024-06-18T02:22:37.481038+0000) 2024-06-18T02:22:43.019 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:22:42 smithi130 podman[159229]: 2024-06-18 02:22:42.677712172 +0000 UTC m=+0.734746158 container remove 24f46c456c319796a9a9e912a7bf09c4a969dcf642ab43c87e152255ad63668d (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240612, RELEASE=squid-3781e3a, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_CLEAN=True, ceph=True, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-06-18T02:22:43.019 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:42 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:42.811+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:07.225607+0000 front 2024-06-18T02:22:07.225544+0000 (oldest deadline 2024-06-18T02:22:31.325614+0000) 2024-06-18T02:22:43.019 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:42 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:42.811+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:15.927068+0000 front 2024-06-18T02:22:15.927019+0000 (oldest deadline 2024-06-18T02:22:41.226937+0000) 2024-06-18T02:22:43.293 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:43 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:43.232+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:08.180293+0000 front 2024-06-18T02:22:08.180335+0000 (oldest deadline 2024-06-18T02:22:33.480100+0000) 2024-06-18T02:22:43.293 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:43 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:43.232+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:16.381270+0000 front 2024-06-18T02:22:16.381110+0000 (oldest deadline 2024-06-18T02:22:37.481038+0000) 2024-06-18T02:22:43.294 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:22:43 smithi130 podman[159355]: 2024-06-18 02:22:42.923450616 +0000 UTC m=+0.017325296 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:22:43.294 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:22:43 smithi130 podman[159355]: 2024-06-18 02:22:43.036970922 +0000 UTC m=+0.130845640 container create 82dbbf0cf7df4098c3dfb09c8cb26dc7bae7d047354410fa14375d84a7ebf628 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240612, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-3781e3a, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-06-18T02:22:43.294 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:22:43 smithi130 podman[159355]: 2024-06-18 02:22:43.256172807 +0000 UTC m=+0.350047487 container init 82dbbf0cf7df4098c3dfb09c8cb26dc7bae7d047354410fa14375d84a7ebf628 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240612, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, RELEASE=squid-3781e3a, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-06-18T02:22:43.294 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:22:43 smithi130 podman[159355]: 2024-06-18 02:22:43.259641329 +0000 UTC m=+0.353516011 container start 82dbbf0cf7df4098c3dfb09c8cb26dc7bae7d047354410fa14375d84a7ebf628 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-3781e3a, ceph=True, org.label-schema.build-date=20240612, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, io.buildah.version=1.36.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-06-18T02:22:43.777 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:22:43 smithi130 podman[159355]: 2024-06-18 02:22:43.385844521 +0000 UTC m=+0.479719212 container attach 82dbbf0cf7df4098c3dfb09c8cb26dc7bae7d047354410fa14375d84a7ebf628 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240612, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-3781e3a, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-06-18T02:22:43.777 INFO:journalctl@ceph.osd.4.smithi130.stdout:Jun 18 02:22:43 smithi130 podman[159355]: 2024-06-18 02:22:43.527404143 +0000 UTC m=+0.621278816 container died 82dbbf0cf7df4098c3dfb09c8cb26dc7bae7d047354410fa14375d84a7ebf628 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, RELEASE=squid-3781e3a, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240612, GIT_BRANCH=HEAD) 2024-06-18T02:22:43.777 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:22:43 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5[130377]: 2024-06-18T02:22:43.294+0000 7f62d58ba640 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:06.789991+0000 front 2024-06-18T02:22:06.790086+0000 (oldest deadline 2024-06-18T02:22:34.390462+0000) 2024-06-18T02:22:43.777 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:22:43 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5[130377]: 2024-06-18T02:22:43.294+0000 7f62d58ba640 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:14.391116+0000 front 2024-06-18T02:22:14.391099+0000 (oldest deadline 2024-06-18T02:22:37.290866+0000) 2024-06-18T02:22:44.043 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:43 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:43.777+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:07.225607+0000 front 2024-06-18T02:22:07.225544+0000 (oldest deadline 2024-06-18T02:22:31.325614+0000) 2024-06-18T02:22:44.043 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:43 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:43.777+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:15.927068+0000 front 2024-06-18T02:22:15.927019+0000 (oldest deadline 2024-06-18T02:22:41.226937+0000) 2024-06-18T02:22:44.191 DEBUG:teuthology.orchestra.run.smithi130:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.4.service' 2024-06-18T02:22:44.233 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-18T02:22:44.233 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-06-18T02:22:44.233 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-06-18T02:22:44.233 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.5 2024-06-18T02:22:44.442 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:44.273+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:08.180293+0000 front 2024-06-18T02:22:08.180335+0000 (oldest deadline 2024-06-18T02:22:33.480100+0000) 2024-06-18T02:22:44.442 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:44.273+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:16.381270+0000 front 2024-06-18T02:22:16.381110+0000 (oldest deadline 2024-06-18T02:22:37.481038+0000) 2024-06-18T02:22:44.442 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:22:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5[130377]: 2024-06-18T02:22:44.273+0000 7f62d58ba640 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:06.789991+0000 front 2024-06-18T02:22:06.790086+0000 (oldest deadline 2024-06-18T02:22:34.390462+0000) 2024-06-18T02:22:44.442 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:22:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5[130377]: 2024-06-18T02:22:44.273+0000 7f62d58ba640 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:14.391116+0000 front 2024-06-18T02:22:14.391099+0000 (oldest deadline 2024-06-18T02:22:37.290866+0000) 2024-06-18T02:22:44.442 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:22:44 smithi130 systemd[1]: Stopping Ceph osd.5 for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:22:44.793 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:22:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5[130377]: 2024-06-18T02:22:44.620+0000 7f62dd2ac640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-18T02:22:44.793 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:22:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5[130377]: 2024-06-18T02:22:44.620+0000 7f62dd2ac640 -1 osd.5 196 *** Got signal Terminated *** 2024-06-18T02:22:44.793 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:22:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5[130377]: 2024-06-18T02:22:44.620+0000 7f62dd2ac640 -1 osd.5 196 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-18T02:22:45.293 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:44.817+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:07.225607+0000 front 2024-06-18T02:22:07.225544+0000 (oldest deadline 2024-06-18T02:22:31.325614+0000) 2024-06-18T02:22:45.293 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:44 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:44.817+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:15.927068+0000 front 2024-06-18T02:22:15.927019+0000 (oldest deadline 2024-06-18T02:22:41.226937+0000) 2024-06-18T02:22:45.793 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:22:45 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5[130377]: 2024-06-18T02:22:45.321+0000 7f62d58ba640 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:06.789991+0000 front 2024-06-18T02:22:06.790086+0000 (oldest deadline 2024-06-18T02:22:34.390462+0000) 2024-06-18T02:22:45.793 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:22:45 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5[130377]: 2024-06-18T02:22:45.321+0000 7f62d58ba640 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:14.391116+0000 front 2024-06-18T02:22:14.391099+0000 (oldest deadline 2024-06-18T02:22:37.290866+0000) 2024-06-18T02:22:45.794 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:45 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:45.294+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:08.180293+0000 front 2024-06-18T02:22:08.180335+0000 (oldest deadline 2024-06-18T02:22:33.480100+0000) 2024-06-18T02:22:45.794 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:45 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:45.294+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:16.381270+0000 front 2024-06-18T02:22:16.381110+0000 (oldest deadline 2024-06-18T02:22:37.481038+0000) 2024-06-18T02:22:46.136 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:45 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:45.809+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:07.225607+0000 front 2024-06-18T02:22:07.225544+0000 (oldest deadline 2024-06-18T02:22:31.325614+0000) 2024-06-18T02:22:46.136 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:45 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:45.809+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:15.927068+0000 front 2024-06-18T02:22:15.927019+0000 (oldest deadline 2024-06-18T02:22:41.226937+0000) 2024-06-18T02:22:46.481 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:22:46 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5[130377]: 2024-06-18T02:22:46.276+0000 7f62d58ba640 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:06.789991+0000 front 2024-06-18T02:22:06.790086+0000 (oldest deadline 2024-06-18T02:22:34.390462+0000) 2024-06-18T02:22:46.482 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:22:46 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5[130377]: 2024-06-18T02:22:46.276+0000 7f62d58ba640 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:14.391116+0000 front 2024-06-18T02:22:14.391099+0000 (oldest deadline 2024-06-18T02:22:37.290866+0000) 2024-06-18T02:22:46.482 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:46 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:46.321+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:08.180293+0000 front 2024-06-18T02:22:08.180335+0000 (oldest deadline 2024-06-18T02:22:33.480100+0000) 2024-06-18T02:22:46.482 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:46 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:46.321+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:16.381270+0000 front 2024-06-18T02:22:16.381110+0000 (oldest deadline 2024-06-18T02:22:37.481038+0000) 2024-06-18T02:22:46.482 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:46 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:46.321+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6820 osd.2 since back 2024-06-18T02:22:22.182145+0000 front 2024-06-18T02:22:22.182162+0000 (oldest deadline 2024-06-18T02:22:45.682048+0000) 2024-06-18T02:22:47.043 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:46 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:46.785+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:07.225607+0000 front 2024-06-18T02:22:07.225544+0000 (oldest deadline 2024-06-18T02:22:31.325614+0000) 2024-06-18T02:22:47.044 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:46 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:46.785+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:15.927068+0000 front 2024-06-18T02:22:15.927019+0000 (oldest deadline 2024-06-18T02:22:41.226937+0000) 2024-06-18T02:22:47.401 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:22:47 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5[130377]: 2024-06-18T02:22:47.314+0000 7f62d58ba640 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:06.789991+0000 front 2024-06-18T02:22:06.790086+0000 (oldest deadline 2024-06-18T02:22:34.390462+0000) 2024-06-18T02:22:47.402 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:22:47 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5[130377]: 2024-06-18T02:22:47.314+0000 7f62d58ba640 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:14.391116+0000 front 2024-06-18T02:22:14.391099+0000 (oldest deadline 2024-06-18T02:22:37.290866+0000) 2024-06-18T02:22:47.402 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:47 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:47.272+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:08.180293+0000 front 2024-06-18T02:22:08.180335+0000 (oldest deadline 2024-06-18T02:22:33.480100+0000) 2024-06-18T02:22:47.402 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:47 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:47.272+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:16.381270+0000 front 2024-06-18T02:22:16.381110+0000 (oldest deadline 2024-06-18T02:22:37.481038+0000) 2024-06-18T02:22:47.402 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:47 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:47.272+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6820 osd.2 since back 2024-06-18T02:22:22.182145+0000 front 2024-06-18T02:22:22.182162+0000 (oldest deadline 2024-06-18T02:22:45.682048+0000) 2024-06-18T02:22:48.010 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:47 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:47.759+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:07.225607+0000 front 2024-06-18T02:22:07.225544+0000 (oldest deadline 2024-06-18T02:22:31.325614+0000) 2024-06-18T02:22:48.010 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:47 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:47.759+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:15.927068+0000 front 2024-06-18T02:22:15.927019+0000 (oldest deadline 2024-06-18T02:22:41.226937+0000) 2024-06-18T02:22:48.010 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:47 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:47.759+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6820 osd.2 since back 2024-06-18T02:22:23.928688+0000 front 2024-06-18T02:22:23.928656+0000 (oldest deadline 2024-06-18T02:22:47.428611+0000) 2024-06-18T02:22:48.543 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:22:48 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5[130377]: 2024-06-18T02:22:48.330+0000 7f62d58ba640 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:06.789991+0000 front 2024-06-18T02:22:06.790086+0000 (oldest deadline 2024-06-18T02:22:34.390462+0000) 2024-06-18T02:22:48.543 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:22:48 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5[130377]: 2024-06-18T02:22:48.330+0000 7f62d58ba640 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:14.391116+0000 front 2024-06-18T02:22:14.391099+0000 (oldest deadline 2024-06-18T02:22:37.290866+0000) 2024-06-18T02:22:48.543 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:22:48 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5[130377]: 2024-06-18T02:22:48.330+0000 7f62d58ba640 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.7:6820 osd.2 since back 2024-06-18T02:22:23.191873+0000 front 2024-06-18T02:22:23.191908+0000 (oldest deadline 2024-06-18T02:22:47.891783+0000) 2024-06-18T02:22:48.543 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:48 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:48.263+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:08.180293+0000 front 2024-06-18T02:22:08.180335+0000 (oldest deadline 2024-06-18T02:22:33.480100+0000) 2024-06-18T02:22:48.544 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:48 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:48.263+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:16.381270+0000 front 2024-06-18T02:22:16.381110+0000 (oldest deadline 2024-06-18T02:22:37.481038+0000) 2024-06-18T02:22:48.544 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:48 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:48.263+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6820 osd.2 since back 2024-06-18T02:22:22.182145+0000 front 2024-06-18T02:22:22.182162+0000 (oldest deadline 2024-06-18T02:22:45.682048+0000) 2024-06-18T02:22:49.043 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:48 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:48.799+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:07.225607+0000 front 2024-06-18T02:22:07.225544+0000 (oldest deadline 2024-06-18T02:22:31.325614+0000) 2024-06-18T02:22:49.043 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:48 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:48.799+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:15.927068+0000 front 2024-06-18T02:22:15.927019+0000 (oldest deadline 2024-06-18T02:22:41.226937+0000) 2024-06-18T02:22:49.043 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:48 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:48.799+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6820 osd.2 since back 2024-06-18T02:22:23.928688+0000 front 2024-06-18T02:22:23.928656+0000 (oldest deadline 2024-06-18T02:22:47.428611+0000) 2024-06-18T02:22:49.543 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:22:49 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5[130377]: 2024-06-18T02:22:49.318+0000 7f62d58ba640 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:06.789991+0000 front 2024-06-18T02:22:06.790086+0000 (oldest deadline 2024-06-18T02:22:34.390462+0000) 2024-06-18T02:22:49.543 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:22:49 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5[130377]: 2024-06-18T02:22:49.318+0000 7f62d58ba640 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:14.391116+0000 front 2024-06-18T02:22:14.391099+0000 (oldest deadline 2024-06-18T02:22:37.290866+0000) 2024-06-18T02:22:49.543 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:22:49 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5[130377]: 2024-06-18T02:22:49.318+0000 7f62d58ba640 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.7:6820 osd.2 since back 2024-06-18T02:22:23.191873+0000 front 2024-06-18T02:22:23.191908+0000 (oldest deadline 2024-06-18T02:22:47.891783+0000) 2024-06-18T02:22:49.543 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:49 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:49.223+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:08.180293+0000 front 2024-06-18T02:22:08.180335+0000 (oldest deadline 2024-06-18T02:22:33.480100+0000) 2024-06-18T02:22:49.544 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:49 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:49.223+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:16.381270+0000 front 2024-06-18T02:22:16.381110+0000 (oldest deadline 2024-06-18T02:22:37.481038+0000) 2024-06-18T02:22:49.544 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:49 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:49.223+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6820 osd.2 since back 2024-06-18T02:22:22.182145+0000 front 2024-06-18T02:22:22.182162+0000 (oldest deadline 2024-06-18T02:22:45.682048+0000) 2024-06-18T02:22:50.043 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:49 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:49.793+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:07.225607+0000 front 2024-06-18T02:22:07.225544+0000 (oldest deadline 2024-06-18T02:22:31.325614+0000) 2024-06-18T02:22:50.043 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:49 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:49.793+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:15.927068+0000 front 2024-06-18T02:22:15.927019+0000 (oldest deadline 2024-06-18T02:22:41.226937+0000) 2024-06-18T02:22:50.043 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:49 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:49.793+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6820 osd.2 since back 2024-06-18T02:22:23.928688+0000 front 2024-06-18T02:22:23.928656+0000 (oldest deadline 2024-06-18T02:22:47.428611+0000) 2024-06-18T02:22:50.375 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:22:50 smithi130 podman[159456]: 2024-06-18 02:22:50.107279299 +0000 UTC m=+5.628633555 container died 210471d14700a1bd8a42c7c7102c0b3330fe54b3a3553d265d54914a221b767b (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-3781e3a, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.license=GPLv2, org.label-schema.build-date=20240612, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-06-18T02:22:50.375 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:50.235+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:08.180293+0000 front 2024-06-18T02:22:08.180335+0000 (oldest deadline 2024-06-18T02:22:33.480100+0000) 2024-06-18T02:22:50.375 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:50.235+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:16.381270+0000 front 2024-06-18T02:22:16.381110+0000 (oldest deadline 2024-06-18T02:22:37.481038+0000) 2024-06-18T02:22:50.375 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:50.235+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6820 osd.2 since back 2024-06-18T02:22:22.182145+0000 front 2024-06-18T02:22:22.182162+0000 (oldest deadline 2024-06-18T02:22:45.682048+0000) 2024-06-18T02:22:50.734 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:22:50 smithi130 podman[159456]: 2024-06-18 02:22:50.492265325 +0000 UTC m=+6.013619571 container cleanup 210471d14700a1bd8a42c7c7102c0b3330fe54b3a3553d265d54914a221b767b (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5, io.buildah.version=1.36.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_CLEAN=True, RELEASE=squid-3781e3a, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240612, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True) 2024-06-18T02:22:50.734 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:22:50 smithi130 bash[159456]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5 2024-06-18T02:22:51.043 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:22:50 smithi130 podman[159593]: 2024-06-18 02:22:50.735242176 +0000 UTC m=+0.624169233 container remove 210471d14700a1bd8a42c7c7102c0b3330fe54b3a3553d265d54914a221b767b (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240612, org.label-schema.schema-version=1.0, RELEASE=squid-3781e3a) 2024-06-18T02:22:51.044 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:50.788+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:07.225607+0000 front 2024-06-18T02:22:07.225544+0000 (oldest deadline 2024-06-18T02:22:31.325614+0000) 2024-06-18T02:22:51.044 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:50.788+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:15.927068+0000 front 2024-06-18T02:22:15.927019+0000 (oldest deadline 2024-06-18T02:22:41.226937+0000) 2024-06-18T02:22:51.044 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:50 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:50.788+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6820 osd.2 since back 2024-06-18T02:22:23.928688+0000 front 2024-06-18T02:22:23.928656+0000 (oldest deadline 2024-06-18T02:22:47.428611+0000) 2024-06-18T02:22:51.353 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:22:51 smithi130 podman[159683]: 2024-06-18 02:22:50.973176402 +0000 UTC m=+0.017574220 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:22:51.354 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:22:51 smithi130 podman[159683]: 2024-06-18 02:22:51.127715214 +0000 UTC m=+0.172113031 container create a3c4ef43d001e8a4a6286e09faa0987183939a7f2412c7ad40b3ffb16d2731cd (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5-deactivate, ceph=True, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240612, RELEASE=squid-3781e3a, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47) 2024-06-18T02:22:51.354 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:51 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:51.218+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:08.180293+0000 front 2024-06-18T02:22:08.180335+0000 (oldest deadline 2024-06-18T02:22:33.480100+0000) 2024-06-18T02:22:51.354 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:51 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:51.218+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:16.381270+0000 front 2024-06-18T02:22:16.381110+0000 (oldest deadline 2024-06-18T02:22:37.481038+0000) 2024-06-18T02:22:51.354 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:51 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:51.218+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6820 osd.2 since back 2024-06-18T02:22:22.182145+0000 front 2024-06-18T02:22:22.182162+0000 (oldest deadline 2024-06-18T02:22:45.682048+0000) 2024-06-18T02:22:51.613 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:22:51 smithi130 podman[159683]: 2024-06-18 02:22:51.355130317 +0000 UTC m=+0.399528141 container init a3c4ef43d001e8a4a6286e09faa0987183939a7f2412c7ad40b3ffb16d2731cd (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5-deactivate, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, RELEASE=squid-3781e3a, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240612, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-06-18T02:22:51.613 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:22:51 smithi130 podman[159683]: 2024-06-18 02:22:51.358482037 +0000 UTC m=+0.402879855 container start a3c4ef43d001e8a4a6286e09faa0987183939a7f2412c7ad40b3ffb16d2731cd (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-3781e3a, org.label-schema.build-date=20240612, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0) 2024-06-18T02:22:51.613 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:22:51 smithi130 podman[159683]: 2024-06-18 02:22:51.438416621 +0000 UTC m=+0.482814440 container attach a3c4ef43d001e8a4a6286e09faa0987183939a7f2412c7ad40b3ffb16d2731cd (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5-deactivate, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240612, RELEASE=squid-3781e3a, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47) 2024-06-18T02:22:51.898 INFO:journalctl@ceph.osd.5.smithi130.stdout:Jun 18 02:22:51 smithi130 podman[159683]: 2024-06-18 02:22:51.61437128 +0000 UTC m=+0.658769099 container died a3c4ef43d001e8a4a6286e09faa0987183939a7f2412c7ad40b3ffb16d2731cd (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-3781e3a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.build-date=20240612, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-06-18T02:22:51.898 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:51 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:51.757+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:07.225607+0000 front 2024-06-18T02:22:07.225544+0000 (oldest deadline 2024-06-18T02:22:31.325614+0000) 2024-06-18T02:22:51.898 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:51 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:51.757+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:15.927068+0000 front 2024-06-18T02:22:15.927019+0000 (oldest deadline 2024-06-18T02:22:41.226937+0000) 2024-06-18T02:22:51.898 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:51 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:51.757+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6820 osd.2 since back 2024-06-18T02:22:23.928688+0000 front 2024-06-18T02:22:23.928656+0000 (oldest deadline 2024-06-18T02:22:47.428611+0000) 2024-06-18T02:22:52.286 DEBUG:teuthology.orchestra.run.smithi130:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.5.service' 2024-06-18T02:22:52.328 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-18T02:22:52.328 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-06-18T02:22:52.328 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-06-18T02:22:52.328 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.6 2024-06-18T02:22:52.543 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:52 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:52.253+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:08.180293+0000 front 2024-06-18T02:22:08.180335+0000 (oldest deadline 2024-06-18T02:22:33.480100+0000) 2024-06-18T02:22:52.543 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:52 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:52.253+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:16.381270+0000 front 2024-06-18T02:22:16.381110+0000 (oldest deadline 2024-06-18T02:22:37.481038+0000) 2024-06-18T02:22:52.543 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:52 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:52.253+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6820 osd.2 since back 2024-06-18T02:22:22.182145+0000 front 2024-06-18T02:22:22.182162+0000 (oldest deadline 2024-06-18T02:22:45.682048+0000) 2024-06-18T02:22:52.543 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:52 smithi130 systemd[1]: Stopping Ceph osd.6 for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:22:53.043 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:52 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:52.652+0000 7f03e5b2e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-18T02:22:53.043 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:52 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:52.652+0000 7f03e5b2e640 -1 osd.6 196 *** Got signal Terminated *** 2024-06-18T02:22:53.043 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:52 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:52.652+0000 7f03e5b2e640 -1 osd.6 196 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-18T02:22:53.044 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:52 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:52.762+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:07.225607+0000 front 2024-06-18T02:22:07.225544+0000 (oldest deadline 2024-06-18T02:22:31.325614+0000) 2024-06-18T02:22:53.044 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:52 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:52.762+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:15.927068+0000 front 2024-06-18T02:22:15.927019+0000 (oldest deadline 2024-06-18T02:22:41.226937+0000) 2024-06-18T02:22:53.044 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:52 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:52.762+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6820 osd.2 since back 2024-06-18T02:22:23.928688+0000 front 2024-06-18T02:22:23.928656+0000 (oldest deadline 2024-06-18T02:22:47.428611+0000) 2024-06-18T02:22:53.543 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:53 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:53.222+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:08.180293+0000 front 2024-06-18T02:22:08.180335+0000 (oldest deadline 2024-06-18T02:22:33.480100+0000) 2024-06-18T02:22:53.543 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:53 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:53.222+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:16.381270+0000 front 2024-06-18T02:22:16.381110+0000 (oldest deadline 2024-06-18T02:22:37.481038+0000) 2024-06-18T02:22:53.543 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:53 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:53.222+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6820 osd.2 since back 2024-06-18T02:22:22.182145+0000 front 2024-06-18T02:22:22.182162+0000 (oldest deadline 2024-06-18T02:22:45.682048+0000) 2024-06-18T02:22:54.043 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:53 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:53.761+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:07.225607+0000 front 2024-06-18T02:22:07.225544+0000 (oldest deadline 2024-06-18T02:22:31.325614+0000) 2024-06-18T02:22:54.043 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:53 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:53.761+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:15.927068+0000 front 2024-06-18T02:22:15.927019+0000 (oldest deadline 2024-06-18T02:22:41.226937+0000) 2024-06-18T02:22:54.044 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:53 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:53.761+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6820 osd.2 since back 2024-06-18T02:22:23.928688+0000 front 2024-06-18T02:22:23.928656+0000 (oldest deadline 2024-06-18T02:22:47.428611+0000) 2024-06-18T02:22:54.044 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:53 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:53.761+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6828 osd.3 since back 2024-06-18T02:22:27.929461+0000 front 2024-06-18T02:22:27.929528+0000 (oldest deadline 2024-06-18T02:22:53.129648+0000) 2024-06-18T02:22:54.543 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:54 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:54.207+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:08.180293+0000 front 2024-06-18T02:22:08.180335+0000 (oldest deadline 2024-06-18T02:22:33.480100+0000) 2024-06-18T02:22:54.544 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:54 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:54.207+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:16.381270+0000 front 2024-06-18T02:22:16.381110+0000 (oldest deadline 2024-06-18T02:22:37.481038+0000) 2024-06-18T02:22:54.544 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:54 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:54.207+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6820 osd.2 since back 2024-06-18T02:22:22.182145+0000 front 2024-06-18T02:22:22.182162+0000 (oldest deadline 2024-06-18T02:22:45.682048+0000) 2024-06-18T02:22:55.043 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:54 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:54.742+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:07.225607+0000 front 2024-06-18T02:22:07.225544+0000 (oldest deadline 2024-06-18T02:22:31.325614+0000) 2024-06-18T02:22:55.043 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:54 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:54.742+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:15.927068+0000 front 2024-06-18T02:22:15.927019+0000 (oldest deadline 2024-06-18T02:22:41.226937+0000) 2024-06-18T02:22:55.043 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:54 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:54.742+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6820 osd.2 since back 2024-06-18T02:22:23.928688+0000 front 2024-06-18T02:22:23.928656+0000 (oldest deadline 2024-06-18T02:22:47.428611+0000) 2024-06-18T02:22:55.044 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:54 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:54.742+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6828 osd.3 since back 2024-06-18T02:22:27.929461+0000 front 2024-06-18T02:22:27.929528+0000 (oldest deadline 2024-06-18T02:22:53.129648+0000) 2024-06-18T02:22:55.543 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:55 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:55.235+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:08.180293+0000 front 2024-06-18T02:22:08.180335+0000 (oldest deadline 2024-06-18T02:22:33.480100+0000) 2024-06-18T02:22:55.543 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:55 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:55.235+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:16.381270+0000 front 2024-06-18T02:22:16.381110+0000 (oldest deadline 2024-06-18T02:22:37.481038+0000) 2024-06-18T02:22:55.543 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:55 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:55.235+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6820 osd.2 since back 2024-06-18T02:22:22.182145+0000 front 2024-06-18T02:22:22.182162+0000 (oldest deadline 2024-06-18T02:22:45.682048+0000) 2024-06-18T02:22:55.544 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:55 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:55.235+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6828 osd.3 since back 2024-06-18T02:22:30.784164+0000 front 2024-06-18T02:22:30.784186+0000 (oldest deadline 2024-06-18T02:22:54.884094+0000) 2024-06-18T02:22:56.043 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:55 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:55.763+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:07.225607+0000 front 2024-06-18T02:22:07.225544+0000 (oldest deadline 2024-06-18T02:22:31.325614+0000) 2024-06-18T02:22:56.043 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:55 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:55.763+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:15.927068+0000 front 2024-06-18T02:22:15.927019+0000 (oldest deadline 2024-06-18T02:22:41.226937+0000) 2024-06-18T02:22:56.044 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:55 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:55.763+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6820 osd.2 since back 2024-06-18T02:22:23.928688+0000 front 2024-06-18T02:22:23.928656+0000 (oldest deadline 2024-06-18T02:22:47.428611+0000) 2024-06-18T02:22:56.044 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:55 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:55.763+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6828 osd.3 since back 2024-06-18T02:22:27.929461+0000 front 2024-06-18T02:22:27.929528+0000 (oldest deadline 2024-06-18T02:22:53.129648+0000) 2024-06-18T02:22:56.459 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:56 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:56.282+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:08.180293+0000 front 2024-06-18T02:22:08.180335+0000 (oldest deadline 2024-06-18T02:22:33.480100+0000) 2024-06-18T02:22:56.459 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:56 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:56.282+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:16.381270+0000 front 2024-06-18T02:22:16.381110+0000 (oldest deadline 2024-06-18T02:22:37.481038+0000) 2024-06-18T02:22:56.459 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:56 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:56.282+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6820 osd.2 since back 2024-06-18T02:22:22.182145+0000 front 2024-06-18T02:22:22.182162+0000 (oldest deadline 2024-06-18T02:22:45.682048+0000) 2024-06-18T02:22:56.460 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:56 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:56.282+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6828 osd.3 since back 2024-06-18T02:22:30.784164+0000 front 2024-06-18T02:22:30.784186+0000 (oldest deadline 2024-06-18T02:22:54.884094+0000) 2024-06-18T02:22:57.043 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:56 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:56.733+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:07.225607+0000 front 2024-06-18T02:22:07.225544+0000 (oldest deadline 2024-06-18T02:22:31.325614+0000) 2024-06-18T02:22:57.043 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:56 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:56.733+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:15.927068+0000 front 2024-06-18T02:22:15.927019+0000 (oldest deadline 2024-06-18T02:22:41.226937+0000) 2024-06-18T02:22:57.043 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:56 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:56.733+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6820 osd.2 since back 2024-06-18T02:22:23.928688+0000 front 2024-06-18T02:22:23.928656+0000 (oldest deadline 2024-06-18T02:22:47.428611+0000) 2024-06-18T02:22:57.043 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:56 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:56.734+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6828 osd.3 since back 2024-06-18T02:22:27.929461+0000 front 2024-06-18T02:22:27.929528+0000 (oldest deadline 2024-06-18T02:22:53.129648+0000) 2024-06-18T02:22:57.543 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:57 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:57.310+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:08.180293+0000 front 2024-06-18T02:22:08.180335+0000 (oldest deadline 2024-06-18T02:22:33.480100+0000) 2024-06-18T02:22:57.543 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:57 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:57.310+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:16.381270+0000 front 2024-06-18T02:22:16.381110+0000 (oldest deadline 2024-06-18T02:22:37.481038+0000) 2024-06-18T02:22:57.543 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:57 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:57.310+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6820 osd.2 since back 2024-06-18T02:22:22.182145+0000 front 2024-06-18T02:22:22.182162+0000 (oldest deadline 2024-06-18T02:22:45.682048+0000) 2024-06-18T02:22:57.544 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:57 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6[135631]: 2024-06-18T02:22:57.310+0000 7f03de13c640 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.7:6828 osd.3 since back 2024-06-18T02:22:30.784164+0000 front 2024-06-18T02:22:30.784186+0000 (oldest deadline 2024-06-18T02:22:54.884094+0000) 2024-06-18T02:22:58.043 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:57 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:57.764+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:07.225607+0000 front 2024-06-18T02:22:07.225544+0000 (oldest deadline 2024-06-18T02:22:31.325614+0000) 2024-06-18T02:22:58.043 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:57 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:57.764+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:15.927068+0000 front 2024-06-18T02:22:15.927019+0000 (oldest deadline 2024-06-18T02:22:41.226937+0000) 2024-06-18T02:22:58.043 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:57 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:57.764+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6820 osd.2 since back 2024-06-18T02:22:23.928688+0000 front 2024-06-18T02:22:23.928656+0000 (oldest deadline 2024-06-18T02:22:47.428611+0000) 2024-06-18T02:22:58.043 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:57 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:57.764+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6828 osd.3 since back 2024-06-18T02:22:27.929461+0000 front 2024-06-18T02:22:27.929528+0000 (oldest deadline 2024-06-18T02:22:53.129648+0000) 2024-06-18T02:22:58.369 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:58 smithi130 podman[159787]: 2024-06-18 02:22:58.103544227 +0000 UTC m=+5.547638166 container died eb813977281a549932896ccb9368b650ab41e6b9ed82cef6d4bcd437d9dc75d4 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6, RELEASE=squid-3781e3a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240612, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_BRANCH=HEAD) 2024-06-18T02:22:58.793 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:58 smithi130 podman[159787]: 2024-06-18 02:22:58.552641437 +0000 UTC m=+5.996735368 container cleanup eb813977281a549932896ccb9368b650ab41e6b9ed82cef6d4bcd437d9dc75d4 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-3781e3a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240612, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-06-18T02:22:58.793 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:58 smithi130 bash[159787]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6 2024-06-18T02:22:59.212 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:58 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:58.804+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:07.225607+0000 front 2024-06-18T02:22:07.225544+0000 (oldest deadline 2024-06-18T02:22:31.325614+0000) 2024-06-18T02:22:59.213 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:58 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:58.804+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:15.927068+0000 front 2024-06-18T02:22:15.927019+0000 (oldest deadline 2024-06-18T02:22:41.226937+0000) 2024-06-18T02:22:59.213 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:58 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:58.804+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6820 osd.2 since back 2024-06-18T02:22:23.928688+0000 front 2024-06-18T02:22:23.928656+0000 (oldest deadline 2024-06-18T02:22:47.428611+0000) 2024-06-18T02:22:59.213 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:58 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:58.804+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6828 osd.3 since back 2024-06-18T02:22:27.929461+0000 front 2024-06-18T02:22:27.929528+0000 (oldest deadline 2024-06-18T02:22:53.129648+0000) 2024-06-18T02:22:59.214 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:58 smithi130 podman[159815]: 2024-06-18 02:22:58.879299784 +0000 UTC m=+0.771668594 container remove eb813977281a549932896ccb9368b650ab41e6b9ed82cef6d4bcd437d9dc75d4 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240612, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, RELEASE=squid-3781e3a, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-18T02:22:59.489 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:59 smithi130 podman[159905]: 2024-06-18 02:22:59.213432281 +0000 UTC m=+0.101307634 container create a12bce1b8d44ef6a74c0758fce1696553f318e4fb3beb108cce5a658cddd6fd6 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6-deactivate, org.label-schema.build-date=20240612, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, RELEASE=squid-3781e3a, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-06-18T02:22:59.490 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:59 smithi130 podman[159905]: 2024-06-18 02:22:59.129694198 +0000 UTC m=+0.017569508 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:22:59.490 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:59 smithi130 podman[159905]: 2024-06-18 02:22:59.415446348 +0000 UTC m=+0.303321657 container init a12bce1b8d44ef6a74c0758fce1696553f318e4fb3beb108cce5a658cddd6fd6 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240612, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, RELEASE=squid-3781e3a, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-06-18T02:22:59.490 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:59 smithi130 podman[159905]: 2024-06-18 02:22:59.418594085 +0000 UTC m=+0.306469396 container start a12bce1b8d44ef6a74c0758fce1696553f318e4fb3beb108cce5a658cddd6fd6 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6-deactivate, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.license=GPLv2, RELEASE=squid-3781e3a, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.build-date=20240612) 2024-06-18T02:22:59.490 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:59 smithi130 podman[159905]: 2024-06-18 02:22:59.490497593 +0000 UTC m=+0.378372904 container attach a12bce1b8d44ef6a74c0758fce1696553f318e4fb3beb108cce5a658cddd6fd6 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-3781e3a, org.label-schema.vendor=CentOS, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240612, io.buildah.version=1.36.0) 2024-06-18T02:22:59.793 INFO:journalctl@ceph.osd.6.smithi130.stdout:Jun 18 02:22:59 smithi130 podman[159905]: 2024-06-18 02:22:59.671795169 +0000 UTC m=+0.559670480 container died a12bce1b8d44ef6a74c0758fce1696553f318e4fb3beb108cce5a658cddd6fd6 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-6-deactivate, io.buildah.version=1.36.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-3781e3a, GIT_CLEAN=True, org.label-schema.build-date=20240612, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47) 2024-06-18T02:23:00.293 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:59 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:59.848+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:07.225607+0000 front 2024-06-18T02:22:07.225544+0000 (oldest deadline 2024-06-18T02:22:31.325614+0000) 2024-06-18T02:23:00.294 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:59 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:59.848+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:15.927068+0000 front 2024-06-18T02:22:15.927019+0000 (oldest deadline 2024-06-18T02:22:41.226937+0000) 2024-06-18T02:23:00.294 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:59 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:59.848+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6820 osd.2 since back 2024-06-18T02:22:23.928688+0000 front 2024-06-18T02:22:23.928656+0000 (oldest deadline 2024-06-18T02:22:47.428611+0000) 2024-06-18T02:23:00.294 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:22:59 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:22:59.848+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6828 osd.3 since back 2024-06-18T02:22:27.929461+0000 front 2024-06-18T02:22:27.929528+0000 (oldest deadline 2024-06-18T02:22:53.129648+0000) 2024-06-18T02:23:00.412 DEBUG:teuthology.orchestra.run.smithi130:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.6.service' 2024-06-18T02:23:00.454 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-18T02:23:00.454 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-06-18T02:23:00.454 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-06-18T02:23:00.455 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.7 2024-06-18T02:23:00.779 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:23:00 smithi130 systemd[1]: Stopping Ceph osd.7 for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:23:01.043 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:23:00 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:23:00.779+0000 7f69ce695640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-18T02:23:01.043 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:23:00 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:23:00.779+0000 7f69ce695640 -1 osd.7 196 *** Got signal Terminated *** 2024-06-18T02:23:01.043 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:23:00 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:23:00.779+0000 7f69ce695640 -1 osd.7 196 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-18T02:23:01.044 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:23:00 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:23:00.893+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:07.225607+0000 front 2024-06-18T02:22:07.225544+0000 (oldest deadline 2024-06-18T02:22:31.325614+0000) 2024-06-18T02:23:01.044 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:23:00 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:23:00.893+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:15.927068+0000 front 2024-06-18T02:22:15.927019+0000 (oldest deadline 2024-06-18T02:22:41.226937+0000) 2024-06-18T02:23:01.044 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:23:00 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:23:00.893+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6820 osd.2 since back 2024-06-18T02:22:23.928688+0000 front 2024-06-18T02:22:23.928656+0000 (oldest deadline 2024-06-18T02:22:47.428611+0000) 2024-06-18T02:23:01.044 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:23:00 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:23:00.893+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6828 osd.3 since back 2024-06-18T02:22:27.929461+0000 front 2024-06-18T02:22:27.929528+0000 (oldest deadline 2024-06-18T02:22:53.129648+0000) 2024-06-18T02:23:02.293 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:23:01 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:23:01.849+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:07.225607+0000 front 2024-06-18T02:22:07.225544+0000 (oldest deadline 2024-06-18T02:22:31.325614+0000) 2024-06-18T02:23:02.293 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:23:01 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:23:01.849+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:15.927068+0000 front 2024-06-18T02:22:15.927019+0000 (oldest deadline 2024-06-18T02:22:41.226937+0000) 2024-06-18T02:23:02.293 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:23:01 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:23:01.849+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6820 osd.2 since back 2024-06-18T02:22:23.928688+0000 front 2024-06-18T02:22:23.928656+0000 (oldest deadline 2024-06-18T02:22:47.428611+0000) 2024-06-18T02:23:02.293 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:23:01 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:23:01.849+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6828 osd.3 since back 2024-06-18T02:22:27.929461+0000 front 2024-06-18T02:22:27.929528+0000 (oldest deadline 2024-06-18T02:22:53.129648+0000) 2024-06-18T02:23:03.293 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:23:02 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:23:02.898+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:07.225607+0000 front 2024-06-18T02:22:07.225544+0000 (oldest deadline 2024-06-18T02:22:31.325614+0000) 2024-06-18T02:23:03.293 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:23:02 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:23:02.898+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:15.927068+0000 front 2024-06-18T02:22:15.927019+0000 (oldest deadline 2024-06-18T02:22:41.226937+0000) 2024-06-18T02:23:03.293 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:23:02 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:23:02.898+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6820 osd.2 since back 2024-06-18T02:22:23.928688+0000 front 2024-06-18T02:22:23.928656+0000 (oldest deadline 2024-06-18T02:22:47.428611+0000) 2024-06-18T02:23:03.293 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:23:02 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:23:02.898+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6828 osd.3 since back 2024-06-18T02:22:27.929461+0000 front 2024-06-18T02:22:27.929528+0000 (oldest deadline 2024-06-18T02:22:53.129648+0000) 2024-06-18T02:23:03.294 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:23:02 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:23:02.898+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.130:6804 osd.4 since back 2024-06-18T02:22:37.631207+0000 front 2024-06-18T02:22:37.631327+0000 (oldest deadline 2024-06-18T02:23:02.331254+0000) 2024-06-18T02:23:04.200 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:23:03 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:23:03.881+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:07.225607+0000 front 2024-06-18T02:22:07.225544+0000 (oldest deadline 2024-06-18T02:22:31.325614+0000) 2024-06-18T02:23:04.200 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:23:03 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:23:03.881+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:15.927068+0000 front 2024-06-18T02:22:15.927019+0000 (oldest deadline 2024-06-18T02:22:41.226937+0000) 2024-06-18T02:23:04.200 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:23:03 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:23:03.881+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6820 osd.2 since back 2024-06-18T02:22:23.928688+0000 front 2024-06-18T02:22:23.928656+0000 (oldest deadline 2024-06-18T02:22:47.428611+0000) 2024-06-18T02:23:04.200 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:23:03 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:23:03.881+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6828 osd.3 since back 2024-06-18T02:22:27.929461+0000 front 2024-06-18T02:22:27.929528+0000 (oldest deadline 2024-06-18T02:22:53.129648+0000) 2024-06-18T02:23:04.200 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:23:03 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:23:03.881+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.130:6804 osd.4 since back 2024-06-18T02:22:37.631207+0000 front 2024-06-18T02:22:37.631327+0000 (oldest deadline 2024-06-18T02:23:02.331254+0000) 2024-06-18T02:23:05.293 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:23:04 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:23:04.842+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6804 osd.0 since back 2024-06-18T02:22:07.225607+0000 front 2024-06-18T02:22:07.225544+0000 (oldest deadline 2024-06-18T02:22:31.325614+0000) 2024-06-18T02:23:05.293 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:23:04 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:23:04.842+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6812 osd.1 since back 2024-06-18T02:22:15.927068+0000 front 2024-06-18T02:22:15.927019+0000 (oldest deadline 2024-06-18T02:22:41.226937+0000) 2024-06-18T02:23:05.293 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:23:04 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:23:04.842+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6820 osd.2 since back 2024-06-18T02:22:23.928688+0000 front 2024-06-18T02:22:23.928656+0000 (oldest deadline 2024-06-18T02:22:47.428611+0000) 2024-06-18T02:23:05.294 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:23:04 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:23:04.842+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.7:6828 osd.3 since back 2024-06-18T02:22:27.929461+0000 front 2024-06-18T02:22:27.929528+0000 (oldest deadline 2024-06-18T02:22:53.129648+0000) 2024-06-18T02:23:05.294 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:23:04 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7[146478]: 2024-06-18T02:23:04.842+0000 7f69cacab640 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.130:6804 osd.4 since back 2024-06-18T02:22:37.631207+0000 front 2024-06-18T02:22:37.631327+0000 (oldest deadline 2024-06-18T02:23:02.331254+0000) 2024-06-18T02:23:06.415 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:23:06 smithi130 podman[160008]: 2024-06-18 02:23:06.123246746 +0000 UTC m=+5.446775721 container died 315f4e6d26b8d91073c7ebf653c5e4032d0cfbd3da071aa518af8ae0ffdf131d (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, RELEASE=squid-3781e3a, org.label-schema.build-date=20240612, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0) 2024-06-18T02:23:06.693 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:23:06 smithi130 podman[160008]: 2024-06-18 02:23:06.599982763 +0000 UTC m=+5.923511779 container cleanup 315f4e6d26b8d91073c7ebf653c5e4032d0cfbd3da071aa518af8ae0ffdf131d (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240612, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-3781e3a, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, org.label-schema.vendor=CentOS) 2024-06-18T02:23:06.693 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:23:06 smithi130 bash[160008]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7 2024-06-18T02:23:07.260 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:23:07 smithi130 podman[160721]: 2024-06-18 02:23:07.044632571 +0000 UTC m=+0.421384788 container died 99c2ab34e8039ea3a2a729b65313ec54e07f0fa7e63e0070f48a91b40d84b89d (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=elated_tharp, GIT_CLEAN=True, distribution-scope=public, RELEASE=HEAD, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.openshift.tags=base centos centos-stream, build-date=2022-05-03T08:36:31.336870, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.buildah.version=1.19.8, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, CEPH_POINT_RELEASE=-17.2.0, ceph=True, io.openshift.expose-services=, maintainer=Guillaume Abrioux , io.k8s.display-name=CentOS Stream 8, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, release=754, GIT_BRANCH=HEAD, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, vcs-type=git, name=centos-stream, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, version=8, com.redhat.component=centos-stream-container, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., architecture=x86_64, GIT_REPO=https://github.com/ceph/ceph-container.git, vendor=Red Hat, Inc.) 2024-06-18T02:23:07.901 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:23:07 smithi130 podman[160704]: 2024-06-18 02:23:07.79040363 +0000 UTC m=+1.655365918 container remove 315f4e6d26b8d91073c7ebf653c5e4032d0cfbd3da071aa518af8ae0ffdf131d (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240612, org.label-schema.license=GPLv2, RELEASE=squid-3781e3a, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-06-18T02:23:08.812 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:23:08 smithi130 podman[160868]: 2024-06-18 02:23:08.461497125 +0000 UTC m=+0.016961112 image pull af93c036e0161a7a6f4fcb3f1f48acaac5cf4ef8953c6a8b104629a4b86fec44 quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00 2024-06-18T02:23:08.812 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:23:08 smithi130 podman[160868]: 2024-06-18 02:23:08.560356117 +0000 UTC m=+0.115820097 container create 34e7f4635ed17b9c68e3481fd10ced1cff99c5c45af586a966df70c1457fa947 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-3781e3a, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240612, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_BRANCH=HEAD, ceph=True) 2024-06-18T02:23:08.812 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:23:08 smithi130 podman[160868]: 2024-06-18 02:23:08.813509758 +0000 UTC m=+0.368973748 container init 34e7f4635ed17b9c68e3481fd10ced1cff99c5c45af586a966df70c1457fa947 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-3781e3a, org.label-schema.build-date=20240612, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-06-18T02:23:09.093 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:23:08 smithi130 podman[160868]: 2024-06-18 02:23:08.818095664 +0000 UTC m=+0.373559646 container start 34e7f4635ed17b9c68e3481fd10ced1cff99c5c45af586a966df70c1457fa947 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7-deactivate, maintainer=Guillaume Abrioux , RELEASE=squid-3781e3a, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, io.buildah.version=1.36.0, org.label-schema.build-date=20240612, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2) 2024-06-18T02:23:09.093 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:23:08 smithi130 podman[160868]: 2024-06-18 02:23:08.921528002 +0000 UTC m=+0.476991990 container attach 34e7f4635ed17b9c68e3481fd10ced1cff99c5c45af586a966df70c1457fa947 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-3781e3a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.build-date=20240612, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, GIT_BRANCH=HEAD) 2024-06-18T02:23:10.043 INFO:journalctl@ceph.osd.7.smithi130.stdout:Jun 18 02:23:09 smithi130 podman[160868]: 2024-06-18 02:23:09.724242022 +0000 UTC m=+1.279706013 container died 34e7f4635ed17b9c68e3481fd10ced1cff99c5c45af586a966df70c1457fa947 (image=quay.ceph.io/ceph-ci/ceph:3781e3a592387d16e8020f5db99cdee4198f6d00, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240612, GIT_BRANCH=HEAD, RELEASE=squid-3781e3a, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=4a8012357b057f80e264ea5a6c36c04375a85d47, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-06-18T02:23:10.484 DEBUG:teuthology.orchestra.run.smithi130:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@osd.7.service' 2024-06-18T02:23:10.531 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-18T02:23:10.531 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-06-18T02:23:10.531 INFO:tasks.cephadm.prometheus.a:Stopping prometheus.a... 2024-06-18T02:23:10.531 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@prometheus.a 2024-06-18T02:23:10.794 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:23:10 smithi130 systemd[1]: Stopping Ceph prometheus.a for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:23:10.795 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:23:10 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:23:10.690Z caller=main.go:775 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-06-18T02:23:10.795 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:23:10 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:23:10.690Z caller=main.go:798 level=info msg="Stopping scrape discovery manager..." 2024-06-18T02:23:10.795 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:23:10 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:23:10.690Z caller=main.go:812 level=info msg="Stopping notify discovery manager..." 2024-06-18T02:23:10.795 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:23:10 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:23:10.690Z caller=main.go:834 level=info msg="Stopping scrape manager..." 2024-06-18T02:23:10.795 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:23:10 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:23:10.690Z caller=main.go:794 level=info msg="Scrape discovery manager stopped" 2024-06-18T02:23:10.795 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:23:10 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:23:10.690Z caller=main.go:808 level=info msg="Notify discovery manager stopped" 2024-06-18T02:23:10.795 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:23:10 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:23:10.690Z caller=manager.go:945 level=info component="rule manager" msg="Stopping rule manager..." 2024-06-18T02:23:10.795 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:23:10 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:23:10.690Z caller=main.go:828 level=info msg="Scrape manager stopped" 2024-06-18T02:23:10.795 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:23:10 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:23:10.690Z caller=manager.go:955 level=info component="rule manager" msg="Rule manager stopped" 2024-06-18T02:23:10.795 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:23:10 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:23:10.690Z caller=notifier.go:600 level=info component=notifier msg="Stopping notification manager..." 2024-06-18T02:23:10.795 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:23:10 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:23:10.690Z caller=main.go:1054 level=info msg="Notifier manager stopped" 2024-06-18T02:23:10.795 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:23:10 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a[61968]: ts=2024-06-18T02:23:10.690Z caller=main.go:1066 level=info msg="See you next time!" 2024-06-18T02:23:10.795 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:23:10 smithi130 podman[160983]: 2024-06-18 02:23:10.700867992 +0000 UTC m=+0.113086511 container died e905fb2eb4a61a5202ae703be971b061154f41907e0f50ed3aebcacaf52a499f (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-06-18T02:23:11.293 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:23:11 smithi130 podman[160983]: 2024-06-18 02:23:11.156281982 +0000 UTC m=+0.568500543 container cleanup e905fb2eb4a61a5202ae703be971b061154f41907e0f50ed3aebcacaf52a499f (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-06-18T02:23:11.294 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:23:11 smithi130 bash[160983]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus-a 2024-06-18T02:23:11.294 INFO:journalctl@ceph.prometheus.a.smithi130.stdout:Jun 18 02:23:11 smithi130 bash[161010]: Error: no container with name or ID "ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-prometheus.a" found: no such container 2024-06-18T02:23:11.462 DEBUG:teuthology.orchestra.run.smithi130:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@prometheus.a.service' 2024-06-18T02:23:11.503 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-18T02:23:11.503 INFO:tasks.cephadm.prometheus.a:Stopped prometheus.a 2024-06-18T02:23:11.504 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 --force --keep-logs 2024-06-18T02:23:13.643 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:23:13 smithi007 systemd[1]: Stopping Ceph node-exporter.a for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:23:13.643 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:23:13 smithi007 podman[192797]: 2024-06-18 02:23:13.396980774 +0000 UTC m=+0.120152126 container died 8128e558f0990350967b5972128368e8bcea326afb063ce8355d3739d046926d (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-06-18T02:23:13.931 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:23:13 smithi007 podman[192797]: 2024-06-18 02:23:13.819205775 +0000 UTC m=+0.542377125 container cleanup 8128e558f0990350967b5972128368e8bcea326afb063ce8355d3739d046926d (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-06-18T02:23:13.931 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:23:13 smithi007 bash[192797]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a 2024-06-18T02:23:14.406 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:23:14 smithi007 systemd[1]: Stopping Ceph alertmanager.a for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:23:14.407 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:23:14 smithi007 podman[192810]: 2024-06-18 02:23:14.062830433 +0000 UTC m=+0.669541127 container remove 8128e558f0990350967b5972128368e8bcea326afb063ce8355d3739d046926d (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-06-18T02:23:14.407 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:23:14 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@node-exporter.a.service: Main process exited, code=exited, status=143/n/a 2024-06-18T02:23:14.407 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:23:14 smithi007 bash[192825]: Error: no container with name or ID "ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter.a" found: no such container 2024-06-18T02:23:14.407 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:23:14 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@node-exporter.a.service: Failed with result 'exit-code'. 2024-06-18T02:23:14.407 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:23:14 smithi007 systemd[1]: Stopped Ceph node-exporter.a for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:23:14.407 INFO:journalctl@ceph.node-exporter.a.smithi007.stdout:Jun 18 02:23:14 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@node-exporter.a.service: Consumed 5.617s CPU time. 2024-06-18T02:23:14.681 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:23:14 smithi007 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a[63807]: level=info ts=2024-06-18T02:23:14.407Z caller=main.go:557 msg="Received SIGTERM, exiting gracefully..." 2024-06-18T02:23:14.681 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:23:14 smithi007 podman[192878]: 2024-06-18 02:23:14.448593375 +0000 UTC m=+0.141160797 container died 5994e8525c64b2f3c089a6ffa1c0f9dec524d3cec2e1fc2ba2dd2d0521ca9db9 (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-06-18T02:23:15.057 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:23:14 smithi007 podman[192878]: 2024-06-18 02:23:14.807815365 +0000 UTC m=+0.500382786 container cleanup 5994e8525c64b2f3c089a6ffa1c0f9dec524d3cec2e1fc2ba2dd2d0521ca9db9 (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-06-18T02:23:15.057 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:23:14 smithi007 bash[192878]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a 2024-06-18T02:23:15.057 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:23:14 smithi007 bash[192906]: Error: no container with name or ID "ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager.a" found: no such container 2024-06-18T02:23:15.353 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:23:15 smithi007 podman[192890]: 2024-06-18 02:23:15.058849543 +0000 UTC m=+0.602739887 container remove 5994e8525c64b2f3c089a6ffa1c0f9dec524d3cec2e1fc2ba2dd2d0521ca9db9 (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-06-18T02:23:15.353 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:23:15 smithi007 podman[192890]: 2024-06-18 02:23:15.151428909 +0000 UTC m=+0.695319268 volume remove 3cf3e54fbf1f52194f8d68819be321185ff7dc186406dec6e061b6aaa5399dc4 2024-06-18T02:23:15.353 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:23:15 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@alertmanager.a.service: Deactivated successfully. 2024-06-18T02:23:15.353 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:23:15 smithi007 systemd[1]: Stopped Ceph alertmanager.a for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:23:15.354 INFO:journalctl@ceph.alertmanager.a.smithi007.stdout:Jun 18 02:23:15 smithi007 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@alertmanager.a.service: Consumed 1.489s CPU time. 2024-06-18T02:23:49.624 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 --force --keep-logs 2024-06-18T02:23:53.191 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:23:53 smithi130 systemd[1]: Stopping Ceph node-exporter.b for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:23:53.543 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:23:53 smithi130 podman[162319]: 2024-06-18 02:23:53.192429616 +0000 UTC m=+0.101303617 container died bab93b43cf16c67e0d51cd4b318d5c663ef64e31afb4174201d2415c529abad5 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-06-18T02:23:54.043 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:23:53 smithi130 podman[162319]: 2024-06-18 02:23:53.698851046 +0000 UTC m=+0.607725088 container cleanup bab93b43cf16c67e0d51cd4b318d5c663ef64e31afb4174201d2415c529abad5 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-06-18T02:23:54.043 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:23:53 smithi130 bash[162319]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b 2024-06-18T02:23:54.043 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:23:53 smithi130 bash[162346]: Error: no container with name or ID "ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter.b" found: no such container 2024-06-18T02:23:54.044 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:23:53 smithi130 podman[162330]: 2024-06-18 02:23:53.916595724 +0000 UTC m=+0.724308059 container remove bab93b43cf16c67e0d51cd4b318d5c663ef64e31afb4174201d2415c529abad5 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-06-18T02:23:54.044 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:23:53 smithi130 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@node-exporter.b.service: Main process exited, code=exited, status=143/n/a 2024-06-18T02:23:54.044 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:23:53 smithi130 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@node-exporter.b.service: Failed with result 'exit-code'. 2024-06-18T02:23:54.044 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:23:53 smithi130 systemd[1]: Stopped Ceph node-exporter.b for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:23:54.044 INFO:journalctl@ceph.node-exporter.b.smithi130.stdout:Jun 18 02:23:53 smithi130 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@node-exporter.b.service: Consumed 5.018s CPU time. 2024-06-18T02:23:54.485 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:23:54 smithi130 systemd[1]: Stopping Ceph grafana.a for cd9a3408-2d15-11ef-bc9d-c7b262605968... 2024-06-18T02:23:54.485 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:23:54 smithi130 ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a[55577]: t=2024-06-18T02:23:54+0000 lvl=info msg="Shutdown started" logger=server reason="System signal: terminated" 2024-06-18T02:23:54.485 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:23:54 smithi130 podman[162398]: 2024-06-18 02:23:54.221939104 +0000 UTC m=+0.111679130 container died 70ba81d97c8e90c3868d027746ef3dd8099fd81eb528839065e8b8163d29bc9b (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vendor=Red Hat, Inc., architecture=x86_64, build-date=2022-03-28T10:36:18.413762, release=236.1648460182, name=ubi8, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, vcs-type=git, version=8.5, maintainer=Paul Cuzner , io.openshift.tags=base rhel8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, summary=Grafana Container configured for Ceph mgr/dashboard integration, description=Ceph Grafana Container, io.k8s.display-name=Red Hat Universal Base Image 8, io.buildah.version=1.24.2, io.openshift.expose-services=, com.redhat.component=ubi8-container, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, distribution-scope=public) 2024-06-18T02:23:54.793 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:23:54 smithi130 podman[162398]: 2024-06-18 02:23:54.652934469 +0000 UTC m=+0.542674482 container cleanup 70ba81d97c8e90c3868d027746ef3dd8099fd81eb528839065e8b8163d29bc9b (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a, com.redhat.component=ubi8-container, io.buildah.version=1.24.2, distribution-scope=public, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, description=Ceph Grafana Container, maintainer=Paul Cuzner , vcs-type=git, version=8.5, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, name=ubi8, io.k8s.display-name=Red Hat Universal Base Image 8, io.openshift.expose-services=, build-date=2022-03-28T10:36:18.413762, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., summary=Grafana Container configured for Ceph mgr/dashboard integration, io.openshift.tags=base rhel8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, vendor=Red Hat, Inc., release=236.1648460182, architecture=x86_64) 2024-06-18T02:23:54.793 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:23:54 smithi130 bash[162398]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a 2024-06-18T02:23:55.293 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:23:54 smithi130 podman[162412]: 2024-06-18 02:23:54.896263175 +0000 UTC m=+0.676483741 container remove 70ba81d97c8e90c3868d027746ef3dd8099fd81eb528839065e8b8163d29bc9b (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana-a, io.k8s.display-name=Red Hat Universal Base Image 8, io.openshift.expose-services=, maintainer=Paul Cuzner , com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, vcs-type=git, version=8.5, name=ubi8, com.redhat.component=ubi8-container, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, vendor=Red Hat, Inc., com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, summary=Grafana Container configured for Ceph mgr/dashboard integration, io.buildah.version=1.24.2, description=Ceph Grafana Container, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., release=236.1648460182, distribution-scope=public, architecture=x86_64, build-date=2022-03-28T10:36:18.413762, io.openshift.tags=base rhel8) 2024-06-18T02:23:55.293 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:23:54 smithi130 bash[162425]: Error: no container with name or ID "ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968-grafana.a" found: no such container 2024-06-18T02:23:55.293 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:23:54 smithi130 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@grafana.a.service: Deactivated successfully. 2024-06-18T02:23:55.294 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:23:54 smithi130 systemd[1]: Stopped Ceph grafana.a for cd9a3408-2d15-11ef-bc9d-c7b262605968. 2024-06-18T02:23:55.294 INFO:journalctl@ceph.grafana.a.smithi130.stdout:Jun 18 02:23:54 smithi130 systemd[1]: ceph-cd9a3408-2d15-11ef-bc9d-c7b262605968@grafana.a.service: Consumed 5.785s CPU time. 2024-06-18T02:24:18.111 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-18T02:24:18.146 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-18T02:24:18.177 INFO:tasks.cephadm:Archiving crash dumps... 2024-06-18T02:24:18.179 DEBUG:teuthology.misc:Transferring archived files from smithi007:/var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-06-17_21:08:03-orch-squid-distro-default-smithi/7760393/remote/smithi007/crash 2024-06-18T02:24:18.180 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar c -f - -C /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/crash -- . 2024-06-18T02:24:18.332 INFO:teuthology.orchestra.run.smithi007.stderr:tar: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/crash: Cannot open: No such file or directory 2024-06-18T02:24:18.333 INFO:teuthology.orchestra.run.smithi007.stderr:tar: Error is not recoverable: exiting now 2024-06-18T02:24:18.335 DEBUG:teuthology.misc:Transferring archived files from smithi130:/var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-06-17_21:08:03-orch-squid-distro-default-smithi/7760393/remote/smithi130/crash 2024-06-18T02:24:18.336 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar c -f - -C /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/crash -- . 2024-06-18T02:24:18.381 INFO:teuthology.orchestra.run.smithi130.stderr:tar: /var/lib/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/crash: Cannot open: No such file or directory 2024-06-18T02:24:18.381 INFO:teuthology.orchestra.run.smithi130.stderr:tar: Error is not recoverable: exiting now 2024-06-18T02:24:18.383 INFO:tasks.cephadm:Checking cluster log for badness... 2024-06-18T02:24:18.383 DEBUG:teuthology.orchestra.run.smithi007:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph.log | egrep CEPHADM_ | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2024-06-18T02:24:18.417 INFO:teuthology.orchestra.run.smithi007.stdout:2024-06-18T01:58:27.892278+0000 mon.a (mon.0) 370 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-06-18T02:24:18.417 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-06-18T02:24:18.417 DEBUG:teuthology.orchestra.run.smithi007:> sudo egrep '\[SEC\]' /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph.log | egrep CEPHADM_ | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2024-06-18T02:24:18.487 DEBUG:teuthology.orchestra.run.smithi007:> sudo egrep '\[ERR\]' /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph.log | egrep CEPHADM_ | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2024-06-18T02:24:18.556 DEBUG:teuthology.orchestra.run.smithi007:> sudo egrep '\[WRN\]' /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph.log | egrep CEPHADM_ | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2024-06-18T02:24:18.625 INFO:teuthology.orchestra.run.smithi007.stdout:2024-06-18T01:58:27.892278+0000 mon.a (mon.0) 370 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-06-18T02:24:18.625 INFO:tasks.cephadm:Compressing logs... 2024-06-18T02:24:18.625 DEBUG:teuthology.orchestra.run.smithi007:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-06-18T02:24:18.668 DEBUG:teuthology.orchestra.run.smithi130:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-06-18T02:24:18.691 INFO:teuthology.orchestra.run.smithi007.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-06-18T02:24:18.691 INFO:teuthology.orchestra.run.smithi007.stderr:: No such file or directory 2024-06-18T02:24:18.691 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph.log 2024-06-18T02:24:18.691 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph-osd.2.log 2024-06-18T02:24:18.693 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph.audit.log 2024-06-18T02:24:18.693 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph.log: /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph-osd.3.log 2024-06-18T02:24:18.693 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph-osd.1.log 2024-06-18T02:24:18.693 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph.audit.log: /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph-mgr.y.log 2024-06-18T02:24:18.693 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph-osd.0.log 2024-06-18T02:24:18.697 INFO:teuthology.orchestra.run.smithi130.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log: No such file or directory 2024-06-18T02:24:18.697 INFO:teuthology.orchestra.run.smithi130.stderr: 2024-06-18T02:24:18.697 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph.log 2024-06-18T02:24:18.698 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose --/var/log/ceph/cephadm.log: /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph.audit.log 2024-06-18T02:24:18.699 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph-mgr.y.log: 93.1% -- replaced with /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph.log.gz 2024-06-18T02:24:18.699 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph-mon.c.log 2024-06-18T02:24:18.700 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph-osd.7.log 2024-06-18T02:24:18.700 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph-osd.5.log 2024-06-18T02:24:18.701 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph-osd.7.log: 87.7% -- replaced with /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph.log.gz 2024-06-18T02:24:18.702 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph-mon.a.log 2024-06-18T02:24:18.707 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph-osd.4.log 2024-06-18T02:24:18.707 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph-mgr.x.log 2024-06-18T02:24:18.708 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph-client.rgw.smpl.smithi130.wwebfk.log 2024-06-18T02:24:18.712 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph-osd.6.log 2024-06-18T02:24:18.713 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph-client.rgw.smpl.smithi130.wwebfk.log: 75.9% -- replaced with /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph-client.rgw.smpl.smithi130.wwebfk.log.gz 2024-06-18T02:24:18.713 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph.cephadm.log 2024-06-18T02:24:18.716 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph-client.rgw.foo.smithi130.aakmof.log 2024-06-18T02:24:18.716 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph.cephadm.log 2024-06-18T02:24:18.721 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph.cephadm.log: 92.6% -- replaced with /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph.audit.log.gz 2024-06-18T02:24:18.723 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph-volume.log 2024-06-18T02:24:18.723 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph-client.rgw.foo.smithi130.aakmof.log: 91.5% -- replaced with /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph.cephadm.log.gz 2024-06-18T02:24:18.723 INFO:teuthology.orchestra.run.smithi130.stderr: 76.4% -- replaced with /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph-client.rgw.foo.smithi130.aakmof.log.gz 2024-06-18T02:24:18.723 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph-mon.b.log 2024-06-18T02:24:18.724 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph-mon.a.log: 90.3%gzip -5 --verbose -- /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/tcmu-runner.log 2024-06-18T02:24:18.724 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/cephadm.log.gz 2024-06-18T02:24:18.730 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph-volume.log: /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph-mon.b.log: 89.7% -- replaced with /var/log/ceph/cephadm.log.gz 2024-06-18T02:24:18.732 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph-client.rgw.foo.smithi007.dvbvbk.log 2024-06-18T02:24:18.733 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/tcmu-runner.log: 87.1% -- replaced with /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/tcmu-runner.log.gz 2024-06-18T02:24:18.734 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph-client.rgw.smpl.smithi007.hgrnmk.log 2024-06-18T02:24:18.735 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph-client.rgw.foo.smithi007.dvbvbk.log: 76.1% -- replaced with /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph-client.rgw.foo.smithi007.dvbvbk.log.gz 2024-06-18T02:24:18.741 INFO:teuthology.orchestra.run.smithi007.stderr: 95.3% -- replaced with /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph.audit.log.gz 2024-06-18T02:24:18.741 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph-volume.log 2024-06-18T02:24:18.742 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph-client.rgw.smpl.smithi007.hgrnmk.log: 76.1% -- replaced with /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph-client.rgw.smpl.smithi007.hgrnmk.log.gz 2024-06-18T02:24:18.748 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph-volume.log: 95.1% -- replaced with /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph.cephadm.log.gz 2024-06-18T02:24:18.777 INFO:teuthology.orchestra.run.smithi130.stderr: 92.1% -- replaced with /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph-volume.log.gz 2024-06-18T02:24:18.820 INFO:teuthology.orchestra.run.smithi007.stderr: 92.1% -- replaced with /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph-volume.log.gz 2024-06-18T02:24:18.944 INFO:teuthology.orchestra.run.smithi007.stderr: 87.5% -- replaced with /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph-mgr.y.log.gz 2024-06-18T02:24:19.475 INFO:teuthology.orchestra.run.smithi007.stderr: 92.7% -- replaced with /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph-mon.c.log.gz 2024-06-18T02:24:20.107 INFO:teuthology.orchestra.run.smithi130.stderr: 93.6% -- replaced with /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph-osd.6.log.gz 2024-06-18T02:24:20.292 INFO:teuthology.orchestra.run.smithi130.stderr: 88.8% -- replaced with /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph-mgr.x.log.gz 2024-06-18T02:24:20.302 INFO:teuthology.orchestra.run.smithi007.stderr: 93.7% -- replaced with /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph-osd.2.log.gz 2024-06-18T02:24:20.516 INFO:teuthology.orchestra.run.smithi130.stderr: 92.7% -- replaced with /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph-mon.b.log.gz 2024-06-18T02:24:20.670 INFO:teuthology.orchestra.run.smithi007.stderr: 93.7% -- replaced with /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph-osd.0.log.gz 2024-06-18T02:24:20.791 INFO:teuthology.orchestra.run.smithi130.stderr: 93.9% -- replaced with /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph-osd.4.log.gz 2024-06-18T02:24:20.868 INFO:teuthology.orchestra.run.smithi007.stderr: 91.6% -- replaced with /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph-mon.a.log.gz 2024-06-18T02:24:21.014 INFO:teuthology.orchestra.run.smithi130.stderr: 94.0% -- replaced with /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph-osd.7.log.gz 2024-06-18T02:24:21.032 INFO:teuthology.orchestra.run.smithi130.stderr: 93.7% -- replaced with /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph-osd.5.log.gz 2024-06-18T02:24:21.033 INFO:teuthology.orchestra.run.smithi130.stderr: 2024-06-18T02:24:21.034 INFO:teuthology.orchestra.run.smithi130.stderr:real 0m2.351s 2024-06-18T02:24:21.034 INFO:teuthology.orchestra.run.smithi130.stderr:user 0m11.208s 2024-06-18T02:24:21.034 INFO:teuthology.orchestra.run.smithi130.stderr:sys 0m0.419s 2024-06-18T02:24:21.138 INFO:teuthology.orchestra.run.smithi007.stderr: 93.8% -- replaced with /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph-osd.1.log.gz 2024-06-18T02:24:21.536 INFO:teuthology.orchestra.run.smithi007.stderr: 93.8% -- replaced with /var/log/ceph/cd9a3408-2d15-11ef-bc9d-c7b262605968/ceph-osd.3.log.gz 2024-06-18T02:24:21.540 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-06-18T02:24:21.540 INFO:teuthology.orchestra.run.smithi007.stderr:real 0m2.858s 2024-06-18T02:24:21.540 INFO:teuthology.orchestra.run.smithi007.stderr:user 0m11.694s 2024-06-18T02:24:21.540 INFO:teuthology.orchestra.run.smithi007.stderr:sys 0m0.389s 2024-06-18T02:24:21.540 INFO:tasks.cephadm:Archiving logs... 2024-06-18T02:24:21.540 DEBUG:teuthology.misc:Transferring archived files from smithi007:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-06-17_21:08:03-orch-squid-distro-default-smithi/7760393/remote/smithi007/log 2024-06-18T02:24:21.541 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar c -f - -C /var/log/ceph -- . 2024-06-18T02:24:22.984 DEBUG:teuthology.misc:Transferring archived files from smithi130:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-06-17_21:08:03-orch-squid-distro-default-smithi/7760393/remote/smithi130/log 2024-06-18T02:24:22.985 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar c -f - -C /var/log/ceph -- . 2024-06-18T02:24:24.393 INFO:tasks.cephadm:Removing cluster... 2024-06-18T02:24:24.393 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 --force 2024-06-18T02:24:24.702 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid cd9a3408-2d15-11ef-bc9d-c7b262605968 --force 2024-06-18T02:24:24.994 INFO:tasks.cephadm:Removing cephadm ... 2024-06-18T02:24:24.995 DEBUG:teuthology.orchestra.run.smithi007:> rm -rf /home/ubuntu/cephtest/cephadm 2024-06-18T02:24:25.012 DEBUG:teuthology.orchestra.run.smithi130:> rm -rf /home/ubuntu/cephtest/cephadm 2024-06-18T02:24:25.027 INFO:tasks.cephadm:Teardown complete 2024-06-18T02:24:25.027 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-06-18T02:24:25.037 INFO:teuthology.task.clock:Checking final clock skew... 2024-06-18T02:24:25.037 DEBUG:teuthology.orchestra.run.smithi007:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-18T02:24:25.055 DEBUG:teuthology.orchestra.run.smithi130:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-18T02:24:25.068 INFO:teuthology.orchestra.run.smithi007.stderr:bash: line 1: ntpq: command not found 2024-06-18T02:24:25.071 INFO:teuthology.orchestra.run.smithi007.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-18T02:24:25.072 INFO:teuthology.orchestra.run.smithi007.stdout:=============================================================================== 2024-06-18T02:24:25.072 INFO:teuthology.orchestra.run.smithi007.stdout:^* hv01.front.sepia.ceph.com 3 6 377 63 +497us[ +514us] +/- 53ms 2024-06-18T02:24:25.072 INFO:teuthology.orchestra.run.smithi007.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 61 -300us[ -300us] +/- 55ms 2024-06-18T02:24:25.072 INFO:teuthology.orchestra.run.smithi007.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 64 -330us[ -313us] +/- 84ms 2024-06-18T02:24:25.072 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-06-18T02:24:25.081 INFO:teuthology.orchestra.run.smithi130.stderr:bash: line 1: ntpq: command not found 2024-06-18T02:24:25.085 INFO:teuthology.orchestra.run.smithi130.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-18T02:24:25.085 INFO:teuthology.orchestra.run.smithi130.stdout:=============================================================================== 2024-06-18T02:24:25.085 INFO:teuthology.orchestra.run.smithi130.stdout:^* hv01.front.sepia.ceph.com 3 6 377 1 +511us[ +525us] +/- 54ms 2024-06-18T02:24:25.085 INFO:teuthology.orchestra.run.smithi130.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 60 -271us[ -256us] +/- 55ms 2024-06-18T02:24:25.085 INFO:teuthology.orchestra.run.smithi130.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 1 -370us[ -356us] +/- 85ms 2024-06-18T02:24:25.085 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-06-18T02:24:25.086 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-06-18T02:24:25.097 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-06-18T02:24:25.098 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-06-18T02:24:25.112 DEBUG:teuthology.orchestra.run.smithi007:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-06-18T02:24:25.233 DEBUG:teuthology.orchestra.run.smithi130:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-06-18T02:24:25.336 DEBUG:teuthology.orchestra.run.smithi007:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-06-18T02:24:25.367 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-18T02:24:25.368 DEBUG:teuthology.orchestra.run.smithi130:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-06-18T02:24:25.398 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-18T02:24:25.399 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-06-18T02:24:25.408 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-06-18T02:24:25.423 INFO:teuthology.task.internal:Duration was 2017.337928 seconds 2024-06-18T02:24:25.423 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-06-18T02:24:25.435 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-06-18T02:24:25.435 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-06-18T02:24:25.438 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-06-18T02:24:25.476 INFO:teuthology.orchestra.run.smithi007.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-18T02:24:25.478 INFO:teuthology.orchestra.run.smithi130.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-18T02:24:25.967 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-06-18T02:24:25.967 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi007.front.sepia.ceph.com 2024-06-18T02:24:25.967 DEBUG:teuthology.orchestra.run.smithi007:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-06-18T02:24:26.030 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi130.front.sepia.ceph.com 2024-06-18T02:24:26.030 DEBUG:teuthology.orchestra.run.smithi130:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-06-18T02:24:26.059 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-06-18T02:24:26.059 DEBUG:teuthology.orchestra.run.smithi007:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-06-18T02:24:26.073 DEBUG:teuthology.orchestra.run.smithi130:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-06-18T02:24:26.126 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-06-18T02:24:26.126 DEBUG:teuthology.orchestra.run.smithi007:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-06-18T02:24:26.141 DEBUG:teuthology.orchestra.run.smithi130:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-06-18T02:24:27.177 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-06-18T02:24:27.187 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-06-18T02:24:27.187 DEBUG:teuthology.orchestra.run.smithi007:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-06-18T02:24:27.213 DEBUG:teuthology.orchestra.run.smithi130:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-06-18T02:24:27.240 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-06-18T02:24:27.251 DEBUG:teuthology.orchestra.run.smithi007:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-06-18T02:24:27.256 DEBUG:teuthology.orchestra.run.smithi130:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-06-18T02:24:27.277 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern = core 2024-06-18T02:24:27.305 INFO:teuthology.orchestra.run.smithi130.stdout:kernel.core_pattern = core 2024-06-18T02:24:27.325 DEBUG:teuthology.orchestra.run.smithi007:> test -e /home/ubuntu/cephtest/archive/coredump 2024-06-18T02:24:27.369 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-18T02:24:27.369 DEBUG:teuthology.orchestra.run.smithi130:> test -e /home/ubuntu/cephtest/archive/coredump 2024-06-18T02:24:27.384 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-18T02:24:27.384 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-06-18T02:24:27.397 INFO:teuthology.task.internal:Transferring archived files... 2024-06-18T02:24:27.397 DEBUG:teuthology.misc:Transferring archived files from smithi007:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-06-17_21:08:03-orch-squid-distro-default-smithi/7760393/remote/smithi007 2024-06-18T02:24:27.397 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-06-18T02:24:27.467 DEBUG:teuthology.misc:Transferring archived files from smithi130:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-06-17_21:08:03-orch-squid-distro-default-smithi/7760393/remote/smithi130 2024-06-18T02:24:27.467 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-06-18T02:24:27.514 INFO:teuthology.task.internal:Removing archive directory... 2024-06-18T02:24:27.514 DEBUG:teuthology.orchestra.run.smithi007:> rm -rf -- /home/ubuntu/cephtest/archive 2024-06-18T02:24:27.516 DEBUG:teuthology.orchestra.run.smithi130:> rm -rf -- /home/ubuntu/cephtest/archive 2024-06-18T02:24:27.560 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-06-18T02:24:27.573 INFO:teuthology.task.internal:Not uploading archives. 2024-06-18T02:24:27.573 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-06-18T02:24:27.589 INFO:teuthology.task.internal:Tidying up after the test... 2024-06-18T02:24:27.590 DEBUG:teuthology.orchestra.run.smithi007:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-06-18T02:24:27.592 DEBUG:teuthology.orchestra.run.smithi130:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-06-18T02:24:27.605 INFO:teuthology.orchestra.run.smithi007.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 18 02:24 /home/ubuntu/cephtest 2024-06-18T02:24:27.615 INFO:teuthology.orchestra.run.smithi130.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 18 02:24 /home/ubuntu/cephtest 2024-06-18T02:24:27.616 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-06-18T02:24:27.629 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-06-18T02:24:27.662 INFO:teuthology.run:Summary data: description: orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/classic} duration: 2017.3379278182983 failure_reason: '"2024-06-18T01:58:27.892278+0000 mon.a (mon.0) 370 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log' owner: scheduled_teuthology@teuthology success: false 2024-06-18T02:24:27.662 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-06-18T02:24:27.746 INFO:teuthology.run:FAIL